Service worker doesn’t require any specific config in that case since it would cache assets requests by any of these apps as the requests happen. As a result, there is no need to “customize” the asset list for each app.

As far as other PWA features go, you would need one manifest.json per app to customize the icon, splash screen, URL, etc. for each app. I’ve actually done that for a client a few weeks ago and it worked great.