I think this entire discussion is borne out of frustration because it isn't easy enough to use 3rd-party packages in Swift projects yet, so people jump to the idea of bundling everything as some kind of quasi-standard library.
I would suggest people refocus their energy towards improving the package manager. There are actually a couple of cool proposals floating around right now which could be a starting point for plugging those holes, e.g.: