This is something I've been wanting for a while. And seems somewhat related to other recently asked things like Is there any similar functionality existing or planned similar to dotNet's MEF system?.
If you want a plugin system I don't think Swift itself provides anything out of the box. But macOS has some plugin documentation that predates Swift.
But for running on the fly user input Swift code I don't think there is any other solution that embedding the compiler in the app.