AFAICT you are correct, the best approach I've found is to have an absolutely minimalistic plugin that drives a command line tool that can have other dependencies. If you have multiple plugins, use multiple command lines tools (that can share other target dependencies as needed).
It's a bit unexpected at first (especially since one can add dependencies for the plugin - just not how you expect...).