Can the dependency be built with SwiftPM by adding a manifest and declaring its product .dynamic? Then you could make the dependency on it explicit in your manifest and everything would just work.
Otherwise you’ll have to wait for binary dependencies or extensible build tools.