Binary frameworks are supported only in limited fashion by SwiftPM.
You cannot vend a package that has a dependency on a binary framework, and SwiftPM itself has no prescribed pattern for linking and depending on binaries in your packages.
See Binary Frameworks with SwiftPM, Distributing Binary (closed source) Libraries - #17 by Jon_Shier, and SPM Support for Binaries Distribution - #24 by hartbit