Macros run in a sandbox, so they won't be able to link any external dynamic libraries. You may have more luck with building your XCFrameworks with static libraries which should at least work in theory.
I believe during the pitch phase, we did consider macros themselves to be shipped as statically linked binaries, but I don't remember the specifics of why we didn't do that.