How can I conditionally link a Swift package only for devices and not simulators?

Swift packages have no support for environment specification? Wouldn't that line up super super well with targetEnvironment?