Swift Package Plugins - Network Access

We are stuck on the same problem - building a KMP module from the SPM Plugin. However, are you sure that enabling the network access will be enough to make it work? I'm trying at least a CommandPlugin with both writeToPackageDirectory + allowNetworkConnections permissions and it successfully fetches binaries from gradle.org but then it fails with a following error:

org.gradle.api.UncheckedIOException: java.net.SocketException: Operation not permitted