Error with Open Source Swift 6.0 Compiler

I've installed the Swift 6.0 compiler from Swift.org - Install Swift. Activated it as the in-use compiler with export TOOLCHAINS=$(plutil -extract CFBundleIdentifier raw /Library/Developer/Toolchains/swift-6.0-DEVELOPMENT-SNAPSHOT-2024-08-22-a.xctoolchain/Info.plist) and then i executed swift build but i got a really long error:
error: 'swift-nio-ssl': Invalid manifest... for many packages that i use in my project.

Do you have an Xcode beta installed and selected? If so, that would be fixed by Fix the build for newer Xcodes by al45tair · Pull Request #75902 · swiftlang/swift · GitHub. A workaround then is to switch to Xcode 15.4 with xcode-select -s.

Yes i have Xcode 16 Beta 6 and I forgot to specify that I am using macOS Sequoia 15.1 Beta 3.