You're not missing anything, swift build indeed does not support iOS. You can build your package on the commandline using xcodebuild, though.
You can use xcodebuild -list to see the available schemes and then use xcodebuild just like you would with an Xcode project, including passing -destination to build for iOS.