I suggest using Ninja instead of Xcode (by omitting the --xcode flag) because it's the tried-and-tested build system for this project.
You can still use Xcode to edit and commit changes, by creating an empty xcworkspace (File → New → Workspace) inside the "swift-project" directory, and adding a folder reference (File → Add Files…) of the "swift-project/swift" directory.