Python error when building Swift source on macOS 12.3

jhowlin · 2022-03-30T21:53:06.944Z

Running into an error when attempting to build main using the following command (from the getting started docs):

  --skip-ios --skip-watchos --skip-tvos --swift-darwin-supported-archs "$(uname -m)" \
  --sccache --release-debuginfo --swift-disable-dead-stripping --test \
  --Xcode

Error:

--- Building earlyswiftdriver ---
+ /Users/jason/Documents/Swift/swift-project/swift-driver/Utilities/build-script-helper.py build --package-path /Users/jason/Documents/Swift/swift-project/swift-driver --build-path /Users/jason/Documents/Swift/swift-project/build/Xcode-RelWithDebInfoAssert/earlyswiftdriver-macosx-arm64 --configuration release --toolchain /Library/Developer/CommandLineTools/usr --ninja-bin /opt/homebrew/bin//ninja --cmake-bin /opt/homebrew/bin//cmake --local_compiler_build
env: python: No such file or directory
ERROR: command terminated with a non-zero exit status 127, aborting

Because macOS 12.3 removed python 2, there is no /usr/bin/python anymore. I can't add a symlink or re-install python 2 into that directory because of system integrity protection.

Any thoughts about how to resolve this? Thanks!

wowbagger · 2022-03-31T02:14:02.917Z

Maybe these 3 PRs can solve the problem:

github.com/apple/swift

Change `env python` to `env python3`

apple:main ← porglezomp-misc:epa-env-python-agency

opened 05:47PM - 23 Mar 22 UTC

porglezomp

+106 -107

I don't see any of the other PRs doing a full replacement of all the shebangs—th…is just changes all of them without doing any of the work to make sure that's fine.

github.com/apple/swift

[build-script] Drop Python2.7 from swift_cmake_options.

apple:main ← plotfi:main2

opened 07:44PM - 24 Mar 22 UTC

plotfi

+0 -1

Since Swift is dropping Python2 support, and since this xcrun line causes spuri…ous errors during a build-script build on systems without Python2, I am proposing we drop this xcrun -find line from build-script-impl. @gottesmm

github.com/apple/swift

[NFC] Remove Python 2 imports from future

apple:main ← dduan:dd/the-future-is-now

opened 08:46PM - 29 Mar 22 UTC

dduan

+104 -347

The `__future__` we relied on is now, where the 4 specific things are all incl…uded [since Python 3.0](https://docs.python.org/3/library/__future__.html): * absolute_import * print_function * unicode_literals * division These import statements will be no-ops and are no longer necessary.

LucianoPAlmeida · 2022-03-31T02:35:33.203Z

For this case in specific note that the error message says in which file the failure is happening /Users/jason/Documents/Swift/swift-project/swift-driver/Utilities/build-script-helper.py, so we can see that this is on swift driver dependency. I hit the same issue and while investigating noted that this was fixed but then reverted in Revert "Update build-script-helper.py to use python3" by shahmishal · Pull Request #1024 · apple/swift-driver · GitHub so there should be a good reason for that. For now if you want to unblock the build just manually editing those files #!/usr/bin/env python to #!/usr/bin/env python3 should help =]

LucianoPAlmeida · 2022-03-31T02:44:32.808Z

I think for running the build script command the only files you would have to change locally are /Users/jason/Documents/Swift/swift-project/swift-driver/Utilities/build-script-helper.py and the cmake one removing the python2.7 as [build-script] Drop Python2.7 from swift_cmake_options. by plotfi · Pull Request #42009 · apple/swift · GitHub, after changing that locally your command should run fine

jhowlin · 2022-03-31T15:22:11.630Z

Thanks! I ended up changing everything in the swift-project/swift directory to use python3, as well as the two files you mentioned.

Now I get past that error and about 20 minutes in it fails with:

clang: error: no such file or directory: '/Users/jason/Documents/Swift/swift-project/build/Xcode-RelWithDebInfoAssert/swift-macosx-arm64/lib/RelWithDebInfo/libswiftCompilerModules-bootstrapping1.a'

I am using the following build command:

utils/build-script --skip-build-benchmarks   --skip-ios --skip-watchos --skip-tvos --swift-darwin-supported-archs "$(uname -m)"   --sccache --release-debuginfo --swift-disable-dead-stripping --Xcode

On macOS 12.3 M1, Xcode 13.3. I do see in the forums here others having problems doing Xcode builds. Fairly sure at this point it is no longer a python version issue.

Any thoughts? Thanks!

LucianoPAlmeida · 2022-03-31T15:29:47.481Z

I would suggest you to try --bootstrap=off flag. Make sure to use --reconfigure the first time you use that bootstrap flag :)

jhowlin · 2022-03-31T15:40:17.795Z

** BUILD SUCCEEDED **

That did the trick, thank you.

mikepinkerton · 2022-04-14T18:04:13.367Z

It looks like everything got fixed up except the change to benchmark/scripts/build_script_helper.py.

Is there a reason why this part didn't land?

Overcot · 2022-04-18T22:20:33.415Z

Also,

/swift-driver/Utilities/build-script-helper.py

It crashes when building on m1, mac os 12.3 with this command:

utils/build-script --skip-build-benchmarks \
  --skip-ios --skip-watchos --skip-tvos --swift-darwin-supported-archs "$(uname -m)" \
  --sccache --release-debuginfo --swift-disable-dead-stripping --test \
  --xcode

And the output is:

+ /opt/homebrew/bin/sccache --show-stats
+ /usr/libexec/PlistBuddy -c 'Print :SupportedTargets:macosx:Archs' /Applications/Xcode.app/Contents/Developer/Platforms/MacOSX.platform/Developer/SDKs/MacOSX12.3.sdk/SDKSettings.plist
+ mkdir -p /Users/overcot/Work/swift-project/build/Xcode-RelWithDebInfoAssert
--- Building earlyswiftdriver ---
+ /Users/overcot/Work/swift-project/swift-driver/Utilities/build-script-helper.py build --package-path /Users/overcot/Work/swift-project/swift-driver --build-path /Users/overcot/Work/swift-project/build/Xcode-RelWithDebInfoAssert/earlyswiftdriver-macosx-arm64 --configuration release --toolchain /Applications/Xcode.app/Contents/Developer/Toolchains/XcodeDefault.xctoolchain/usr --ninja-bin /opt/homebrew/bin/ninja --cmake-bin /opt/homebrew/bin/cmake --local_compiler_build
env: python: No such file or directory
ERROR: command terminated with a non-zero exit status 127, aborting

Keith · 2022-04-19T18:04:37.770Z

Can you update your checkout and see if [cmake] Remove Python 2 from build requirement (#42434) · apple/swift@1b85082 · GitHub landing yesterday fixed it?