invalidManifestFormat, PCH was compiled with module cache path…

I renamed my Linux username, and now I get this error when I try to build my code:

 $ swift build
'furnace-controller': error: invalidManifestFormat("<unknown>:0: error: PCH was compiled with module cache path \'/home/pi/.cache/clang/ModuleCache/1Y8E05I9T37AM\', but the path is currently \'/home/furnace/.cache/clang/ModuleCache/1Y8E05I9T37AM\'\n<unknown>:0: error: missing required module \'SwiftShims\'", diagnosticFile: nil)

I've tried swift package clean, swift package reset, and swift package purge-cache, but it doesn't fix it.

Deleting ~/.cache fixes it, but this still feels buggy, at best.