Ah, thank you for the clarification! Approaching it that way would definitely be much nicer IMO.
FYI Pitch: Support LTO for Swift