MainActor isolated property can not be mutated from deinit

I think I asked pretty much the same thing, but there wasn't much answer except it should be better in Swift 6/the future. But it doesn't seem to have.

Removing an observer in deinit is pretty standard practice and I think recommended in some docs.