That used to be kind of true, except ongoing proposals are aiming to enable "everything in this module is on the main actor" by default (on a module by module basis) ([Pitch] Control default actor isolation inference) which does make code implicitly on the main actor be pretty ubiquitous. So it seems to be that more than not-special, it is going to become more special than currently.
That's true that one person gets to set it, but also it's "wherever the app/system" runs -- and that's going to be one of those platforms / runtimes, and very rarely there's multiple "assumption of main thread" that are conflicting but active at the same time...? Usually those frameworks take full ownership of the programming model, don't they?