Do you mean something like pthread mutex with ROBUST? (I don't know any other examples). I guess I implicitly assumed that our signal handler will be notified before any such things. But if that's not the case than it's a valid point.
I asked but they didn't reply yet.