Just for posterity's sake, ManagedBufferPointer still has a use case. It's exactly the scenario I described here:
My family of managed buffers needs a common base class so I can implement type-erased operations. Thus, I can't use ManagedBuffer itself.