Getting around unsafe pointer mutability requirements

[Jens]

Related thread: Fixed size array hacks