Remove last unsafe block

With rust 1.53 came Vec::extend_from_within which allows to replace the last unsafe block in this codebase. It requires breaking compatibility with older rust verions though.

If you require an older rustc version you can still use v0.2.2. It is functionally equivalent but contains that last unsafe block.