Fix potential write past end of buffer.

We wanted to read one byte into the second byte of "byte", but didn't
cast everything correctly, so we ended up reading the byte past the
end of "byte".