Mini map view is not aligned correctly with map

I have a mini-map view displayed and the higher I go, the more “off” the view rectangle is. My map is very tall and thin, so the mini-map is as well.

You can see from the mini-map that the view area is scrolled up high, but the actual view is much lower. It seems to get more off the higher I go.