Using map jumps to wrong floor

A lot of times when I use the map to jump to an other location (in VR) I jump to the wrong floor or to the roof. This happen when the room is less high than standard. This is very irritating.