Oh thank goodness, I'm not the only one who has this problem.
Short video paths are almost impossible. Most of my video paths are between 2-8 keyframes. You have to have at least 5 keyframes with all of them timestamped to be able to change even the second keyframe without changing the duration of the clip. In some cases,
Right now my workaround is if I want a desired length of time between a certain set of keyframes I have to make the clip way longer in duration than it has to be and then speed ramp the rest of the clip in Premiere.
Timestamps are very broken for me.