Appreciate your efforts to help Phil but in this case, I can tell you I built this workstation with a 2080 ti RTX and 64 gigs of ram to be able to handle scenes like I have been building. I also use it with Unity and Unreal in larger landcapes without issue. Things worked fine in 3.4 Enscape but you do bring up a valid point. I have some meters that run in the background to let me know various readings on the computer such a vram used, ram used, heat, processor use, etc and none of these have been impact that much. I will get some serious spikes when using Unreal and Unity though.
I should try this on another scene to see if there is something occurring here that could be somehow related to some cache type thing being full or whatever.