I don't have relief either with my displacement map (for very rough concrete). It's a PBR texture from ShareTextures. Just the shadow, but flat, with no relief.
Here is a quick guide as to how to get it to work - I'll use a sharetextures example : Brick Wall 5 in 1K (a sensible choice for real time)
Also worth noting that Sharetextures seem to use 8bit Jpeg files - ideally we would like 16bit PNG files for this.

I'm going to extract these into a folder and open the Normal Map and the displacement map in Photoshop

When the normal map is open I'm going to open the channels and press the plus button

This will create an alpha channel

now go to the tab with the displacement map in and press ctrl-a (select all) and ctrl-c (copy) to copy this displacement map

Go back to the normal map tab and paste the displacement map into the black alpha channel

If you click the eyeball next to RGB in the bottom right , it will show all channels combined - in this example it looks a little more red than it did.

Save the file as a tiff.
Load this into Enscape's height slot and choose "displacement"
This will load both the displacement AND the normal information in
Notice that Enscape shows the alpha map we loaded in as the black details

This will give you a nice result than using just normal/displacement, but as is always the case with Parralax occlusion maps (which is what the displaceme is) this does not change the silhouette of the object
