Probably to do with the way the assets are stored, and have to be loaded.
Each map point moght have to refer to a map zone, in order to load some name/detail elements.
If so, suggests some sort of abbreviated lookup table (with just key info required for map screen) would alleviate this issue somewhat. (Might not require moving the drive heads so much to get ALL the details- an SSD installed version of game (yes, on PS4), would reveal aspects to what is causing that problem)
True; I know near nothing about the way this title functions.
What I see regularly is major lack of forethought as to how it all comes together.
Not an issue on a PC with ‘sky is the limit’ specs; major issue on console with very limited grunt.
If we go back in time to when Skyrims (official) mods came out for last gen systems…
The xbox with 512mb of RAM laughed them in, the PS3 with 256Mb of RAM had a real issue.
Kinda like the launch of this games first paid for expansion - where developers chose to dump some aspects (texture pool size) to free up the RAM/resources (somewhat suggestive) to allow the consoles to ‘buy into’ the DLC.
Might be a temporary bugbear (extension of recent compromises made).
This is one that could be worked around, but might not be at the top of their (Warhorse) todo list- as it doesnt affect everyone.
Unlike the dodgy building model that does affect everyone- although I didnt test if that ‘shop’ model lowers its poly count/resourse hit if I were to run with High or the consoles’ Medium settings.
My guess is it must just be in the Ultra settings that the shop model goes bonkers as so few seem to complain about it/raise awareness to it.
The silly thing is that dodgy building is reused all over the map, and everywhere it pops up seems to coincide with a 20% (minimum) framerate drop.
That building has been broken since the game came out.
Hope that isnt suggestive of turnaround time for typical problems with this title.

Ive never used the fast travel with the exception of when game forces it (hunting with Hans), or once when I wanted to film a horse run through Rattay…