
I realize that this is already a recognized symptom of the current UDL, but figured more info couldn't be bad info.
I logged in to try different configurations in order to find a sweet spot that would allow me to use UDL as a DM without a screeching halt performance hit and still looked good to my players. I'm using the Forge of Fury module, specifically on the Glitterhame map. At first, after activating UDL, the hit was awful. Even just clicking a token on my end took 1-2 seconds to pop up the token's stats and radial menu. Moving the token on my end was worse as it would stutter horribly and take a moment after releasing the mouse button for the token to finally drop. My player, on the other hand, was impressed by how smooth and how great looking it was.
So I dove a little deeper and discovered that if I zoomed in to 100% or more, at least for a while, things went back to buttery smooth. I could move around and click without any lag, I could hit Ctrl-L to see through the token's eyes, whether it was darkvision or emit light, and had no issue. Over time though, it eventually started to go downhill again.
What really confused me, and I'm guessing the devs too, was that the GPU/CPU usage and memory footprint was virtually the same whether or not I was using UDL.
You can see that there's a difference, but it doesn't deviate all that wildly.
The only other thing I wanted to add was that when I changed to a different map in the module, it was like night and day. When I setup UDL on The Foundry, it went from hair pulling lag to formula one speed with all the awesome effects intact. The difference being (of course) the size of the maps (which, again, people have already noted).
Glitterhame - 74x67 @ 5180x4690 resolution
The Foundry - 76x43 @ 5320x3010 resolution
That's only about a 30% increase from the smaller to larger, but it speaks volumes for some reason to the performance.
Anyway, maybe someone will find that all helpful.