TV supports PC resolutions that do upscaling (eg NVidia control panel calls 1080p upscaled to 4k as "4k x 2k, 1920 x 1080p)

If I tell NVidia control panel to change my resolution from 4k (2160p) down to 1080p, my TV's Info button correctly says 1080p. (This is correct, and expected)
if I tell DF to change my resolution from any other resolution to 1080p, it upscales it instead, causing the info button to show 2160p (Display's native)

This is causing issues elsewhere, with my setup.

Edit: Windows 10 seems to do this in it's settings as well. Looks like NVidia does some direct changing.
Edit 2: This was a problem with nvidia settings for scaling modes. Driver should be set to override modes set by games and applications in nvidia control panel, when specifying scaling in the same place.

Always prefer to give the solutions, in case others are searching for the same problems.

Looks like there's a bug in the current nvidia drivers that prevents that override from working correctly too.