Hi,

is there a function to use different audio devices for each monitor/application/window?
If not, do u got any solution ideas besides DisplayFusion?

Hope u can help me!

That's not entirely accurate. DisplayFusion allows you to setup monitor profiles, which enables combining specific monitors with specific audio devices. You cannot use DF to change devices with apps or windows, that is true.