That works great with a 16 bit stereo impulse response and lsp-plugins-impulse-responses-stereo.
With an audio interface that has 4 output channels like Scarlett 2i4 I can feed an unequalized signal to the speakers (channel 1 + 2) and a signal for the headphones (channel 3 +4).