https://askubuntu.com/questions/71863/how-to-change-pulseaudio-sink-with-pacmd-set-default-sink-during-playback
You also need to set load-module module-stream-restore restore_device=false in /etc/pulse/default.pa
load-module module-stream-restore restore_device=false