Wow, setting the compressor-makeup-gain to zero, really improves the sound quality. This is a step improvement vs. just stopping pulseaudio. Thanks for this.
It could also explain why this post found better sound quality when not using VLC with the phat beat