Speakerphat external speaker support

I’ve recently built a raspberry pi Zero w powered Amazon echo, using the alexa avs voice service sample and the pimoroni speaker phat. Although successful, sound quality is a bit low, and I was wondering if it possible to solder other speakers to the speakerphat for better audio. Specifically, an adafruit 3w 4ohms speaker. Is this fine?

Also, as one of the steps, after installing speakerphat firmware I was instructed to disable asound.conf and instead modify and use “.asoundrc”. Both had sound, although the vumeter has been disabled in the “.asoundrc” file and i dont know if it affects sound output.