I would recommend trying with a clean vanilla Raspbian first - just to rule out a hardware fault on the Pi front, which seems a plausible option by your account.
That said do note that speaker-test DOES output white noise by default, unless you use flags to overrule the source, like so: