I used one of those cheap USB sound dongles too. I found it much better than the raw audio output on the PI.
Not super but good enough for my purposes so far. I have zero experience with the hifiberry or wolfson cards.
I have also been using KODI and playing music through the HDMI to my amplifier, the sound is great.