While installing the kubuntu-restricted-extras package, I accidentally allowed the installation of ttf-mscorefonts-installer. This kind of uglified up all my browser fonts, so to remove them I ran:
sudo apt-get purge ttf-mscorefonts-installer
Solution was based on this answer at askubuntu.