What did you do? My Windows 8.1 is not broken. Seems like a case of PEBKAC.
Newegg has filters (Price, USB, brand, style) then sort by rating for a start - or click here.
I don't own a USB headset, as it would defeat the purpose of a decent sound card / on-board sound.