Unplugging speakers/heaphones causes permanent sound loss

[Lord Taron]

If I unplug my speakers mid-game and plug in my headsets (or anything else, even the speakers again) the sound no longer plays in Skyrim at all. It works fine if I start the game back up again.

Not a big deal, really, but anyone else see this? Suggestions?

AMD Athlon 64 X2 (dual core), ~3.1ghz
Win 7 64 bit
On-board Sound card for an XFX Motherboard. Forgot what it was, but don't think it's anything special.

More specs avail on request.