The scary part is that blowing away the OS install won't save you completely. There are BIOS, firmware attacks, to name a couple. Take a look at the following link with information about persistent root access via hard drive firmware hacking. Even if you reinstall the OS, your box will continue to be owned:
http://spritesmods.com/?art=hddhack&page=1