Depends on the kind of taxes you pay. They can put a lien on your house, garnish your wages, etc. Eventually, sure they may put you in prison, but generally they aren't going to hurt you doing it unless you try to hurt them. You're just renaming coercive measures violence.