According to a report by the IRS, 312,000 federal workers and retirees missed paying their taxes on time in 2011.
The IRS says that's an uptick of about 12% compared to 2010.
Tim Kovacs, a taxpayer thinks they should be fired. "They should be fired immediately. I have to pay my taxes and work for the money."
He's not alone in his thoughts. Phyllis Mason, agrees. "They should have to pay their taxes to, it's not right."
Among Executive Department's, workers at housing and urban development have the highest delinquency rate at 4.42%. Delinquincy at the Government printing office tops at 7.6%, the most of any large independent agency.
Congress and the White House aren't immune. The Senate percentage is 3.3% and the House tops 3.7%. Even employees at the White House haven't paid their taxes, that percentage is just over 2%, which is down from previous years.
Federal workers are not alone, more than 8% of the general population doesn't pay its taxes on time. But federal taxpayers that don't pay and get away with it, leaves many people angry.
Certified Public Accountant Max Highstein, says non-compliant federal employees should face the same penalties the public often confronts for failing to pay state taxes. "If your an accountant, if your a nurse, if you are a doctor, they will lift your license if you are not compliant or don't have an agreement with them. The federal government doesn't do that."
Under a proposed house bill, workers deemed 'seriously delinquent' would be ineligible for federal jobs. Right now that bill is stuck in a committee.