Hacker News new | past | comments | ask | show | jobs | submit login
The IRS Is Buying an AI Supercomputer from Nvidia (theintercept.com)
48 points by jbegley 85 days ago | hide | past | favorite | 68 comments



Isn't the IRS on the chopping block? I know they killed the free tax filing feature for citizen. I cannot keep track anymore.

Reading through the article, it's not one or two machines but 8 Blackwell nodes, so quite some firepower for compute. Wonder what part of the audit or tax prep requires a GPU farm.


If you're wondering if the "Efficiency Department" is actually about efficiency, or if they're just cosplaying political Santa Claus, look for cuts to the IRS.

The IRS is the most bang for the buck government department. Every dollar spent there nets out many more, because they're chronically under-resourced to audit the whales who can trivially hide their tax obligations.

Naturally whenever there's a hint that the department could be even close to properly funded, the media, overwhelmingly owned by the class of people who evade taxes as a sport, gin up controversy. It's no wonder that the richest man in the history of the world has bought his way into the building and been provided with gasoline and matches.


> The IRS is the most bang for the buck government department. Every dollar spent there nets out many more, because they're chronically under-resourced to audit the whales who can trivially hide their tax obligations.

This is just a trope.

Auditing big whales is often not the most efficient use of resources because their taxes are a) much more complicated, and so more expensive to audit and b) more likely to have been done by a team of competent lawyers, so even though they're engaged in all kinds of shenanigans, the shenanigans are legal and there is no money to be had by auditing them.

Where the IRS can "turn a profit" is by auditing small and medium businesses, because they're more likely to have screwed up, and auditing them is cheap to the IRS. But this has a different problem. It isn't cheap to the taxpayer being audited; they pay an order of magnitude more to go through the audit than the IRS does. And then most of them are innocent, even though the IRS makes it back from the few that aren't. For obvious reasons the innocent ones hate this with the fire of a thousand suns, because nobody compensates them for their costs even though they did nothing wrong. But if you actually did compensate them for their costs then it wouldn't be net-positive for the IRS to do all those audits.


> This is just a trope.

Do you have citations to back up this assertion? The GAO seems to say otherwise[1].

[1] https://www.gao.gov/products/gao-24-106112


It's saying the same thing:

> GAO found that, as income increased, IRS recommended more taxes per audit, on average, but generally closed fewer audits.

They close fewer audits because the audits require more resources (and partially because there are fewer of those taxpayers). Meanwhile the other effect also shows up clearly in their numbers: Average additional tax for the $500k-1M group (midpoint $750k) was ~$20k or 2.67%, for $1M-5M (midpoint 3M) was ~$40k or 1.33%, for $5M-10M (midpoint 7.5M) was ~$86k or 1.15%. Percentage for the top group is unknown because that bracket is open-ended, but $360k for the group that contains billionaires is likely to continue the trend.

They get less as a percentage from the people with better tax lawyers. It's more in absolute dollars because by definition they have more money, but since it also costs more to audit them it's not necessarily worth it.

Notice also that these are heuristics and the actual numbers change with the number of audits. There are going to be some people who are obviously cheating on their taxes, e.g. someone else filed a 1099 or W-2 for paying them and then they filed a return that didn't include the income. The IRS is going to put them at the front of the list to be audited and then that audit is going to show a positive recovery for the IRS.

The more audits you do, the lower the recovery rate gets, because you started with the ones with huge obvious problems and doing more audits means auditing people who are more likely to be innocent.

This is also why the "bang for the buck" calculation is pretty meaningless. Suppose there is one person you can audit for $2000 and then recover a million dollars (+$998,000), and then an unlimited number of people you could audit for $1000 and recover an average of $800 (-$200). If you do one audit of the one who is obviously cheating, you've recovered 500 times more than you put in! Clearly you should keep going. If you audit 100 people, you've spent $101,000 and recovered $1.08M, that's still almost ten times more than you spent! Clearly you should keep going? Except that only one of them was net positive and the additional audits have actually reduced your net gain from $998k to $978k while auditing a significant number of innocent people.

What matters is the incremental returns from additional audits, not the average returns from existing audits. And taking into account as a cost the burden of auditing innocent people.


> Auditing big whales is often not the most efficient use of resources because their taxes are a) much more complicated, and so more expensive to audit and b) more likely to have been done by a team of competent lawyers, so even though they're engaged in all kinds of shenanigans, the shenanigans are legal and there is no money to be had by auditing them.

For "x" hours of work, the big whales can also potentially bring in a lot more money than a bunch of small minnows.

Before it got a funding bump, the IRS went after minnows because of resource constraints:

> Congress asked the IRS to report on why it audits the poor more than the affluent. Its response is that it doesn’t have enough money and people to audit the wealthy properly. So it’s not going to.

* https://www.propublica.org/article/irs-sorry-but-its-just-ea...


> For "x" hours of work, the big whales can also potentially bring in a lot more money than a bunch of small minnows.

Your article says the opposite:

> They [audits of low income people taking the EITC] are “the most efficient use of available IRS examination resources,” Rettig’s report says.

They can either hire a lot of cheap low-level examiners to quickly audit a lot of low-income people or a smaller number of expensive examiners to slowly audit big complex returns that are more likely to be correct but have more at stake. They were doing the first one because it recovers more money per enforcement dollar.

You can decide that your priority is "audit more rich people" rather than "recover the most money" but that doesn't make them the same thing, or make the first one the only or even default thing they'll do if you give them more enforcement resources.


The IRS Individual Master File, running on IBM mainframes, may be the oldest software alive. Perhaps there's a need for an update. https://www.guinnessworldrecords.com/world-records/636196-ol...


I agree! However, the brain trust Musk is running is absolutely not qualified to do it. They're getting tripped up on basic COBOL trivia[1].

[1] https://www.fastcompany.com/91278597/elon-musk-doge-cobol-la...


The IRS hired a guy to rewrite the Master File in Java a few years back and they ran out of money when he was almost finished.


Why update what isn’t broken?


US tax filing is broken compared to many European countries that automatically prepare the tax return.


That’s by congressional design. Don’t blame the mainframe.

DOGE just shut down the auto prepare because gov’t is bad and wasteful.


Yeah, I'm sure there are no weird edge cases in America's byzantine tax laws that have been spotted and squashed in the software

Sounds like fun to find and fix them all again though!


The Tech Right ascendant (in this admin) claims AI is going to magically fix & improve systems, will let us fire thousands, tens or hundreds of thousands of people

Some of this is just a war against the middle class.

But more seriously this is a desire to let unregulated unchecked systems draw judgement upon people. This is like the UK postal crisis, where the UK has long held a legal system that assumed computerized systems are correct and not questionable.

Once the AI is in power, it can be tuned to the biases of the ultra-wealthy tech-right. Technocratic dominion.


maybe they'll just do all our taxes for us?


A lot of developed countries do this.

They just sent you your assessment automatically with they you think you/they owe if anything, you need to file anything only there if you believe there is difference .

The US system is pretty backwards really, most of the taxes are deducted at source anyway the system already has a good idea of your income/taxes owed.

If IRS calculate returns at scale using tax deducted at source and employer info(W-2 etc) , unless you dispute their calculations there is no need for audit or paperwork at all reducing the cost of running IRS too.

This kills intuit so will never happen, but if it does it would be the single biggest revenue boost to the Government easily in tens if not 100's of billions of dollars.


Yes, every few years I press ok. They want me to do it every year but that just seems like a lot of work. So far they got everything right. I really want this for small businesses in real time. The payment processor already deals with most refunds. It would be nice to fill taxes with each purchase, payment or invoice automatically. Should automate the payments too! Give them the (approved) work schedule, let them provide a clock card machine. Pay the salary end of the shift.

Why should we have a party dragging out a transaction? Just complete it immediately and ideally in isolation.

Then they might as well also run the bank, the payment processor and the recruitment agency.

People here in NL are afraid to start a business not because they can't deliver the product or service or that they can't find customers, they are afraid of the tax office.


Direct File I think helped some. Deleted by Musk.


you owe elon musk 80 years of your life - x.gov


> Isn't the IRS on the chopping block? I know they killed the free tax filing feature for citizen. I cannot keep track anymore.

The IRS is mentioned in Project 2025's chapter on Treasury:

* https://static.project2025.org/2025_MandateForLeadership_CHA...

See "TAX ADMINISTRATION" section. Some points with-in that:

> Doubling the IRS? The Inflation Reduction Act contains a radical $80 billion expansion of the IRS—enough to double the size of its workforce.34 Unless Congress reverses this policy, the IRS will become much more intrusive and impose still greater costs on the American people.

[…]

> Management. The IRS has approximately 81,000 employees.36 Of those, only two are presidential appointments—the Commissioner and the Chief Counsel.37 As a practical matter, it is impossible for these two officials to overcome bureau- cratic inertia and to implement policy changes that the IRS bureaucracy wants to impede. That is why, notwithstanding decades of sound and fury, almost nothing has changed at the IRS.

On the second point, "Management": who doesn't / wouldn't want more political apparatchiks with-in the tax system?

As for the second point: the IRS has a resource problem (partly due to retirements), and needs to hire a bunch of folks now to be able to train them and pass on institutional knowledge:

> “When we hear 87,000 agents, it sounds like a horrifying army of people. But it’s what they need to maintain, because people are exiting in volumes,” says Robert Cordasco, a certified public accountant and founder of Cordasco & Co. in Savannah, Georgia. “I don’t know how much it adds as much as it gets us to the status quo.”

* https://www.cnbc.com/2022/08/31/irs-is-not-hiring-an-army-of...

* https://www.journalofaccountancy.com/news/2024/jun/expert-wa...

A story from before the funding bump:

> Congress asked the IRS to report on why it audits the poor more than the affluent. Its response is that it doesn’t have enough money and people to audit the wealthy properly. So it’s not going to.

* https://www.propublica.org/article/irs-sorry-but-its-just-ea...


If they have this kind of cash why not just fix the system they already have and improve IRS Free File and make it available to everyone?


How would ensuring the IRS is able to correctly do its job make more money for the ultra wealthy?


Their system is a hodge podge of bailing wire and duct tape strapped cobal. I don't think there's a way to "fix" it other than redoing it in pieces.


Because Elon giving the finger to the public is more important

He literally gloated on his website about closing it


that would benefit the people and not a large US company.


Audits for everyone


correct - as long as they don’t make 7-figures. anyone over 7-figures is auto-exempt


"Last September the IRS announced it would hire 3,700 new agents to help increase scrutiny of taxes paid by corporations, wealthy people and the private investment funds they increasingly favor. " [https://www.icij.org/inside-icij/2024/02/inside-the-irs-unit...]

"IRS launches new effort aimed at high-income non-filers; 125,000 cases focused on high earners, including millionaires" [https://www.irs.gov/newsroom/irs-launches-new-effort-aimed-a...]

"The Internal Revenue Service today announced the agency has surpassed the $1 billion mark in collections from high-wealth taxpayers with past-due taxes. " [https://www.irs.gov/newsroom/irs-tops-1-billion-in-past-due-...]

--

Your ideological view of reality and what the IRS are objectively doing do not seem to remotely line up.


> Your ideological view of reality and what the IRS are objectively doing do not seem to remotely line up.

Except that Project 2025 wants to freeze the IRS budget and hiring:

> Doubling the IRS? The Inflation Reduction Act contains a radical $80 billion expansion of the IRS—enough to double the size of its workforce.34 Unless Congress reverses this policy, the IRS will become much more intrusive and impose still greater costs on the American people.

* https://static.project2025.org/2025_MandateForLeadership_CHA...


You know they are about to fire thousands of them right?

https://www.reuters.com/world/us/us-irs-prepares-lay-off-tho...


did you just provide links from Biden administration and have missed we have a new President? :)


It will definitely be trained to not audit billionaires.


To hunt down people who talk unfavorably about the great leader.


As a US citizen, if the government isn't using appropriated funds legally, whats the point in paying taxes? Maybe they see this coming.


This will not end well. The IRS has tried many times to replace their mainframe systems and failed. So they are upgrading to AI ? I thought Trump was the "save waste" guy.

These are finanical systems, they need to add/subtract and multiply/divide lots of transactional data. AI not needed.


> These are finanical systems, they need to add/subtract and multiply/divide lots of transactional data. AI not needed.

The IRS gets 125 million paper forms every year:

https://www.cnn.com/2024/01/29/politics/tax-season-irs-digit...

They tried and failed to scan some of them with OCR:

"OCR – This project involved extracting machine-readable data from low-resolution and poor-quality images (both digital and paper) with the capability to integrate them with the IRS’s information technology systems and intake different types of forms and data. The pilot project was discontinued in October 2022 after failing to identify acceptable solutions using the vendor and resources provided. The ED&CMO has no plans to resume this effort at this time."

https://www.tigta.gov/sites/default/files/reports/2023-09/20...

I imagine that a few GB200s would actually help with that effort


The 1040EZ was being OCR’d forty years ago.

It doesn’t scale to 1040s and schedules because today’s biologics don’t know how to write anymore.


The people maintaining the systems could use AI to grapple with transforming it faster, no? I mean, if you have to rewrite existing programs from 1995 all the time you might as well feed an AI the context and get some suggestions and just verify and test the changes instead of manually with pen and paper jotting out the tree of the sections and the database relations and how the architecture requires it to be and what new legislations need to be accounted for in what way etc etc..

So AI can be used to speed up transforming the existing infrastructure instead of AI doing the actual processing which would obviously be not the direct use case in anyones mind

It could also be implemented in less volumous tasks, like specialised scenarios like complex cases of fraud detection idk


Why do they keep failing? Don't tell me it's also COBOL that no one knows (or rather, isn'tpayong enough to remaining experts to know).

I (really) don't think AI is the solution in its current iteration, but it's unfortunate that it seems like they keep failing.


A big part of the failure is that the system is not entirely digital, and not entirely automated.

People can still submit paper returns (and this is common for any businesses beyond a certain size- I've seen 200+ pages for a small-ish company's return). Supporting documentation and schedules can be non-standard (like receipts, letters, exhibits, spreadsheets, contracts, etc.), and the forms themselves can be hand-written and the other docs can be on inconsistent paper sizes so bulk ocr of any kind is rough.

Really, you have several challenging problems- maybe 200M individual returns filed every year, who knows how many corporate returns, all of the daily/monthly/quarterly filings for payroll, then for tax season you have an army of temp workers who are responsible for doing manual data entry which is cumbersome.

Then you have the financial management/reporting/reconciliation side of it. The volume is staggering. Electronic transfers in both directions, handling paper checks both to and from taxpayers. More manual data entry for manual payments.

And the kicker of all this is that it actually works for some pretty reasonable value of that term. And everyone here knows what the code probably looks like and we definitely know what the code's documentation looks like.

How would you like to sit down with the nearly 7,000 pages of the US Tax Code and start taking a bite of that monster? It's not a reference manual- the amount of cross referencing with other laws and regulations required would be monumental.

So, you are correct, AI is definitely not the answer; But I suspect the AI is for rooting out tax cheats (or maybe certain tax cheats), not running the system itself.


The increase in complexity of tax law coincided with the era of COBOL mainframes and those changes were a lot easier to implement incrementally, but to build it from scratch now is a herculean task regardless of the language.

AI definitely won’t help with that.


AI is GREAT at porting software to new languages. That's like one of the things it is best at.


AI is okay at it.

It is one of the things they are best at.

Tho it works best with small chunks of well isolated code… I doubt it’d be very successful with the IRS’s ball of COBOL, especially considering how little cobol code is available for training sets.

It’d still require a ton of hairy manual work.


> IBM says GenAI can convert that old COBOL code to Java for you

https://www.theregister.com/2023/08/22/ibm_says_genai_can_co...


Also from that article

> IBM is giving its mainframe customers a tool infused with generative AI to translate COBOL code to Java

Hard to wholesale believe claims when they are literally the ones selling that capability.

It probably works well for already clear and well structured cobol.



> It probably works well for already clear and well structured cobol.


All well and good, but the system deals with money. You cannot have rounding issues. For non COBOL systems, rounding issues are a big issue.


Not that Java is dead but that is reminiscent of the futurama professor invention of translating one dead language into another.


The software is was written in the 60s and patched, patched, patched... I knew someone who worked on it, he passed away in the late 90s.

Plus tax laws change every year, in many cases causing massive changes. Every conversion failed because no one is left fully understands the whole system.

Plus for a conversion, you need a long quiet time, with the tax laws you never get that.

Not to mention, even with Biden's additional funding, which I am sure it will be cut, it is far from the amount needed for a successful project.

So here we are. I think some "modernization" has occurred, but the core system is still running some 60 year old software.

Note, I knew a lot of people who worked there prior to 2000, so maybe what I know is a bit out of date. But I doubt it since the attempts I have read about over the past 20 years did not succeed.


The IMF and BMF aren’t just software. They’re the code in tax code. It’s the law, not the printed thing in a binder.

If you have the gall to question IMF behavior vs printed tax code and write it up internally, you will get a reply from an tax code analyst in a couple of months from WV explaining why you’re wrong, selections from code, selections from IRS legal interpretations, applicable court cases past, present and pending.

It’s all very polite, but you quickly realize they’re lawyers and you aren’t.


The tax code is legislation and they're the government. Instead of trying to translate it from old COBOL spaghetti code, discard the existing code and implement a new system from the tax code.

And while you're having a bunch of lawyers go through the tax code in order to do this, have them recommend simplifications to make it easier, so that instead writing new complicated software, you write new simpler tax laws.


Estonia


They never actually define what “efficiency” means, so it can be anything they want, and then they can claim any victory they would like by playing with numbers and definitions.


> I thought Trump was the "save waste" guy.

What made you think that?


Everything his boss Musk says :)


Imagine a world in which they use this computer to model ways to simplify the tax code.


The tax code is complex by design though. They only want those who pay full time financial advisors to find loopholes to find loopholes.


The rich would also be happy with a 30 percent national sales tax.


Voters are dumb but not that dumb.


How would a simple tax code help the ultra wealthy?


Don't need a super computer to do that hah


This does not seem like it is going to help the IRS do a better job with tax arithmetic.


Remember the movie Brazil (1985) when someone got swatted, inprisoned and executed because of a typo caused by a fly?

Imagine how the appeal process will "work" once the IRS introduces LLMs for this...


Ahhh hallucinations in my taxes. Good. Good.


Monopoly action card: the IRS has hallucinated in your favor. Collect paid federal income tax for last year.


My first thought is "we're gonna have to train it up on COBOL."




Consider applying for YC's Summer 2025 batch! Applications are open till May 13

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: