ChatGPT vs Claude vs Gemini vs Grok for Tax Questions
Independent testing found general chatbots unreliable for preparing a full return. All four are useful explainers. Choose based on privacy controls, and verify answers.
What independent testing found
The New York Times tested Gemini, ChatGPT, Claude and Grok on eight fictional situations from TaxSlayer training materials and concluded you should not trust A.I. to file your taxes. It noted that tax returns involve many interdependent forms that must be updated in sequence, which language models struggle to do perfectly. [1]
The Taxpayer Advocate Service similarly warns that AI may struggle with complex laws and unique circumstances. [2]
How to choose
- Privacy controls: check whether you can opt out of training. ChatGPT offers a training opt-out and Temporary chats. [3] Check the equivalent settings in Claude, Gemini and Grok before use.
- Use the same verification habit with any of them: ask for the IRS form or publication, then check it.
Our plan
We are building a public test set of common situations (W-2 only, side gig, student loans, HSA) to score each chatbot. Results will be published with prompts and dates. Until then, we do not rank them.
Sources
- New York Times: Don't trust A.I. to file your taxes (Mar 5, 2026) Verified Oct 16, 2026
- Taxpayer Advocate Service: Is AI-generated tax advice making the grade? Verified Oct 16, 2026
- OpenAI Help Center: Data controls in ChatGPT Verified Oct 16, 2026
FAQ
Have you tested them yourselves?
Not yet. We plan a published, repeatable test set before the 2027 filing season and will not rank them until then.