The tax deadline is approaching and some filers are turning to chatbots powered by artificial intelligence for help with returns.

But taxpayers should be wary of generative AI — which uses artificial intelligence to create content — for tax advice, experts say.

Nearly 1 in 5 Americans would trust ChatGPT, a popular AI chatbot from OpenAI, to review their income taxes, and 14% have used it, according to a February survey of roughly 1,000 U.S. adults from CardRates.com.

Another recent survey had similar findings, with 17% saying they have used AI for tax filing and 45% open to it for future use, a Harris Poll found.

While many experts are optimistic about the future of generative AI and taxes, filers should “proceed with caution” when using the software to file returns, said April Walker, lead manager for tax practice and ethics at the American Institute of CPAs.

More from Personal Finance:
There’s still time to reduce your tax bill or boost your refund before the deadline
An ‘often overlooked’ retirement savings option can lower your tax bill
Some retirement savers can still get a ‘special tax credit,’ IRS says

“We caution users against using ChatGPT for financial advice, as they should seek a professional instead. This activity actually goes against our usage policies,” a spokesperson from OpenAI told CNBC.

In 2022, the IRS rolled out voice and chatbots to help answer basic payment and collection notice questions. The agency has since expanded its use of AI-driven technology.

Since the January 2022 rollout, the IRS used chatbots to help more than 13 million taxpayers and helped set up about $151 million in payment agreements, the agency announced in September.

Meanwhile, TurboTax has unveiled the generative AI-powered “Intuit Assist” chatbot. The was chatbot was designed to help with software already using AI for “simplified filing” and more accurate returns, according to Karen Nolan, senior communications manager at Intuit TurboTax.

However, “AI is not completing or filing a tax return in TurboTax,” she said. “If a TurboTax filer ever has a question about their tax return, they are only a click away from a live tax expert at all times.”

H&R Block, which has used AI for years, also introduced a generative chatbot with “AI Tax Assist” this season. The tool assists the process for DIY filers and the company has instructions on the best way to use it.

“We also have a team of human testers reviewing questions and feedback daily to identify what to add and improve,” a company spokesperson said.  

Still, AI chatbots “aren’t ready for prime time,” when filing tax returns, according to Subodha Kumar, professor of statistics, operations and data science at the Fox School of Business at Temple University.

Kumar has tested AI chatbots with his students and found the software works for general tax questions, but often provides wrong answers for more specific prompts.

For example, filers may not get accurate answers to tax questions from ChatGPT because its training is “general purpose” rather than tax-specific, he said.

Plus, the data isn’t fully updated, with different knowledge cutoff dates, depending on which version of ChatGPT you’re using. The latest AI model is GPT-4 Turbo, and provides answers with context up to April 2023. That could be an issue with yearly inflation adjustments, tax changes from Congress and the IRS.

However, with models specifically trained for tax, Kumar expects a “big leap” from tax-specific AI chatbots by next season.