AI chatbots give wrong answers to financial queries 'most of the time'

ehe78qhe

Article is just a vague summary of https://www.saturnos.com/report/artificial-authority Anecdotally, current models seem to be decent at general personal finance principles - certainly better than the majority of personal finance education that people get exposed to unless they seek it out and read a variety of books and sources. But I wouldn't trust them with direct decision making with actual money due to the training lag time on current tax policy, etc.

sixtyj

I would prefer to use agent-assisted python scripts that chatbot.

demibabs

I like how FT makes me accept cookies from their 46 “technology” (advertising) partners before showing me that the article is behind a paywall anyway.

01100011

Single shot or with reasoning enabled? My experience is that reasoning dramatically reduces hallucinations and improves output quality. I don't trust models without it.

simianwords

These models do pretty well in benchmarks and real world so I'm highly suspicious of this article. Further more, in the original report, the examples of bad answers are from Haiku - at least 7 out of 10. Anyone who knows anything about LLMs know that haiku shouldn't be used for anything pretty much. There's no reproducible set either. I'm not gonna trust this report.