Think AIs will come for your CFO and his team? Not quite, not yet… Vals.ai’s Finance Agent Benchmark clearly shows we are some ways off from the professions caving in to our LLM-powered overlords:
“The foundation models are currently ill-suited to perform open-ended questions expected of entry-level finance analysts”
But fret not — not all is lost:
“Models on average performed best in the simple quantitative (37.57% average accuracy) and qualitative retrieval (30.79% average accuracy) tasks. These tasks are easy but time-intensive for finance analysts.”
