New: Cookbooks and AI ExplanationsStep-by-Step recipes to solve problems connected to Roadmaps and Cheat Sheets. Need more details? Use AI buttons for structured and simple explanations with concrete examples throughout the whole platform.Take a look
The model reads the chart correctly. Then it does the subtraction wrong right in front of me.
What you'll have at the end
The chart's numbers pulled out and the follow-up math done by code instead of the model, checked against the chart by hand.
You need
You can already send a chart image to a vision-capable model and ask it a question about the image, and you know how to make that same model return output matching a JSON schema you define.
Not covered
Charts whose numbers are never printed anywhere on the image, only implied by bar height against an axis; reading those needs a different, more approximate approach than the exact-value extraction this recipe assumes.
Leans on
Give a vision model a zoom tool for illegible chart labels
when the number itself is too small or blurry to read confidently in the first place, that's a different failure than this recipe fixes, and giving the model a zoom tool solves it instead.
Pull every field off a handwritten form into clean JSON
when the source is a form instead of a chart and the goal is catching every small field rather than getting one arithmetic answer right, that recipe's completeness checks fit better than this one's math check.
Checked 15 Aug 2026
Part of the Multimodal AI cookbook