By Isaac Flath
Evals on OCR outputs are usually much harder than on product agentic systems for two main reasons. This is a huge part of our upcoming course because of how critical it is, and we want to share as much knowledge publicly as possible. So let’s talk about the challenges, and then…
First, If you've been wondering wtf a decision model actually is, join us. Joe Barrow and I are going to be going into architecture details on the top OSS decision model by Perplexity. It's a free live discussion tomorrow night, Wednesday, on Decision Models like Jev.
After OCRing text usually you want to do something with the information. Maybe answer questions, make a research report, draft a legal case, or make a medical overview of a patient.
Pipelines and Vision Language Models (VLMs) are two common ways to OCR a document. But many people don’t understand the trade-offs that the different class of approaches have.
What OCR model should I use for X type of document is the most common question I get by far. The question assumes that you only need to know the type of document to pick the right OCR model, and that's not true.
I write about building real products and workflows on documents. Most of that comes down to turning difficult PDFs into useful, trustworthy data: OCR, structure, retrieval, citations, evals. I want to share useful observations as I find them all in one place, and I want you to…