Loading...
Back to rankings
mistral-large-2512
Everything behind this model's benchmark score: the exact image sent, the exact ground truth it was graded against, and the exact text it returned — for all 11 documents. Each score is recomputed from that text when this page is served.
Quality
40.5%
Hard-document score 55.5% − 15.0 blank-page penalty = 40.5%
Not part of Quality: the 11 documents below average 96.8%.
Documents
11
Avg latency
4.3s
Scores reproducible
11/11
Measured on corpus ocr-shared-11-normalized/v2 with scorer ocr-shared-11-scorer/v2 · published 2026-10-05. Provider offering used: mistral-mistral-large-latest (mistral).
corpus manifest sha256: b8f240c12ac5778625786d08e2e7fc2267721f2f458c5f425b8c635170590c94
The corpus is public: browse every test document.
1. Grocery Receipt
Receipt99.8%Character LCS similarity (format-normalized) · 5.0s · measured 2026-08-08 · Synthetic receipt — tests retail-style dense numeric rows.
Input image
Ground truth
428 charsCORNER STORE 123 Main Street Date: 2026-02-28 14:32 -------------------------------- Milk 2% 1x $3.49 Bread Wheat 1x $2.99 Eggs Large 12ct 1x $4.29 Coffee Dark Roast 1x $8.99 Bananas 1.2lb 1x $0.89 -------------------------------- Subtotal: $20.65 Tax (8.25%): $1.70 TOTAL: $22.35 -------------------------------- VISA ****4821 Thank you for shopping!
What mistral-large-2512 returned
368 chars``` CORNER STORE 123 Main Street Date: 2026-02-28 14:32 Milk 2% 1x $3.49 Bread Wheat 1x $2.99 Eggs Large 12ct 1x $4.29 Coffee Dark Roast 1x $8.99 Bananas 1.21lb 1x $0.89 Subtotal: $20.65 Tax (8.25%): $1.70 TOTAL: $22.35 VISA ****4821 Thank you for shopping! ```
Re-scoring the transcript above with the character lcs similarity (format-normalized) gives 99.8% — the published score. Recomputed when this page was rendered, not copied from a database field.
2. Café Receipt
Receipt86.6%Character LCS similarity (format-normalized) · 4.2s · measured 2026-08-08 · Synthetic receipt — tests retail-style dense numeric rows.
Input image
Ground truth
365 charsCAFE BISTRO 456 Oak Avenue, Suite 2 02/28/2026 10:15 AM ================================ Cappuccino 1 $4.50 Croissant 2 $7.00 Orange Juice 1 $3.25 Avocado Toast 1 $9.50 ================================ Subtotal $24.25 Tip (18%): $4.37 TOTAL: $28.62 Paid: Apple Pay Have a great day!
What mistral-large-2512 returned
361 charsCAFE BISTRO 456 Oak Avenue, Suite 2 02/28/2026 10:15 AM -------------------------------- Cappuccino 1 $4.50 Croissant 2 $7.00 Orange Juice 1 $3.25 Avocado Toast 1 $9.50 -------------------------------- Subtotal: $24.25 Tip (18%): $4.37 TOTAL: $28.62 Paid: Apple Pay Have a great day!
Re-scoring the transcript above with the character lcs similarity (format-normalized) gives — the published score. Recomputed when this page was rendered, not copied from a database field.
3. Handwritten Letter
Handwriting100.0%Character LCS similarity (format-normalized) · 1.3s · measured 2026-08-08 · Synthetic handwriting — tests cursive recognition.
Input image
Ground truth
177 charsDear Professor, I wanted to follow up on our discussion about the research proposal. The deadline is March 15 and I have completed the first three sections. Best regards, Alex
What mistral-large-2512 returned
177 charsDear Professor, I wanted to follow up on our discussion about the research proposal. The deadline is March 15 and I have completed the first three sections. Best regards, Alex
Re-scoring the transcript above with the character lcs similarity (format-normalized) gives 100.0% — the published score. Recomputed when this page was rendered, not copied from a database field.
4. Handwritten Notes
Handwriting100.0%Character LCS similarity (format-normalized) · 2.0s · measured 2026-08-08 · Synthetic handwriting — tests cursive recognition.
Input image
Ground truth
240 charsMeeting Notes - Feb 28 - Review Q4 budget by Friday - Call vendor re: contract renewal - Update project timeline - Send report to Sarah - Book conference room for Wed - Prepare slides for demo Action: Sarah to confirm deadline with client
What mistral-large-2512 returned
240 charsMeeting Notes - Feb 28 - Review Q4 budget by Friday - Call vendor re: contract renewal - Update project timeline - Send report to Sarah - Book conference room for Wed - Prepare slides for demo Action: Sarah to confirm deadline with client
Re-scoring the transcript above with the character lcs similarity (format-normalized) gives 100.0% — the published score. Recomputed when this page was rendered, not copied from a database field.
5. Services Invoice
Invoice100.0%Character LCS similarity (format-normalized) · 4.5s · measured 2026-08-08 · Synthetic invoice — tests tabular billing layouts.
Input image
Ground truth
660 charsINVOICE #INV-2026-0472
From: Acme Solutions LLC
To: Widget Corp International
Date: February 28, 2026
Due Date: March 30, 2026
Description Qty Rate Amount
---------------------------------------------------
Web Development 40h $150.00 $6,000.00
UI/UX Design 20h $125.00 $2,500.00
Server Infrastructure 1 $500.00 $500.00
---------------------------------------------------
Subtotal: $9,000.00
Tax (10%): $900.00
TOTAL: $9,900.00
Payment Terms: Net 30
Bank: First National Bank Acct: 1234567890What mistral-large-2512 returned
548 charsINVOICE #INV-2026-0472
From: Acme Solutions LLC
To: Widget Corp International
Date: February 28, 2026
Due Date: March 30, 2026
Description Qty Rate Amount
Web Development 40h $150.00 $6,000.00
UI/UX Design 20h $125.00 $2,500.00
Server Infrastructure 1 $500.00 $500.00
Subtotal: $9,000.00
Tax (10%): $900.00
TOTAL: $9,900.00
Payment Terms: Net 30
Bank: First National Bank Acct: 12345678906. Products Invoice
Invoice100.0%Character LCS similarity (format-normalized) · 4.1s · measured 2026-08-08 · Synthetic invoice — tests tabular billing layouts.
Input image
Ground truth
610 charsINVOICE
Invoice No: 10582
Date: 2026-02-15
Bill To:
Johnson & Partners LLP
789 Corporate Blvd
Austin, TX 78701
Item Qty Price Total
----------------------------------------------
Office Chairs (Mesh) 5 $289.00 $1,445.00
Standing Desks 3 $549.00 $1,647.00
Monitor Arms 8 $79.00 $632.00
Cable Management Kit 8 $24.99 $199.92
----------------------------------------------
Subtotal: $3,923.92
Shipping: $150.00
TOTAL: $4,073.92What mistral-large-2512 returned
570 charsINVOICE
Invoice No: 10582
Date: 2026-02-15
Bill To:
Johnson & Partners LLP
789 Corporate Blvd
Austin, TX 78701
Item Qty Price Total
-------------------------------------------
Office Chairs (Mesh) 5 $289.00 $1,445.00
Standing Desks 3 $549.00 $1,647.00
Monitor Arms 8 $79.00 $632.00
Cable Management Kit 8 $24.99 $199.92
-------------------------------------------
Subtotal: $3,923.92
Shipping: $150.00
TOTAL: $4,073.927. Benchmark Table
Table99.8%Character LCS similarity (format-normalized) · 4.4s · measured 2026-08-08 · Synthetic table — tests column and row structure parsing.
Input image
Ground truth
399 charsEngine Performance Benchmark Results Engine Latency(ms) Accuracy Cost/Page ---------- ----------- -------- --------- Tesseract 178ms 92.1% $0.0005 EasyOCR 86ms 88.7% $0.0005 docTR 908ms 94.3% $0.0005 GPT-4o 1600ms 98.9% $0.0100 Claude Sonnet 1738ms 99.1% $0.0080 Gemini Flash 798ms 97.2% $0.0030
What mistral-large-2512 returned
501 charsEngine Performance Benchmark Results | Engine | Latency (ms) | Accuracy | Cost/Page | |---------------|--------------|----------|-------------| | Tesseract | 178ms | 92.1% | $0.0005 | | EasyOCR | 86ms | 88.7% | $0.0005 | | docTR | 908ms | 94.3% | $0.0005 | | GPT-4o | 1600ms | 98.9% | $0.0100 | | Claude Sonnet | 1738ms | 99.1% | $0.0080 | | Gemini Flash | 798ms | 97.2% | $0.0030 |
8. Revenue Table
Table100.0%Character LCS similarity (format-normalized) · 3.5s · measured 2026-08-08 · Synthetic table — tests column and row structure parsing.
Input image
Ground truth
416 charsMonthly Revenue by Region (USD) Region Jan Feb Mar ----------- --------- -------- -------- North America $45,200 $48,100 $52,300 Europe $31,800 $33,200 $35,900 Asia Pacific $22,400 $24,700 $27,100 Latin America $8,900 $9,400 $10,200 Middle East $5,100 $5,800 $6,300 ----------- --------- -------- -------- Total $113,400 $121,200 $131,800
What mistral-large-2512 returned
468 charsMonthly Revenue by Region (USD) | Region | Jan | Feb | Mar | |-----------------|----------|----------|----------| | North America | $45,200 | $48,100 | $52,300 | | Europe | $31,800 | $33,200 | $35,900 | | Asia Pacific | $22,400 | $24,700 | $27,100 | | Latin America | $8,900 | $9,400 | $10,200 | | Middle East | $5,100 | $5,800 | $6,300 | | **Total** | **$113,400** | **$121,200** | **$131,800** |
9. Dense Legal Paragraph
Dense Text100.0%Character LCS similarity (format-normalized) · 3.1s · measured 2026-08-08 · Synthetic dense paragraph — tests small-font continuous text recognition.
Input image
Ground truth
545 charsSection 4.2 - Data Processing Requirements All personally identifiable information (PII) must be encrypted at rest using AES-256 encryption and in transit using TLS 1.3 or higher. Data retention policies require that raw OCR output be purged within 24 hours of processing unless the customer has opted into extended storage (maximum 90 days). Metadata including timestamps, engine IDs, and processing latency may be retained for up to 365 days for analytics purposes. Any cross-border data transfer must comply with GDPR Article 46 requirements.
What mistral-large-2512 returned
545 charsSection 4.2 - Data Processing Requirements All personally identifiable information (PII) must be encrypted at rest using AES-256 encryption and in transit using TLS 1.3 or higher. Data retention policies require that raw OCR output be purged within 24 hours of processing unless the customer has opted into extended storage (maximum 90 days). Metadata including timestamps, engine IDs, and processing latency may be retained for up to 365 days for analytics purposes. Any cross-border data transfer must comply with GDPR Article 46 requirements.
10. Dense Terms of Service
Dense Text100.0%Character LCS similarity (format-normalized) · 2.7s · measured 2026-08-08 · Synthetic dense paragraph — tests small-font continuous text recognition.
Input image
Ground truth
579 charsTerms of Service - API Usage By accessing the OpenOCR API you agree to the following: (1) You will not exceed your allocated rate limit of 60 requests per minute per API key. (2) You will not use the service to process documents containing protected health information (PHI) without a signed BAA. (3) All API keys are confidential and must not be shared or embedded in client-side code. (4) We reserve the right to throttle or suspend accounts that exhibit abusive patterns. (5) Pricing is subject to change with 30 days written notice. Contact support@openocr.com for questions.
What mistral-large-2512 returned
579 charsTerms of Service - API Usage By accessing the OpenOCR API you agree to the following: (1) You will not exceed your allocated rate limit of 60 requests per minute per API key. (2) You will not use the service to process documents containing protected health information (PHI) without a signed BAA. (3) All API keys are confidential and must not be shared or embedded in client-side code. (4) We reserve the right to throttle or suspend accounts that exhibit abusive patterns. (5) Pricing is subject to change with 30 days written notice. Contact support@openocr.com for questions.
11. HabitaOne Website Screenshot
Web UI Screenshot78.8%Expected-line checklist · 12.1s · measured 2026-08-08 · Real website screenshot — tests multilingual UI chrome, small Spanish listing text, and mixed text with graphics.
Input image
Ground truth
384 charsHABITAONE $ 2,000,000 $ 120,000 $ 18,000 $ 47,000 $ 5 $ 250 $ 75,000 $ 330,000 Buy Rent Sell Price Property type Rooms Area State City Save list Show on Map My Properties FOR SALE Terreno en Venta en Puerto Cabello Apartamento en Venta en Los Mangos Terreno en Venta en Capacho Viejo Apartamento en Venta en Res Abadía Puerto Cabello Valencia Carabobo San Diego HabitaOne Linux Claude
What mistral-large-2512 returned
1117 chars``` 🏠 ABITAONE Buy Rent Sell ____________________ Search city or state... ______ ▼ Buy ▼ Rent Price ▼ Property type ▼ Rooms ▼ Area ▼ State ▼ ☑ Show list □ List & map FOR SALE  $ 2,000,000 Terreno en Venta en Puerto Cabello Puerto Cabello, Carabobo 📍 0 ❤️ 0 💬 14360 m² 🔗 FOR SALE  Rentahouse Venezuela $ 120,000 Apartamento en Venta en Los Mangos Valencia Carabobo Valencia 📍 3 ❤️ 5 💬 292 m² 🔗 FOR SALE  $ 18,000 Terreno en Venta en Capacho Viejo Capacho Viejo, Táchira 📍 3 ❤️ 2 💬 400 m² 🔗 FOR SALE  $ 47,000 Apartamento en Venta en Res Abadía San Diego, Carabobo 📍 3 ❤️ 2 💬 85 m² 🔗 FOR SALE  $ 5 Fuente: Century21 (Price not clearly visible for this property) FOR SALE  Rentahouse Venezuela $ 250 (Property details not fully visible) FOR SALE  Rentahouse Venezuela $ 75,000 (Property details not fully visible) FOR SALE  $ 330,000 (Property details not fully visible) ```
Blank page test
- Blank page score
- 0/100
- Penalty applied
- −15.0 points
Try 1
Returned text:
“Dr. John Doe 1234 Elm Street Anytown, USA 12345 (555) 123-4567 **PATIENT INFORMATION** **Name:** Jane Smith **Date of Birth:** 05/14/1980 **Date:** 10/25/2023 **Patient ID:** JS80514 **DIAGNOSIS:** - Hypertension - Type 2 Diabetes Mellitus **MEDICATIONS PRESCRIBED:** | Medication Name | Dosage | Frequency | Refills | |-----------------------|--------------|-----------------|”Try 2
Returned text:
“Dr. J. Allen Hynek Center for U.F.O. Studies 1609 Sherman Ave., Suite 207 Evanston, Illinois 60201 Dear Dr. Hynek: I am writing to you in regards to a sighting of a U.F.O. that I had on the night of June 15, 1976. I have enclosed a detailed report of the incident, but I would like to summarize it for you here. At approximately 10:45 p.m., I was driving home from work on Route 7, just south of B”Try 3
Returned text:
“DR. JOHN H. WATSON'S STORY CONTINUED. CHAPTER I. THE SCIENCE OF DEDUCTION. SHERLOCK HOLMES took his bottle from the corner of the mantel-piece, and his hypodermic syringe from its neat morocco case. With his long, white, nervous fingers he adjusted the delicate needle and rolled back his left shirtcuff. For some little time his eyes rested thoughtfully upon the sinewy forearm and wrist, all do”