Loading...
Back to rankings
mistral-medium-2508
Everything behind this model's benchmark score: the exact image sent, the exact ground truth it was graded against, and the exact text it returned — for all 11 documents. Each score is recomputed from that text when this page is served.
Quality
61.9%
Hard-document score 61.9% · no blank-page penalty
Not part of Quality: the 11 documents below average 95.8%.
Documents
11
Avg latency
2.0s
Scores reproducible
11/11
Measured on corpus ocr-shared-11-normalized/v2 with scorer ocr-shared-11-scorer/v2 · published 2026-10-05. Provider offering used: mistral-mistral-medium-2508 (mistral).
corpus manifest sha256: b8f240c12ac5778625786d08e2e7fc2267721f2f458c5f425b8c635170590c94
The corpus is public: browse every test document.
1. Grocery Receipt
Receipt100.0%Character LCS similarity (format-normalized) · 1.9s · measured 2026-08-08 · Synthetic receipt — tests retail-style dense numeric rows.
Input image
Ground truth
428 charsCORNER STORE 123 Main Street Date: 2026-02-28 14:32 -------------------------------- Milk 2% 1x $3.49 Bread Wheat 1x $2.99 Eggs Large 12ct 1x $4.29 Coffee Dark Roast 1x $8.99 Bananas 1.2lb 1x $0.89 -------------------------------- Subtotal: $20.65 Tax (8.25%): $1.70 TOTAL: $22.35 -------------------------------- VISA ****4821 Thank you for shopping!
What mistral-medium-2508 returned
399 charsCORNER STORE 123 Main Street Date: 2026-02-28 14:32 --------------------------------- Milk 2% 1x $3.49 Bread Wheat 1x $2.99 Eggs Large 12ct 1x $4.29 Coffee Dark Roast 1x $8.99 Bananas 1.2lb 1x $0.89 --------------------------------- Subtotal: $20.65 Tax (8.25%): $1.70 TOTAL: $22.35 --------------------------------- VISA ****4821 Thank you for shopping!
Re-scoring the transcript above with the character lcs similarity (format-normalized) gives 100.0% — the published score. Recomputed when this page was rendered, not copied from a database field.
2. Café Receipt
Receipt86.7%Character LCS similarity (format-normalized) · 1.6s · measured 2026-08-08 · Synthetic receipt — tests retail-style dense numeric rows.
Input image
Ground truth
365 charsCAFE BISTRO 456 Oak Avenue, Suite 2 02/28/2026 10:15 AM ================================ Cappuccino 1 $4.50 Croissant 2 $7.00 Orange Juice 1 $3.25 Avocado Toast 1 $9.50 ================================ Subtotal $24.25 Tip (18%): $4.37 TOTAL: $28.62 Paid: Apple Pay Have a great day!
What mistral-medium-2508 returned
331 charsCAFE BISTRO 456 Oak Avenue, Suite 2 02/28/2026 10:15 AM --------------------------------- Cappuccino 1 $4.50 Croissant 2 $7.00 Orange Juice 1 $3.25 Avocado Toast 1 $9.50 --------------------------------- Subtotal $24.25 Tip (18%): $4.37 TOTAL: $28.62 Paid: Apple Pay Have a great day!
Re-scoring the transcript above with the character lcs similarity (format-normalized) gives — the published score. Recomputed when this page was rendered, not copied from a database field.
3. Handwritten Letter
Handwriting100.0%Character LCS similarity (format-normalized) · 804ms · measured 2026-08-08 · Synthetic handwriting — tests cursive recognition.
Input image
Ground truth
177 charsDear Professor, I wanted to follow up on our discussion about the research proposal. The deadline is March 15 and I have completed the first three sections. Best regards, Alex
What mistral-medium-2508 returned
177 charsDear Professor, I wanted to follow up on our discussion about the research proposal. The deadline is March 15 and I have completed the first three sections. Best regards, Alex
Re-scoring the transcript above with the character lcs similarity (format-normalized) gives 100.0% — the published score. Recomputed when this page was rendered, not copied from a database field.
4. Handwritten Notes
Handwriting100.0%Character LCS similarity (format-normalized) · 1.0s · measured 2026-08-08 · Synthetic handwriting — tests cursive recognition.
Input image
Ground truth
240 charsMeeting Notes - Feb 28 - Review Q4 budget by Friday - Call vendor re: contract renewal - Update project timeline - Send report to Sarah - Book conference room for Wed - Prepare slides for demo Action: Sarah to confirm deadline with client
What mistral-medium-2508 returned
240 charsMeeting Notes - Feb 28 - Review Q4 budget by Friday - Call vendor re: contract renewal - Update project timeline - Send report to Sarah - Book conference room for Wed - Prepare slides for demo Action: Sarah to confirm deadline with client
Re-scoring the transcript above with the character lcs similarity (format-normalized) gives 100.0% — the published score. Recomputed when this page was rendered, not copied from a database field.
5. Services Invoice
Invoice100.0%Character LCS similarity (format-normalized) · 2.5s · measured 2026-08-08 · Synthetic invoice — tests tabular billing layouts.
Input image
Ground truth
660 charsINVOICE #INV-2026-0472
From: Acme Solutions LLC
To: Widget Corp International
Date: February 28, 2026
Due Date: March 30, 2026
Description Qty Rate Amount
---------------------------------------------------
Web Development 40h $150.00 $6,000.00
UI/UX Design 20h $125.00 $2,500.00
Server Infrastructure 1 $500.00 $500.00
---------------------------------------------------
Subtotal: $9,000.00
Tax (10%): $900.00
TOTAL: $9,900.00
Payment Terms: Net 30
Bank: First National Bank Acct: 1234567890What mistral-medium-2508 returned
624 charsINVOICE #INV-2026-0472
From: Acme Solutions LLC
To: Widget Corp International
Date: February 28, 2026
Due Date: March 30, 2026
Description Qty Rate Amount
-----------------------------------------------
Web Development 40h $150.00 $6,000.00
UI/UX Design 20h $125.00 $2,500.00
Server Infrastructure 1 $500.00 $500.00
-----------------------------------------------
Subtotal: $9,000.00
Tax (10%): $900.00
TOTAL: $9,900.00
Payment Terms: Net 30
Bank: First National Bank Acct: 12345678906. Products Invoice
Invoice100.0%Character LCS similarity (format-normalized) · 2.5s · measured 2026-08-08 · Synthetic invoice — tests tabular billing layouts.
Input image
Ground truth
610 charsINVOICE
Invoice No: 10582
Date: 2026-02-15
Bill To:
Johnson & Partners LLP
789 Corporate Blvd
Austin, TX 78701
Item Qty Price Total
----------------------------------------------
Office Chairs (Mesh) 5 $289.00 $1,445.00
Standing Desks 3 $549.00 $1,647.00
Monitor Arms 8 $79.00 $632.00
Cable Management Kit 8 $24.99 $199.92
----------------------------------------------
Subtotal: $3,923.92
Shipping: $150.00
TOTAL: $4,073.92What mistral-medium-2508 returned
578 charsINVOICE
Invoice No: 10582
Date: 2026-02-15
Bill To:
Johnson & Partners LLP
789 Corporate Blvd
Austin, TX 78701
Item Qty Price Total
---------------------------------------------
Office Chairs (Mesh) 5 $289.00 $1,445.00
Standing Desks 3 $549.00 $1,647.00
Monitor Arms 8 $79.00 $632.00
Cable Management Kit 8 $24.99 $199.92
---------------------------------------------
Subtotal: $3,923.92
Shipping: $150.00
TOTAL: $4,073.927. Benchmark Table
Table100.0%Character LCS similarity (format-normalized) · 2.2s · measured 2026-08-08 · Synthetic table — tests column and row structure parsing.
Input image
Ground truth
399 charsEngine Performance Benchmark Results Engine Latency(ms) Accuracy Cost/Page ---------- ----------- -------- --------- Tesseract 178ms 92.1% $0.0005 EasyOCR 86ms 88.7% $0.0005 docTR 908ms 94.3% $0.0005 GPT-4o 1600ms 98.9% $0.0100 Claude Sonnet 1738ms 99.1% $0.0080 Gemini Flash 798ms 97.2% $0.0030
What mistral-medium-2508 returned
442 charsEngine Performance Benchmark Results --- Engine | Latency(ms) | Accuracy | Cost/Page --------------|-------------|----------|---------- Tesseract | 178ms | 92.1% | $0.0005 EasyOCR | 86ms | 88.7% | $0.0005 docTR | 908ms | 94.3% | $0.0005 GPT-4o | 1600ms | 98.9% | $0.0100 Claude Sonnet | 1738ms | 99.1% | $0.0080 Gemini Flash | 798ms | 97.2% | $0.0030 ---
8. Revenue Table
Table100.0%Character LCS similarity (format-normalized) · 2.2s · measured 2026-08-08 · Synthetic table — tests column and row structure parsing.
Input image
Ground truth
416 charsMonthly Revenue by Region (USD) Region Jan Feb Mar ----------- --------- -------- -------- North America $45,200 $48,100 $52,300 Europe $31,800 $33,200 $35,900 Asia Pacific $22,400 $24,700 $27,100 Latin America $8,900 $9,400 $10,200 Middle East $5,100 $5,800 $6,300 ----------- --------- -------- -------- Total $113,400 $121,200 $131,800
What mistral-medium-2508 returned
451 charsMonthly Revenue by Region (USD) | Region | Jan | Feb | Mar | |----------------|----------|----------|----------| | North America | $45,200 | $48,100 | $52,300 | | Europe | $31,800 | $33,200 | $35,900 | | Asia Pacific | $22,400 | $24,700 | $27,100 | | Latin America | $8,900 | $9,400 | $10,200 | | Middle East | $5,100 | $5,800 | $6,300 | | | Total | $113,400 | $121,200 | $131,800 |
9. Dense Legal Paragraph
Dense Text100.0%Character LCS similarity (format-normalized) · 1.5s · measured 2026-08-08 · Synthetic dense paragraph — tests small-font continuous text recognition.
Input image
Ground truth
545 charsSection 4.2 - Data Processing Requirements All personally identifiable information (PII) must be encrypted at rest using AES-256 encryption and in transit using TLS 1.3 or higher. Data retention policies require that raw OCR output be purged within 24 hours of processing unless the customer has opted into extended storage (maximum 90 days). Metadata including timestamps, engine IDs, and processing latency may be retained for up to 365 days for analytics purposes. Any cross-border data transfer must comply with GDPR Article 46 requirements.
What mistral-medium-2508 returned
545 charsSection 4.2 - Data Processing Requirements All personally identifiable information (PII) must be encrypted at rest using AES-256 encryption and in transit using TLS 1.3 or higher. Data retention policies require that raw OCR output be purged within 24 hours of processing unless the customer has opted into extended storage (maximum 90 days). Metadata including timestamps, engine IDs, and processing latency may be retained for up to 365 days for analytics purposes. Any cross-border data transfer must comply with GDPR Article 46 requirements.
10. Dense Terms of Service
Dense Text100.0%Character LCS similarity (format-normalized) · 1.8s · measured 2026-08-08 · Synthetic dense paragraph — tests small-font continuous text recognition.
Input image
Ground truth
579 charsTerms of Service - API Usage By accessing the OpenOCR API you agree to the following: (1) You will not exceed your allocated rate limit of 60 requests per minute per API key. (2) You will not use the service to process documents containing protected health information (PHI) without a signed BAA. (3) All API keys are confidential and must not be shared or embedded in client-side code. (4) We reserve the right to throttle or suspend accounts that exhibit abusive patterns. (5) Pricing is subject to change with 30 days written notice. Contact support@openocr.com for questions.
What mistral-medium-2508 returned
579 charsTerms of Service - API Usage By accessing the OpenOCR API you agree to the following: (1) You will not exceed your allocated rate limit of 60 requests per minute per API key. (2) You will not use the service to process documents containing protected health information (PHI) without a signed BAA. (3) All API keys are confidential and must not be shared or embedded in client-side code. (4) We reserve the right to throttle or suspend accounts that exhibit abusive patterns. (5) Pricing is subject to change with 30 days written notice. Contact support@openocr.com for questions.
11. HabitaOne Website Screenshot
Web UI Screenshot66.7%Expected-line checklist · 4.3s · measured 2026-08-08 · Real website screenshot — tests multilingual UI chrome, small Spanish listing text, and mixed text with graphics.
Input image
Ground truth
384 charsHABITAONE $ 2,000,000 $ 120,000 $ 18,000 $ 47,000 $ 5 $ 250 $ 75,000 $ 330,000 Buy Rent Sell Price Property type Rooms Area State City Save list Show on Map My Properties FOR SALE Terreno en Venta en Puerto Cabello Apartamento en Venta en Los Mangos Terreno en Venta en Capacho Viejo Apartamento en Venta en Res Abadía Puerto Cabello Valencia Carabobo San Diego HabitaOne Linux Claude
What mistral-medium-2508 returned
598 charsHABITAONE Buy Rent Sell $ 2,000,000 FOR SALE Terreno en Venta en Puerto Cabello Puerto Cabello, Carabobo 📐 14360 m² $ 120,000 FOR SALE Apartamento en Venta en Los Mangos Valencia, Carabobo 🛏 3 🛁 5 📐 292 m² $ 18,000 FOR SALE Terreno en Venta en Capacho Viejo Capacho Viejo, Táchira 📐 400 m² $ 47,000 FOR SALE Apartamento en Venta en Res Abadía San Diego, Carabobo 🛏 3 🛁 2 📐 85 m² $ 5 FOR SALE [Description not fully visible] $ 250 FOR SALE [Description not fully visible] $ 75,000 FOR SALE [Description not fully visible] $ 330,000 FOR SALE [Description not fully visible]
Blank page test
- Blank page score
- 100/100
- Penalty applied
- 0.0 points
Try 1
Reported no readable text:
“[illegible]”Try 2
Reported no readable text:
“[illegible]”Try 3
Reported no readable text:
“[illegible]”