Loading...
Back to rankings
Mistral: Mistral Small 3.1 24B
Everything behind this model's benchmark score: the exact image sent, the exact ground truth it was graded against, and the exact text it returned — for all 11 documents. Each score is recomputed from that text when this page is served.
Average score
25.7%
Documents
11
Avg latency
1.7s
Scores reproducible
11/11
Measured on corpus ocr-shared-11-normalized/v2 with scorer ocr-shared-11-scorer/v2 · published 2026-10-05. Provider offering used: openrouter-mistralai-mistral-small-3.1-24b-instruct (openrouter).
corpus manifest sha256: b8f240c12ac5778625786d08e2e7fc2267721f2f458c5f425b8c635170590c94
The corpus is public: browse every test document.
1. Grocery Receipt
Receipt9.2%Character LCS similarity (format-normalized) · 638ms · measured 2026-08-08 · Synthetic receipt — tests retail-style dense numeric rows.
Input image
Ground truth
428 charsCORNER STORE 123 Main Street Date: 2026-02-28 14:32 -------------------------------- Milk 2% 1x $3.49 Bread Wheat 1x $2.99 Eggs Large 12ct 1x $4.29 Coffee Dark Roast 1x $8.99 Bananas 1.2lb 1x $0.89 -------------------------------- Subtotal: $20.65 Tax (8.25%): $1.70 TOTAL: $22.35 -------------------------------- VISA ****4821 Thank you for shopping!
What Mistral: Mistral Small 3.1 24B returned
12 charsCORNER STORE
Re-scoring the transcript above with the character lcs similarity (format-normalized) gives 9.2% — the published score. Recomputed when this page was rendered, not copied from a database field.
2. Café Receipt
Receipt7.5%Character LCS similarity (format-normalized) · 916ms · measured 2026-08-08 · Synthetic receipt — tests retail-style dense numeric rows.
Input image
Ground truth
365 charsCAFE BISTRO 456 Oak Avenue, Suite 2 02/28/2026 10:15 AM ================================ Cappuccino 1 $4.50 Croissant 2 $7.00 Orange Juice 1 $3.25 Avocado Toast 1 $9.50 ================================ Subtotal $24.25 Tip (18%): $4.37 TOTAL: $28.62 Paid: Apple Pay Have a great day!
What Mistral: Mistral Small 3.1 24B returned
11 charsCAFE BISTRO
Re-scoring the transcript above with the character lcs similarity (format-normalized) gives 7.5% — the published score. Recomputed when this page was rendered, not copied from a database field.
3. Handwritten Letter
Handwriting75.4%Character LCS similarity (format-normalized) · 3.0s · measured 2026-08-08 · Synthetic handwriting — tests cursive recognition.
Input image
Ground truth
177 charsDear Professor, I wanted to follow up on our discussion about the research proposal. The deadline is March 15 and I have completed the first three sections. Best regards, Alex
What Mistral: Mistral Small 3.1 24B returned
107 charsDear Professor, I wanted to follow up on our discussion about the research proposal. The deadline is March
Re-scoring the transcript above with the character lcs similarity (format-normalized) gives 75.4% — the published score. Recomputed when this page was rendered, not copied from a database field.
4. Handwritten Notes
Handwriting14.8%Character LCS similarity (format-normalized) · 2.5s · measured 2026-08-08 · Synthetic handwriting — tests cursive recognition.
Input image
Ground truth
240 charsMeeting Notes - Feb 28 - Review Q4 budget by Friday - Call vendor re: contract renewal - Update project timeline - Send report to Sarah - Book conference room for Wed - Prepare slides for demo Action: Sarah to confirm deadline with client
What Mistral: Mistral Small 3.1 24B returned
19 charsMeeting Notes - Feb
Re-scoring the transcript above with the character lcs similarity (format-normalized) gives 14.8% — the published score. Recomputed when this page was rendered, not copied from a database field.
5. Services Invoice
Invoice6.0%Character LCS similarity (format-normalized) · 2.0s · measured 2026-08-08 · Synthetic invoice — tests tabular billing layouts.
Input image
Ground truth
660 charsINVOICE #INV-2026-0472
From: Acme Solutions LLC
To: Widget Corp International
Date: February 28, 2026
Due Date: March 30, 2026
Description Qty Rate Amount
---------------------------------------------------
Web Development 40h $150.00 $6,000.00
UI/UX Design 20h $125.00 $2,500.00
Server Infrastructure 1 $500.00 $500.00
---------------------------------------------------
Subtotal: $9,000.00
Tax (10%): $900.00
TOTAL: $9,900.00
Payment Terms: Net 30
Bank: First National Bank Acct: 1234567890What Mistral: Mistral Small 3.1 24B returned
13 charsINVOICE #INV-
Re-scoring the transcript above with the character lcs similarity (format-normalized) gives — the published score. Recomputed when this page was rendered, not copied from a database field.
6. Products Invoice
Invoice10.9%Character LCS similarity (format-normalized) · 518ms · measured 2026-08-08 · Synthetic invoice — tests tabular billing layouts.
Input image
Ground truth
610 charsINVOICE
Invoice No: 10582
Date: 2026-02-15
Bill To:
Johnson & Partners LLP
789 Corporate Blvd
Austin, TX 78701
Item Qty Price Total
----------------------------------------------
Office Chairs (Mesh) 5 $289.00 $1,445.00
Standing Desks 3 $549.00 $1,647.00
Monitor Arms 8 $79.00 $632.00
Cable Management Kit 8 $24.99 $199.92
----------------------------------------------
Subtotal: $3,923.92
Shipping: $150.00
TOTAL: $4,073.92What Mistral: Mistral Small 3.1 24B returned
20 charsINVOICE Invoice No:
Re-scoring the transcript above with the character lcs similarity (format-normalized) gives 10.9% — the published score. Recomputed when this page was rendered, not copied from a database field.
7. Benchmark Table
Table49.9%Character LCS similarity (format-normalized) · 2.5s · measured 2026-08-08 · Synthetic table — tests column and row structure parsing.
Input image
Ground truth
399 charsEngine Performance Benchmark Results Engine Latency(ms) Accuracy Cost/Page ---------- ----------- -------- --------- Tesseract 178ms 92.1% $0.0005 EasyOCR 86ms 88.7% $0.0005 docTR 908ms 94.3% $0.0005 GPT-4o 1600ms 98.9% $0.0100 Claude Sonnet 1738ms 99.1% $0.0080 Gemini Flash 798ms 97.2% $0.0030
What Mistral: Mistral Small 3.1 24B returned
141 charsEngine Performance Benchmark Results Engine Latency(ms) Accuracy Cost/Page ------ ----------- -------- --------- Tesseract
Re-scoring the transcript above with the character lcs similarity (format-normalized) gives 49.9% — the published score. Recomputed when this page was rendered, not copied from a database field.
8. Revenue Table
Table40.7%Character LCS similarity (format-normalized) · 1.8s · measured 2026-08-08 · Synthetic table — tests column and row structure parsing.
Input image
Ground truth
416 charsMonthly Revenue by Region (USD) Region Jan Feb Mar ----------- --------- -------- -------- North America $45,200 $48,100 $52,300 Europe $31,800 $33,200 $35,900 Asia Pacific $22,400 $24,700 $27,100 Latin America $8,900 $9,400 $10,200 Middle East $5,100 $5,800 $6,300 ----------- --------- -------- -------- Total $113,400 $121,200 $131,800
What Mistral: Mistral Small 3.1 24B returned
120 charsMonthly Revenue by Region (USD) Region Jan Feb Mar ----------------------------- North America $
Re-scoring the transcript above with the character lcs similarity (format-normalized) gives 40.7% — the published score. Recomputed when this page was rendered, not copied from a database field.
9. Dense Legal Paragraph
Dense Text2.5%Character LCS similarity (format-normalized) · 898ms · measured 2026-08-08 · Synthetic dense paragraph — tests small-font continuous text recognition.
Input image
Ground truth
545 charsSection 4.2 - Data Processing Requirements All personally identifiable information (PII) must be encrypted at rest using AES-256 encryption and in transit using TLS 1.3 or higher. Data retention policies require that raw OCR output be purged within 24 hours of processing unless the customer has opted into extended storage (maximum 90 days). Metadata including timestamps, engine IDs, and processing latency may be retained for up to 365 days for analytics purposes. Any cross-border data transfer must comply with GDPR Article 46 requirements.
What Mistral: Mistral Small 3.1 24B returned
7 charsSection
Re-scoring the transcript above with the character lcs similarity (format-normalized) gives 2.5% — the published score. Recomputed when this page was rendered, not copied from a database field.
10. Dense Terms of Service
Dense Text26.1%Character LCS similarity (format-normalized) · 906ms · measured 2026-08-08 · Synthetic dense paragraph — tests small-font continuous text recognition.
Input image
Ground truth
579 charsTerms of Service - API Usage By accessing the OpenOCR API you agree to the following: (1) You will not exceed your allocated rate limit of 60 requests per minute per API key. (2) You will not use the service to process documents containing protected health information (PHI) without a signed BAA. (3) All API keys are confidential and must not be shared or embedded in client-side code. (4) We reserve the right to throttle or suspend accounts that exhibit abusive patterns. (5) Pricing is subject to change with 30 days written notice. Contact support@openocr.com for questions.
What Mistral: Mistral Small 3.1 24B returned
87 charsTerms of Service - API Usage By accessing the OpenOCR API you agree to the following: (
Re-scoring the transcript above with the character lcs similarity (format-normalized) gives — the published score. Recomputed when this page was rendered, not copied from a database field.
11. HabitaOne Website Screenshot
Web UI Screenshot39.4%Expected-line checklist · 2.8s · measured 2026-08-08 · Real website screenshot — tests multilingual UI chrome, small Spanish listing text, and mixed text with graphics.
Input image
Ground truth
384 charsHABITAONE $ 2,000,000 $ 120,000 $ 18,000 $ 47,000 $ 5 $ 250 $ 75,000 $ 330,000 Buy Rent Sell Price Property type Rooms Area State City Save list Show on Map My Properties FOR SALE Terreno en Venta en Puerto Cabello Apartamento en Venta en Los Mangos Terreno en Venta en Capacho Viejo Apartamento en Venta en Res Abadía Puerto Cabello Valencia Carabobo San Diego HabitaOne Linux Claude
What Mistral: Mistral Small 3.1 24B returned
149 charsHABITAONE Buy Rent Sell EN My Properties Search city or state... Buy Rent Price Property type Rooms Area State Show list List & map FOR SALE $
Re-scoring the transcript above with the expected-line checklist gives 39.4% — the published score. Recomputed when this page was rendered, not copied from a database field.
Blank page test
- Blank page score
- 0/100
- Penalty applied
- −15.0 points
Per-try outputs are unavailable.