Loading...
Back to rankings
o1-2024-12-17
Everything behind this model's benchmark score: the exact image sent, the exact ground truth it was graded against, and the exact text it returned — for all 11 documents. Each score is recomputed from that text when this page is served.
Average score
90.6%
Documents
11
Avg latency
13.0s
Scores reproducible
10/11
Measured on corpus ocr-shared-11-normalized/v2 with scorer ocr-shared-11-scorer/v2 · published 2026-10-05. Provider offering used: openai-o1-2024-12-17 (openai).
corpus manifest sha256: b8f240c12ac5778625786d08e2e7fc2267721f2f458c5f425b8c635170590c94
The corpus is public: browse every test document.
1. Grocery Receipt
Receipt100.0%Character LCS similarity (format-normalized) · 20.5s · measured 2026-08-17 · Synthetic receipt — tests retail-style dense numeric rows.
Input image
Ground truth
428 charsCORNER STORE 123 Main Street Date: 2026-02-28 14:32 -------------------------------- Milk 2% 1x $3.49 Bread Wheat 1x $2.99 Eggs Large 12ct 1x $4.29 Coffee Dark Roast 1x $8.99 Bananas 1.2lb 1x $0.89 -------------------------------- Subtotal: $20.65 Tax (8.25%): $1.70 TOTAL: $22.35 -------------------------------- VISA ****4821 Thank you for shopping!
What o1-2024-12-17 returned
510 charsCORNER STORE 123 Main Street Date: 2026-02-28 14:32 ------------------------------------- Milk 2% 1x $3.49 Bread Wheat 1x $2.99 Eggs Large 12ct 1x $4.29 Coffee Dark Roast 1x $8.99 Bananas 1.2lb 1x $0.89 ------------------------------------- Subtotal: $20.65 Tax (8.25%): $1.70 TOTAL: $22.35 ------------------------------------- VISA ****4821 Thank you for shopping!
Re-scoring the transcript above with the character lcs similarity (format-normalized) gives 100.0% — the published score. Recomputed when this page was rendered, not copied from a database field.
2. Café Receipt
Receipt96.7%Character LCS similarity (format-normalized) · 4.8s · measured 2026-08-17 · Synthetic receipt — tests retail-style dense numeric rows.
Input image
Ground truth
365 charsCAFE BISTRO 456 Oak Avenue, Suite 2 02/28/2026 10:15 AM ================================ Cappuccino 1 $4.50 Croissant 2 $7.00 Orange Juice 1 $3.25 Avocado Toast 1 $9.50 ================================ Subtotal $24.25 Tip (18%): $4.37 TOTAL: $28.62 Paid: Apple Pay Have a great day!
What o1-2024-12-17 returned
373 charsCAFE BISTRO 456 Oak Avenue, Suite 2 02/28/2026 10:15 AM ======================= Cappuccino 1 $4.50 Croissant 2 $7.00 Orange Juice 1 $3.25 Avocado Toast 1 $9.50 ======================= Subtotal $24.25 Tip (18%): $4.37 TOTAL: $28.62 Paid: Apple Pay Have a great day!
Re-scoring the transcript above with the character lcs similarity (format-normalized) gives — the published score. Recomputed when this page was rendered, not copied from a database field.
3. Handwritten Letter
Handwriting100.0%Character LCS similarity (format-normalized) · 5.5s · measured 2026-08-17 · Synthetic handwriting — tests cursive recognition.
Input image
Ground truth
177 charsDear Professor, I wanted to follow up on our discussion about the research proposal. The deadline is March 15 and I have completed the first three sections. Best regards, Alex
What o1-2024-12-17 returned
177 charsDear Professor, I wanted to follow up on our discussion about the research proposal. The deadline is March 15 and I have completed the first three sections. Best regards, Alex
Re-scoring the transcript above with the character lcs similarity (format-normalized) gives 100.0% — the published score. Recomputed when this page was rendered, not copied from a database field.
4. Handwritten Notes
Handwriting100.0%Character LCS similarity (format-normalized) · 3.2s · measured 2026-08-17 · Synthetic handwriting — tests cursive recognition.
Input image
Ground truth
240 charsMeeting Notes - Feb 28 - Review Q4 budget by Friday - Call vendor re: contract renewal - Update project timeline - Send report to Sarah - Book conference room for Wed - Prepare slides for demo Action: Sarah to confirm deadline with client
What o1-2024-12-17 returned
240 charsMeeting Notes - Feb 28 - Review Q4 budget by Friday - Call vendor re: contract renewal - Update project timeline - Send report to Sarah - Book conference room for Wed - Prepare slides for demo Action: Sarah to confirm deadline with client
Re-scoring the transcript above with the character lcs similarity (format-normalized) gives 100.0% — the published score. Recomputed when this page was rendered, not copied from a database field.
5. Services Invoice
Invoice100.0%Character LCS similarity (format-normalized) · 10.8s · measured 2026-08-17 · Synthetic invoice — tests tabular billing layouts.
Input image
Ground truth
660 charsINVOICE #INV-2026-0472
From: Acme Solutions LLC
To: Widget Corp International
Date: February 28, 2026
Due Date: March 30, 2026
Description Qty Rate Amount
---------------------------------------------------
Web Development 40h $150.00 $6,000.00
UI/UX Design 20h $125.00 $2,500.00
Server Infrastructure 1 $500.00 $500.00
---------------------------------------------------
Subtotal: $9,000.00
Tax (10%): $900.00
TOTAL: $9,900.00
Payment Terms: Net 30
Bank: First National Bank Acct: 1234567890What o1-2024-12-17 returned
703 charsINVOICE #INV-2026-0472
From: Acme Solutions LLC
To: Widget Corp International
Date: February 28, 2026
Due Date: March 30, 2026
Description Qty Rate Amount
----------------------------------------------------
Web Development 40h $150.00 $6,000.00
UI/UX Design 20h $125.00 $2,500.00
Server Infrastructure 1 $500.00 $500.00
----------------------------------------------------
Subtotal: $9,000.00
Tax (10%): $900.00
TOTAL: $9,900.00
Payment Terms: Net 30
Bank: First National Bank Acct: 12345678906. Products Invoice
Invoice100.0%Character LCS similarity (format-normalized) · 10.2s · measured 2026-08-17 · Synthetic invoice — tests tabular billing layouts.
Input image
Ground truth
610 charsINVOICE
Invoice No: 10582
Date: 2026-02-15
Bill To:
Johnson & Partners LLP
789 Corporate Blvd
Austin, TX 78701
Item Qty Price Total
----------------------------------------------
Office Chairs (Mesh) 5 $289.00 $1,445.00
Standing Desks 3 $549.00 $1,647.00
Monitor Arms 8 $79.00 $632.00
Cable Management Kit 8 $24.99 $199.92
----------------------------------------------
Subtotal: $3,923.92
Shipping: $150.00
TOTAL: $4,073.92What o1-2024-12-17 returned
575 charsINVOICE Invoice No: 10582 Date: 2026-02-15 Bill To: Johnson & Partners LLP 789 Corporate Blvd Austin, TX 78701 Item Qty Price Total ------------------------------------------------ Office Chairs (Mesh) 5 $289.00 $1,445.00 Standing Desks 3 $549.00 $1,647.00 Monitor Arms 8 $79.00 $632.00 Cable Management Kit 8 $24.99 $199.92 ------------------------------------------------ Subtotal: $3,923.92 Shipping: $150.00 TOTAL: $4,073.92
7. Benchmark Table
Table100.0%Character LCS similarity (format-normalized) · 6.4s · measured 2026-08-17 · Synthetic table — tests column and row structure parsing.
Input image
Ground truth
399 charsEngine Performance Benchmark Results Engine Latency(ms) Accuracy Cost/Page ---------- ----------- -------- --------- Tesseract 178ms 92.1% $0.0005 EasyOCR 86ms 88.7% $0.0005 docTR 908ms 94.3% $0.0005 GPT-4o 1600ms 98.9% $0.0100 Claude Sonnet 1738ms 99.1% $0.0080 Gemini Flash 798ms 97.2% $0.0030
What o1-2024-12-17 returned
433 charsEngine Performance Benchmark Results Engine Latency(ms) Accuracy Cost/Page ---------- ------------ -------- --------- Tesseract 178ms 92.1% $0.0005 EasyOCR 86ms 88.7% $0.0005 docTR 908ms 94.3% $0.0005 GPT-4o 1600ms 98.9% $0.0100 Claude Sonnet 1738ms 99.1% $0.0080 Gemini Flash 798ms 97.2% $0.0030
8. Revenue Table
Table100.0%Character LCS similarity (format-normalized) · 12.3s · measured 2026-08-17 · Synthetic table — tests column and row structure parsing.
Input image
Ground truth
416 charsMonthly Revenue by Region (USD) Region Jan Feb Mar ----------- --------- -------- -------- North America $45,200 $48,100 $52,300 Europe $31,800 $33,200 $35,900 Asia Pacific $22,400 $24,700 $27,100 Latin America $8,900 $9,400 $10,200 Middle East $5,100 $5,800 $6,300 ----------- --------- -------- -------- Total $113,400 $121,200 $131,800
What o1-2024-12-17 returned
412 charsMonthly Revenue by Region (USD) Region Jan Feb Mar ---------- -------- -------- -------- North America $45,200 $48,100 $52,300 Europe $31,800 $33,200 $35,900 Asia Pacific $22,400 $24,700 $27,100 Latin America $8,900 $9,400 $10,200 Middle East $5,100 $5,800 $6,300 ---------- -------- -------- -------- Total $113,400 $121,200 $131,800
9. Dense Legal Paragraph
Dense Text100.0%Character LCS similarity (format-normalized) · 16.0s · measured 2026-08-17 · Synthetic dense paragraph — tests small-font continuous text recognition.
Input image
Ground truth
545 charsSection 4.2 - Data Processing Requirements All personally identifiable information (PII) must be encrypted at rest using AES-256 encryption and in transit using TLS 1.3 or higher. Data retention policies require that raw OCR output be purged within 24 hours of processing unless the customer has opted into extended storage (maximum 90 days). Metadata including timestamps, engine IDs, and processing latency may be retained for up to 365 days for analytics purposes. Any cross-border data transfer must comply with GDPR Article 46 requirements.
What o1-2024-12-17 returned
545 charsSection 4.2 - Data Processing Requirements All personally identifiable information (PII) must be encrypted at rest using AES-256 encryption and in transit using TLS 1.3 or higher. Data retention policies require that raw OCR output be purged within 24 hours of processing unless the customer has opted into extended storage (maximum 90 days). Metadata including timestamps, engine IDs, and processing latency may be retained for up to 365 days for analytics purposes. Any cross-border data transfer must comply with GDPR Article 46 requirements.
10. Dense Terms of Service
Dense Text100.0%Character LCS similarity (format-normalized) · 10.5s · measured 2026-08-17 · Synthetic dense paragraph — tests small-font continuous text recognition.
Input image
Ground truth
579 charsTerms of Service - API Usage By accessing the OpenOCR API you agree to the following: (1) You will not exceed your allocated rate limit of 60 requests per minute per API key. (2) You will not use the service to process documents containing protected health information (PHI) without a signed BAA. (3) All API keys are confidential and must not be shared or embedded in client-side code. (4) We reserve the right to throttle or suspend accounts that exhibit abusive patterns. (5) Pricing is subject to change with 30 days written notice. Contact support@openocr.com for questions.
What o1-2024-12-17 returned
589 charsTerms of Service - API Usage By accessing the OpenOCR API you agree to the following: (1) You will not exceed your allocated rate limit of 60 requests per minute per API key. (2) You will not use the service to process documents containing protected health information (PHI) without a signed BAA. (3) All API keys are confidential and must not be shared or embedded in client-side code. (4) We reserve the right to throttle or suspend accounts that exhibit abusive patterns. (5) Pricing is subject to change with 30 days written notice. Contact support@openocr.com for questions.
11. HabitaOne Website Screenshot
Web UI Screenshot0.0%Expected-line checklist · 42.9s · measured 2026-08-17 · Real website screenshot — tests multilingual UI chrome, small Spanish listing text, and mixed text with graphics.
Input image
Ground truth
384 charsHABITAONE $ 2,000,000 $ 120,000 $ 18,000 $ 47,000 $ 5 $ 250 $ 75,000 $ 330,000 Buy Rent Sell Price Property type Rooms Area State City Save list Show on Map My Properties FOR SALE Terreno en Venta en Puerto Cabello Apartamento en Venta en Los Mangos Terreno en Venta en Capacho Viejo Apartamento en Venta en Res Abadía Puerto Cabello Valencia Carabobo San Diego HabitaOne Linux Claude
What o1-2024-12-17 returned
This run's transcript was not retained.
This document's transcript was not retained, so its score cannot be recomputed here.
Blank page test
Not tested yet. This model was not part of the blank-page run, so no penalty is applied.