Loading...
Back to rankings
Google: Gemini 3.1 Flash Image Preview (Gemini 3.1 Flash Image Preview)
Everything behind this model's benchmark score: the exact image sent, the exact ground truth it was graded against, and the exact text it returned — for all 11 documents. Each score is recomputed from that text when this page is served.
Quality
42.8%
Hard-document score 52.8% − 10.0 blank-page penalty = 42.8%
Not part of Quality: the 11 documents below average 94.6%.
Documents
11
Avg latency
1.8s
Scores reproducible
11/11
Measured on corpus ocr-shared-11-normalized/v2 with scorer ocr-shared-11-scorer/v2 · published 2026-10-05. Provider offering used: openrouter-google-gemini-3.1-flash-image-preview (openrouter).
corpus manifest sha256: b8f240c12ac5778625786d08e2e7fc2267721f2f458c5f425b8c635170590c94
The corpus is public: browse every test document.
1. Grocery Receipt
Receipt59.6%Character LCS similarity (format-normalized) · 2.3s · measured 2026-08-17 · Synthetic receipt — tests retail-style dense numeric rows.
Input image
Ground truth
428 charsCORNER STORE 123 Main Street Date: 2026-02-28 14:32 -------------------------------- Milk 2% 1x $3.49 Bread Wheat 1x $2.99 Eggs Large 12ct 1x $4.29 Coffee Dark Roast 1x $8.99 Bananas 1.2lb 1x $0.89 -------------------------------- Subtotal: $20.65 Tax (8.25%): $1.70 TOTAL: $22.35 -------------------------------- VISA ****4821 Thank you for shopping!
What Google: Gemini 3.1 Flash Image Preview (Gemini 3.1 Flash Image Preview) returned
687 charsCORNER STORE 123 Main Street Date: 2026-02-28 14:32 - - - - - - - - - - - - - - - - - - - - - - - - Milk 2% 1x $3.49 Bread Wheat 1x $2.99 Eggs Large 12ct 1x $4.29 Coffee Dark Roast 1x $8.99 Bananas 1.2lb 1x $0.89 - - - - - - - - - - - - - - - - - - - - - - - - Subtotal: $20.65 Tax (8.25%): $1.70 TOTAL: $22.35 - - - - - - - - - - - - -CORNER STORE 123 Main Street Date: 2026-02-28 14:32 -------------------------------- Milk 2% 1x $3.49 Bread Wheat 1x $2.99 Eggs Large 12ct 1x $4.29 Coffee Dark Roast 1x $8.99 Bananas 1.2lb 1x $0.89 -------------------------------- Subtotal: $20.65 Tax (8.25%): $1.70 TOTAL: $22.35 -------------------------------- VISA ****4821 Thank you for shopping!
Re-scoring the transcript above with the character lcs similarity (format-normalized) gives 59.6% — the published score. Recomputed when this page was rendered, not copied from a database field.
2. Café Receipt
Receipt99.3%Character LCS similarity (format-normalized) · 1.4s · measured 2026-08-17 · Synthetic receipt — tests retail-style dense numeric rows.
Input image
Ground truth
365 charsCAFE BISTRO 456 Oak Avenue, Suite 2 02/28/2026 10:15 AM ================================ Cappuccino 1 $4.50 Croissant 2 $7.00 Orange Juice 1 $3.25 Avocado Toast 1 $9.50 ================================ Subtotal $24.25 Tip (18%): $4.37 TOTAL: $28.62 Paid: Apple Pay Have a great day!
What Google: Gemini 3.1 Flash Image Preview (Gemini 3.1 Flash Image Preview) returned
323 charsCAFE BISTRO 456 Oak Avenue, Suite 2 02/28/2026 10:15 AM ============================== Cappuccino 1 $4.50 Croissant 2 $7.00 Orange Juice 1 $3.25 Avocado Toast 1 $9.50 ============================== Subtotal $24.25 Tip (18%): $4.37 TOTAL: $28.62 Paid: Apple Pay Have a great day!
Re-scoring the transcript above with the character lcs similarity (format-normalized) gives — the published score. Recomputed when this page was rendered, not copied from a database field.
3. Handwritten Letter
Handwriting100.0%Character LCS similarity (format-normalized) · 1.3s · measured 2026-08-17 · Synthetic handwriting — tests cursive recognition.
Input image
Ground truth
177 charsDear Professor, I wanted to follow up on our discussion about the research proposal. The deadline is March 15 and I have completed the first three sections. Best regards, Alex
What Google: Gemini 3.1 Flash Image Preview (Gemini 3.1 Flash Image Preview) returned
177 charsDear Professor, I wanted to follow up on our discussion about the research proposal. The deadline is March 15 and I have completed the first three sections. Best regards, Alex
Re-scoring the transcript above with the character lcs similarity (format-normalized) gives 100.0% — the published score. Recomputed when this page was rendered, not copied from a database field.
4. Handwritten Notes
Handwriting100.0%Character LCS similarity (format-normalized) · 1.3s · measured 2026-08-17 · Synthetic handwriting — tests cursive recognition.
Input image
Ground truth
240 charsMeeting Notes - Feb 28 - Review Q4 budget by Friday - Call vendor re: contract renewal - Update project timeline - Send report to Sarah - Book conference room for Wed - Prepare slides for demo Action: Sarah to confirm deadline with client
What Google: Gemini 3.1 Flash Image Preview (Gemini 3.1 Flash Image Preview) returned
241 charsMeeting Notes - Feb 28 - Review Q4 budget by Friday - Call vendor re: contract renewal - Update project timeline - Send report to Sarah - Book conference room for Wed - Prepare slides for demo Action: Sarah to confirm deadline with client
Re-scoring the transcript above with the character lcs similarity (format-normalized) gives 100.0% — the published score. Recomputed when this page was rendered, not copied from a database field.
5. Services Invoice
Invoice100.0%Character LCS similarity (format-normalized) · 1.8s · measured 2026-08-17 · Synthetic invoice — tests tabular billing layouts.
Input image
Ground truth
660 charsINVOICE #INV-2026-0472
From: Acme Solutions LLC
To: Widget Corp International
Date: February 28, 2026
Due Date: March 30, 2026
Description Qty Rate Amount
---------------------------------------------------
Web Development 40h $150.00 $6,000.00
UI/UX Design 20h $125.00 $2,500.00
Server Infrastructure 1 $500.00 $500.00
---------------------------------------------------
Subtotal: $9,000.00
Tax (10%): $900.00
TOTAL: $9,900.00
Payment Terms: Net 30
Bank: First National Bank Acct: 1234567890What Google: Gemini 3.1 Flash Image Preview (Gemini 3.1 Flash Image Preview) returned
652 charsINVOICE #INV-2026-0472
From: Acme Solutions LLC
To: Widget Corp International
Date: February 28, 2026
Due Date: March 30, 2026
Description Qty Rate Amount
-------------------------------------------------
Web Development 40h $150.00 $6,000.00
UI/UX Design 20h $125.00 $2,500.00
Server Infrastructure 1 $500.00 $500.00
-------------------------------------------------
Subtotal: $9,000.00
Tax (10%): $900.00
TOTAL: $9,900.00
Payment Terms: Net 30
Bank: First National Bank Acct: 12345678906. Products Invoice
Invoice100.0%Character LCS similarity (format-normalized) · 1.8s · measured 2026-08-17 · Synthetic invoice — tests tabular billing layouts.
Input image
Ground truth
610 charsINVOICE
Invoice No: 10582
Date: 2026-02-15
Bill To:
Johnson & Partners LLP
789 Corporate Blvd
Austin, TX 78701
Item Qty Price Total
----------------------------------------------
Office Chairs (Mesh) 5 $289.00 $1,445.00
Standing Desks 3 $549.00 $1,647.00
Monitor Arms 8 $79.00 $632.00
Cable Management Kit 8 $24.99 $199.92
----------------------------------------------
Subtotal: $3,923.92
Shipping: $150.00
TOTAL: $4,073.92What Google: Gemini 3.1 Flash Image Preview (Gemini 3.1 Flash Image Preview) returned
666 charsINVOICE
Invoice No: 10582
Date: 2026-02-15
Bill To:
Johnson & Partners LLP
789 Corporate Blvd
Austin, TX 78701
Item Qty Price Total
-----------------------------------------------------------
Office Chairs (Mesh) 5 $289.00 $1,445.00
Standing Desks 3 $549.00 $1,647.00
Monitor Arms 8 $79.00 $632.00
Cable Management Kit 8 $24.99 $199.92
-----------------------------------------------------------
Subtotal: $3,923.92
Shipping: $150.00
TOTAL: $4,073.927. Benchmark Table
Table100.0%Character LCS similarity (format-normalized) · 1.6s · measured 2026-08-17 · Synthetic table — tests column and row structure parsing.
Input image
Ground truth
399 charsEngine Performance Benchmark Results Engine Latency(ms) Accuracy Cost/Page ---------- ----------- -------- --------- Tesseract 178ms 92.1% $0.0005 EasyOCR 86ms 88.7% $0.0005 docTR 908ms 94.3% $0.0005 GPT-4o 1600ms 98.9% $0.0100 Claude Sonnet 1738ms 99.1% $0.0080 Gemini Flash 798ms 97.2% $0.0030
What Google: Gemini 3.1 Flash Image Preview (Gemini 3.1 Flash Image Preview) returned
298 charsEngine Performance Benchmark Results Engine Latency(ms) Accuracy Cost/Page --------- ------------ ---------- --------- Tesseract 178ms 92.1% $0.0005 EasyOCR 86ms 88.7% $0.0005 docTR 908ms 94.3% $0.0005 GPT-4o 1600ms 98.9% $0.0100 Claude Sonnet 1738ms 99.1% $0.0080 Gemini Flash 798ms 97.2% $0.0030
Re-scoring the transcript above with the character lcs similarity (format-normalized) gives — the published score. Recomputed when this page was rendered, not copied from a database field.
8. Revenue Table
Table100.0%Character LCS similarity (format-normalized) · 1.7s · measured 2026-08-17 · Synthetic table — tests column and row structure parsing.
Input image
Ground truth
416 charsMonthly Revenue by Region (USD) Region Jan Feb Mar ----------- --------- -------- -------- North America $45,200 $48,100 $52,300 Europe $31,800 $33,200 $35,900 Asia Pacific $22,400 $24,700 $27,100 Latin America $8,900 $9,400 $10,200 Middle East $5,100 $5,800 $6,300 ----------- --------- -------- -------- Total $113,400 $121,200 $131,800
What Google: Gemini 3.1 Flash Image Preview (Gemini 3.1 Flash Image Preview) returned
491 charsMonthly Revenue by Region (USD) Region Jan Feb Mar ---------------- ----------- ----------- ----------- North America $45,200 $48,100 $52,300 Europe $31,800 $33,200 $35,900 Asia Pacific $22,400 $24,700 $27,100 Latin America $8,900 $9,400 $10,200 Middle East $5,100 $5,800 $6,300 ---------------- ----------- ----------- ----------- Total $113,400 $121,200 $131,800
9. Dense Legal Paragraph
Dense Text100.0%Character LCS similarity (format-normalized) · 1.4s · measured 2026-08-17 · Synthetic dense paragraph — tests small-font continuous text recognition.
Input image
Ground truth
545 charsSection 4.2 - Data Processing Requirements All personally identifiable information (PII) must be encrypted at rest using AES-256 encryption and in transit using TLS 1.3 or higher. Data retention policies require that raw OCR output be purged within 24 hours of processing unless the customer has opted into extended storage (maximum 90 days). Metadata including timestamps, engine IDs, and processing latency may be retained for up to 365 days for analytics purposes. Any cross-border data transfer must comply with GDPR Article 46 requirements.
What Google: Gemini 3.1 Flash Image Preview (Gemini 3.1 Flash Image Preview) returned
545 charsSection 4.2 - Data Processing Requirements All personally identifiable information (PII) must be encrypted at rest using AES-256 encryption and in transit using TLS 1.3 or higher. Data retention policies require that raw OCR output be purged within 24 hours of processing unless the customer has opted into extended storage (maximum 90 days). Metadata including timestamps, engine IDs, and processing latency may be retained for up to 365 days for analytics purposes. Any cross-border data transfer must comply with GDPR Article 46 requirements.
10. Dense Terms of Service
Dense Text100.0%Character LCS similarity (format-normalized) · 1.4s · measured 2026-08-17 · Synthetic dense paragraph — tests small-font continuous text recognition.
Input image
Ground truth
579 charsTerms of Service - API Usage By accessing the OpenOCR API you agree to the following: (1) You will not exceed your allocated rate limit of 60 requests per minute per API key. (2) You will not use the service to process documents containing protected health information (PHI) without a signed BAA. (3) All API keys are confidential and must not be shared or embedded in client-side code. (4) We reserve the right to throttle or suspend accounts that exhibit abusive patterns. (5) Pricing is subject to change with 30 days written notice. Contact support@openocr.com for questions.
What Google: Gemini 3.1 Flash Image Preview (Gemini 3.1 Flash Image Preview) returned
579 charsTerms of Service - API Usage By accessing the OpenOCR API you agree to the following: (1) You will not exceed your allocated rate limit of 60 requests per minute per API key. (2) You will not use the service to process documents containing protected health information (PHI) without a signed BAA. (3) All API keys are confidential and must not be shared or embedded in client-side code. (4) We reserve the right to throttle or suspend accounts that exhibit abusive patterns. (5) Pricing is subject to change with 30 days written notice. Contact support@openocr.com for questions.
11. HabitaOne Website Screenshot
Web UI Screenshot81.8%Expected-line checklist · 3.8s · measured 2026-08-17 · Real website screenshot — tests multilingual UI chrome, small Spanish listing text, and mixed text with graphics.
Input image
Ground truth
384 charsHABITAONE $ 2,000,000 $ 120,000 $ 18,000 $ 47,000 $ 5 $ 250 $ 75,000 $ 330,000 Buy Rent Sell Price Property type Rooms Area State City Save list Show on Map My Properties FOR SALE Terreno en Venta en Puerto Cabello Apartamento en Venta en Los Mangos Terreno en Venta en Capacho Viejo Apartamento en Venta en Res Abadía Puerto Cabello Valencia Carabobo San Diego HabitaOne Linux Claude
What Google: Gemini 3.1 Flash Image Preview (Gemini 3.1 Flash Image Preview) returned
904 charsCron Syntax - Crontab Ge... X Issues. React Bootstrap/r... X Claude X Houses & Apartaments Fo... x Linux - Wikipedia X Houses & Apartments Fo... X Houses & Apartments Fo... HabitaOne Place X + ... habitaone.com/en/comprar W VPN [?] HABITAONE Buy Rent Sell EN My Properties Search city or state... ব Buy Rent Price Property type Rooms Area State List & map : Show list 00 FOR SALE FOR SALE FOR SALE FOR SALE ... Aventurous Venezuela Fuente: Bienes Online Fuente: Bienes Online [Fuente: BienesOnline Fuente: BienesOnline $ 120,000 $ 2,000,000 $ 18,000 $ 47,000 Terreno en Venta en Puerto Cabello Puerto Cabello Apartamento en Venta en Los Mangos Valencia Carabobo Valencia Terreno en Venta en Capacho Viejo Apartamento en Venta en Res Abadía San Diego © Valencia, Carabobo © Puerto Cabello, Carabobo Capacho Viejo, Táchira San Diego, Carabobo 14360 m² A 35 [] 292 m² 3 e 2 (7 400 m A 0 e 0 (7 3 e 2 L 85 m²
Blank page test
- Blank page score
- 33/100
- Penalty applied
- −10.0 points
Try 1
Returned text:
“* NOISE AND THE VINYL REPLAY CHAIN * By George Carter * (A) THE PHONO-CARTRIDGE (GENERATOR) * Signal from Moving Magnet/Induced Magnet types can typically range from say 2mv at 5cms/sec. through to say 8mv * for some of the earlier high-output types. The resistance of the cartridge can range from say 200 to 2000 ohms. Moving Coil * types range from say 0.1mv to 0.6mv or even higher for "High Outp”Try 2
Reported no readable text:
“[illegible]”Try 3
Returned text:
“*** # = [ ; ! ? { } ] + ~ ( ) | _ / \ ^ < > , . : ' " `”