Document Classification Leaderboard
Open-vocab document classification leaderboard (macro-F1)
The deterministic document platform for agents. Open document models, benchmarks, and leaderboards. Formerly PSPDFKit.
Nutrient (formerly PSPDFKit) is the deterministic document platform for agents. It combines reliable document processing infrastructure for agents, routing and governance, and interfaces for the human in the loop, so that agentic document workflows produce output the person signing off on the business outcome can rely on.
This organization is where we publish the small, document-specialized models behind that platform, together with the open benchmarks and self-service leaderboards we score them on. Same task, same data, same scorer, for our models and everyone else's.
At a glance
Most agents can pull data out of a document. Far fewer can prove where it came from, split a scanned batch back into its documents, tell an invoice from a remittance, or find the fields on a form at a quality level that stands up in an audit. Frontier LLMs are strong generalists and weak on exactly these document-shaped tasks: numbers inside tables, long page streams, dropout-ink forms, handwriting next to print.
We publish narrow models for those tasks and the benchmarks that show where each one wins and where it loses. The point is not to replace your model. It is to give an agentic workflow the deterministic pieces it needs to route, verify, and escalate to a human, and to let you check our numbers yourself.
| Task | Open weights | Commercial | Benchmark | Leaderboard | Demo |
|---|---|---|---|---|---|
| Grounding: does the source document actually support this claim (a number, date, or fact)? | grounding-en (Apache-2.0) | grounding-multilingual (15+ languages) | grounding-benchmark (CC-BY-SA-4.0) | grounding-leaderboard | grounding-demo |
| Document splitting (page-stream segmentation): where does one document end and the next begin? | doc-split-v1 (Apache-2.0, ONNX) | doc-split-v2 | doc-split-benchmark (CC-BY-SA-4.0) | doc-split-leaderboard | doc-split-demo |
| Document classification (open-vocabulary, zero-shot): classify a page against labels you choose at runtime | document-classification-v1 (Apache-2.0, ONNX) | document-classification-v2 | document-classification-benchmark | document-classification-leaderboard | document-classification-demo |
| Document and figure image classification (open-vocabulary): documents, charts, signatures, screenshots | doc-img-classification | doc-openvocab-benchmark (CC-BY-SA-4.0) | doc-openvocab-leaderboard | doc-openvocab-demo | |
| Form field detection: bounding box, type, label, and radio-group identity for every field on a page image | form-field-vlm | form-field-vlm-benchmark (CC-BY-4.0) | form-field-vlm-leaderboard | form-field-vlm-demo | |
| PII detection and redaction: context-aware redaction on full documents | DocPII-redaction-benchmark (MIT) | LLM-PII-Detection-Leaderboard |
Every leaderboard is scored by the same open scorer we use ourselves. Current numbers, including the cases where a cloud model beats us, live on the leaderboards, not in this README. To add a model, run the scorer and open a pull request on the leaderboard space.
fuzzy_match and not_found can be routed to human review while grounded values continue downstream. Confidence is a relative signal, not a calibrated probability, and we say so.Datasets carry their own licenses (CC-BY-SA-4.0, CC-BY-4.0, or MIT, stated on each card). Open-weight models are Apache-2.0. If you use a benchmark or leaderboard result, link the leaderboard space so readers can see the scoring code and the full field at the time you cite it.
Open-vocab document classification leaderboard (macro-F1)
Classify any document image against labels you choose
Explore model performance for page stream segmentation
Split a merged PDF into its constituent documents
End-to-end form-field extraction benchmark