pd3f is an Open-source PDF text extraction pipeline that is self-hosted, local-first and Docker-based.
pd3f reconstructs the original continuous text with the help of machine learning.
pd3f is still in an experimental stage, so please use it with caution.
Some reasons why pd3f is for you
Scans are automatically OCRd
Run it on your computer or on a server
Docker makes installation easy
A longer introduction to pd3f in German on the site of the Prototype Fund.
pd3f can OCR scanned PDFs with OCRmyPDF (Tesseract) and extracts tables with Camelot and Tabula. It’s built upon the output of Parsr. Parsr detects hierarchies of text and splits the text into words, lines and paragraphs.
Even though Parsr brings some structure to the PDF, the text is still scrambled, i.e., due to hyphens. The underlying Python package pd3f-core tries to reconstruct the original continuous text by removing hyphens, new lines and/or spaces. It uses language models to guess how the original text looked like.
pd3f is especially useful for languages with long words such as German. It was mainly developed to parse German letters and official documents. Besides German pd3f supports English, Spanish and French. More languages will be added later.
A more systematic evaluation of pd3f will follow in September 2020.
Johannes Filter is an independent researcher, software developer and data analyst. His work is focused on human-computer interaction, machine learning and natural-language processing. Website, Twitter