update-Problem von V2 auf V3 doppelte Dokumente

DocStephan · 31. Oktober 2026 um 13:04

Moin zusammen,

ich habe Paperless-ngx nach Stefans masterclass lange gut am Laufen gehabt. Nun habe ich nach Befolgen seiner Hinweise auf YouTube eine entsprechendes update auf die V3.3.4 vorgenommen. Eigentlich läuft auch alles. Nur gewisse Dokumente erscheinen immer wieder neu im scaninputordner. Weiß jemand RatFolgendes Protokoll wird angezeigt:

[2026-10-31 13:54:04,353] [WARNING] [paperless.consumer] [5158ccb0] Consuming duplicate Rechnung_RE995513.pdf: 179 existing document(s) share the same content.

[2026-10-31 13:54:04,355] [INFO] [paperless.tasks] [5158ccb0] ConsumerPreflightPlugin completed with no message

[2026-10-31 13:54:04,356] [DEBUG] [paperless.tasks] [5158ccb0] Executing plugin AsnCheckPlugin

[2026-10-31 13:54:04,356] [INFO] [paperless.tasks] [5158ccb0] AsnCheckPlugin completed with no message

[2026-10-31 13:54:04,357] [DEBUG] [paperless.tasks] [5158ccb0] Skipping plugin CollatePlugin

[2026-10-31 13:54:04,371] [DEBUG] [paperless.tasks] [5158ccb0] Skipping plugin BarcodePlugin

[2026-10-31 13:54:04,372] [DEBUG] [paperless.tasks] [5158ccb0] Executing plugin AsnCheckPlugin

[2026-10-31 13:54:04,373] [INFO] [paperless.tasks] [5158ccb0] AsnCheckPlugin completed with no message

[2026-10-31 13:54:04,373] [DEBUG] [paperless.tasks] [5158ccb0] Executing plugin WorkflowTriggerPlugin

[2026-10-31 13:54:04,399] [INFO] [paperless.tasks] [5158ccb0] WorkflowTriggerPlugin completed with:

[2026-10-31 13:54:04,399] [DEBUG] [paperless.tasks] [5158ccb0] Executing plugin ConsumeTaskPlugin

[2026-10-31 13:54:04,400] [INFO] [paperless.consumer] [5158ccb0] Consuming Rechnung_RE995513.pdf

[2026-10-31 13:54:04,405] [DEBUG] [paperless.consumer] [5158ccb0] Detected mime type: application/pdf

[2026-10-31 13:54:04,432] [DEBUG] [paperless.consumer] [5158ccb0] Parser: Paperless-ngx Tesseract OCR Parser v3.3.4

[2026-10-31 13:54:04,442] [DEBUG] [paperless.consumer] [5158ccb0] Parsing Rechnung_RE995513.pdf…

[2026-10-31 13:54:04,504] [INFO] [paperless.consumer] [5158ccb0] pdftotext exited 0

[2026-10-31 13:54:04,510] [DEBUG] [paperless.consumer] [5158ccb0] Archive: no - born-digital PDF (text_length=632), ARCHIVE_FILE_GENERATION=auto

[2026-10-31 13:54:04,558] [INFO] [paperless.parsing.tesseract] [5158ccb0] pdftotext exited 0

[2026-10-31 13:54:04,562] [DEBUG] [paperless.parsing.tesseract] [5158ccb0] Text detection: original_has_text=True (text_length=632, mode=auto, produce_archive=False)

[2026-10-31 13:54:04,564] [DEBUG] [paperless.parsing.tesseract] [5158ccb0] Document has text and no archive requested; skipping OCRmyPDF entirely.

[2026-10-31 13:54:04,564] [DEBUG] [paperless.consumer] [5158ccb0] Generating thumbnail for Rechnung_RE995513.pdf…

[2026-10-31 13:54:04,577] [DEBUG] [paperless.parsing] [5158ccb0] Execute: convert -density 300 -scale 500x5000> -alpha remove -strip -auto-orient -define pdf:use-cropbox=true /tmp/paperless/paperless-ngx0pprdpol/Rechnung_RE995513.pdf[0] /tmp/paperless/paperless-bpn3xmlm/convert.webp

[2026-10-31 13:54:07,346] [INFO] [paperless.parsing] [5158ccb0] convert exited 0

[2026-10-31 13:54:18,663] [DEBUG] [paperless.consumer] [5158ccb0] Saving record to database

[2026-10-31 13:54:18,664] [DEBUG] [paperless.consumer] [5158ccb0] Creation date from parse_date: 2026-10-30 00:00:00+01:00

[2026-10-31 13:54:18,677] [DEBUG] [paperless.templating] [5158ccb0] Parsing Workflow Jinja template: Verkauf

[2026-10-31 13:54:37,258] [DEBUG] [paperless.consumer] [5158ccb0] Deleting original file /tmp/paperless/paperless-mail-irltgl6c/Rechnung_RE995513.pdf

[2026-10-31 13:54:37,259] [DEBUG] [paperless.consumer] [5158ccb0] Deleting working copy /tmp/paperless/paperless-ngx0pprdpol/Rechnung_RE995513.pdf

[2026-10-31 13:54:37,281] [DEBUG] [paperless.parsing.tesseract] [5158ccb0] Cleaning up temporary directory /tmp/paperless/paperless-bpn3xmlm

[2026-10-31 13:54:37,285] [INFO] [paperless.consumer] [5158ccb0] Document 2026-10-30 info@governor-whv.eu Verkauf consumption finished

[2026-10-31 13:54:37,310] [INFO] [paperless.tasks] [5158ccb0] ConsumeTaskPlugin completed with: {‚document_id‘: 8870}

[2026-10-31 13:54:42,191] [DEBUG] [paperless.tasks] [8fafe8b9] Executing plugin ConsumerPreflightPlugin

[2026-10-31 13:54:42,271] [WARNING] [paperless.consumer] [8fafe8b9] Consuming duplicate Widerspruch (1).pdf: 240 existing document(s) share the same content.

[2026-10-31 13:54:42,274] [INFO] [paperless.tasks] [8fafe8b9] ConsumerPreflightPlugin completed with no message

[2026-10-31 13:54:42,275] [DEBUG] [paperless.tasks] [8fafe8b9] Executing plugin AsnCheckPlugin

[2026-10-31 13:54:42,276] [INFO] [paperless.tasks] [8fafe8b9] AsnCheckPlugin completed with no message

[2026-10-31 13:54:42,277] [DEBUG] [paperless.tasks] [8fafe8b9] Skipping plugin CollatePlugin

[2026-10-31 13:54:42,295] [DEBUG] [paperless.tasks] [8fafe8b9] Skipping plugin BarcodePlugin

[2026-10-31 13:54:42,296] [DEBUG] [paperless.tasks] [8fafe8b9] Executing plugin AsnCheckPlugin

[2026-10-31 13:54:42,297] [INFO] [paperless.tasks] [8fafe8b9] AsnCheckPlugin completed with no message

[2026-10-31 13:54:42,298] [DEBUG] [paperless.tasks] [8fafe8b9] Executing plugin WorkflowTriggerPlugin

[2026-10-31 13:54:42,337] [INFO] [paperless.tasks] [8fafe8b9] WorkflowTriggerPlugin completed with:

[2026-10-31 13:54:42,338] [DEBUG] [paperless.tasks] [8fafe8b9] Executing plugin ConsumeTaskPlugin

[2026-10-31 13:54:42,339] [INFO] [paperless.consumer] [8fafe8b9] Consuming Widerspruch (1).pdf

[2026-10-31 13:54:42,346] [DEBUG] [paperless.consumer] [8fafe8b9] Detected mime type: application/pdf

[2026-10-31 13:54:42,378] [DEBUG] [paperless.consumer] [8fafe8b9] Parser: Paperless-ngx Tesseract OCR Parser v3.3.4

[2026-10-31 13:54:42,392] [DEBUG] [paperless.consumer] [8fafe8b9] Parsing Widerspruch (1).pdf…

[2026-10-31 13:54:42,476] [INFO] [paperless.consumer] [8fafe8b9] pdftotext exited 0

[2026-10-31 13:54:42,490] [DEBUG] [paperless.consumer] [8fafe8b9] Archive: no - born-digital PDF (text_length=4353), ARCHIVE_FILE_GENERATION=auto

[2026-10-31 13:54:42,544] [INFO] [paperless.parsing.tesseract] [8fafe8b9] pdftotext exited 0

[2026-10-31 13:54:42,550] [DEBUG] [paperless.parsing.tesseract] [8fafe8b9] Text detection: original_has_text=True (text_length=4353, mode=auto, produce_archive=False)

[2026-10-31 13:54:42,551] [DEBUG] [paperless.parsing.tesseract] [8fafe8b9] Document has text and no archive requested; skipping OCRmyPDF entirely.

[2026-10-31 13:54:42,551] [DEBUG] [paperless.consumer] [8fafe8b9] Generating thumbnail for Widerspruch (1).pdf…

[2026-10-31 13:54:42,560] [DEBUG] [paperless.parsing] [8fafe8b9] Execute: convert -density 300 -scale 500x5000> -alpha remove -strip -auto-orient -define pdf:use-cropbox=true /tmp/paperless/paperless-ngxaef2npg7/Widerspruch (1).pdf[0] /tmp/paperless/paperless-kxk19gi2/convert.webp

[2026-10-31 13:54:46,651] [INFO] [paperless.parsing] [8fafe8b9] convert exited 0

[2026-10-31 13:54:58,619] [DEBUG] [paperless.consumer] [8fafe8b9] Saving record to database

[2026-10-31 13:54:58,620] [DEBUG] [paperless.consumer] [8fafe8b9] Creation date from parse_date: 2026-10-19 00:00:00+02:00

[2026-10-31 13:54:58,629] [DEBUG] [paperless.templating] [8fafe8b9] Parsing Workflow Jinja template:

[2026-10-31 13:54:59,388] [DEBUG] [paperless.consumer] [8fafe8b9] Deleting original file /tmp/paperless/paperless-mail-3uqie846/Widerspruch (1).pdf

[2026-10-31 13:54:59,389] [DEBUG] [paperless.consumer] [8fafe8b9] Deleting working copy /tmp/paperless/paperless-ngxaef2npg7/Widerspruch (1).pdf

[2026-10-31 13:54:59,394] [DEBUG] [paperless.parsing.tesseract] [8fafe8b9] Cleaning up temporary directory /tmp/paperless/paperless-kxk19gi2

[2026-10-31 13:54:59,396] [INFO] [paperless.consumer] [8fafe8b9] Document 2026-10-19 dres.steudtner@t-online.de consumption finished

[2026-10-31 13:54:59,418] [INFO] [paperless.tasks] [8fafe8b9] ConsumeTaskPlugin completed with: {‚document_id‘: 8871}

[2026-10-31 13:55:02,562] [DEBUG] [paperless.tasks] [c4e3e427] Executing plugin ConsumerPreflightPlugin

[2026-10-31 13:55:02,640] [WARNING] [paperless.consumer] [c4e3e427] Consuming duplicate 2026-09-08 KVN Einladung Bezirksversammlung.pdf: 9 existing document(s) share the same content.

[2026-10-31 13:55:02,680] [INFO] [paperless.tasks] [c4e3e427] ConsumerPreflightPlugin completed with no message

[2026-10-31 13:55:02,682] [DEBUG] [paperless.tasks] [c4e3e427] Executing plugin AsnCheckPlugin

[2026-10-31 13:55:02,693] [INFO] [paperless.tasks] [c4e3e427] AsnCheckPlugin completed with no message

[2026-10-31 13:55:02,694] [DEBUG] [paperless.tasks] [c4e3e427] Skipping plugin CollatePlugin

[2026-10-31 13:55:02,709] [DEBUG] [paperless.tasks] [c4e3e427] Skipping plugin BarcodePlugin

[2026-10-31 13:55:02,710] [DEBUG] [paperless.tasks] [c4e3e427] Executing plugin AsnCheckPlugin

[2026-10-31 13:55:02,710] [INFO] [paperless.tasks] [c4e3e427] AsnCheckPlugin completed with no message

[2026-10-31 13:55:02,711] [DEBUG] [paperless.tasks] [c4e3e427] Executing plugin WorkflowTriggerPlugin

[2026-10-31 13:55:02,738] [INFO] [paperless.tasks] [c4e3e427] WorkflowTriggerPlugin completed with:

[2026-10-31 13:55:02,739] [DEBUG] [paperless.tasks] [c4e3e427] Executing plugin ConsumeTaskPlugin

[2026-10-31 13:55:02,740] [INFO] [paperless.consumer] [c4e3e427] Consuming 2026-09-08 KVN Einladung Bezirksversammlung.pdf

[2026-10-31 13:55:02,745] [DEBUG] [paperless.consumer] [c4e3e427] Detected mime type: application/pdf

[2026-10-31 13:55:02,774] [DEBUG] [paperless.consumer] [c4e3e427] Parser: Paperless-ngx Tesseract OCR Parser v3.3.4

[2026-10-31 13:55:02,787] [DEBUG] [paperless.consumer] [c4e3e427] Parsing 2026-09-08 KVN Einladung Bezirksversammlung.pdf…

[2026-10-31 13:55:02,848] [INFO] [paperless.consumer] [c4e3e427] pdftotext exited 0

[2026-10-31 13:55:02,855] [DEBUG] [paperless.consumer] [c4e3e427] Archive: no - born-digital PDF (text_length=1602), ARCHIVE_FILE_GENERATION=auto

[2026-10-31 13:55:02,902] [INFO] [paperless.parsing.tesseract] [c4e3e427] pdftotext exited 0

[2026-10-31 13:55:02,908] [DEBUG] [paperless.parsing.tesseract] [c4e3e427] Text detection: original_has_text=True (text_length=1602, mode=auto, produce_archive=False)

[2026-10-31 13:55:02,909] [DEBUG] [paperless.parsing.tesseract] [c4e3e427] Document has text and no archive requested; skipping OCRmyPDF entirely.

[2026-10-31 13:55:02,910] [DEBUG] [paperless.consumer] [c4e3e427] Generating thumbnail for 2026-09-08 KVN Einladung Bezirksversammlung.pdf…

[2026-10-31 13:55:02,919] [DEBUG] [paperless.parsing] [c4e3e427] Execute: convert -density 300 -scale 500x5000> -alpha remove -strip -auto-orient -define pdf:use-cropbox=true /tmp/paperless/paperless-ngxymvm2cln/2026-09-08 KVN Einladung Bezirksversammlung.pdf[0] /tmp/paperless/paperless-w5as9ni0/convert.webp

[2026-10-31 13:55:06,417] [INFO] [paperless.parsing] [c4e3e427] convert exited 0

[2026-10-31 13:55:18,166] [DEBUG] [paperless.consumer] [c4e3e427] Saving record to database

[2026-10-31 13:55:18,167] [DEBUG] [paperless.consumer] [c4e3e427] Creation date from parse_date: 2026-09-08 00:00:00+02:00

[2026-10-31 13:55:18,174] [DEBUG] [paperless.templating] [c4e3e427] Parsing Workflow Jinja template: [Scan] 2026-09-08 KVN Einladung Bezirksversammlung

[2026-10-31 13:55:18,470] [DEBUG] [paperless.matching] [c4e3e427] Tag KVN matched on document 2026-09-08 dres.steudtner@t-online.de [Scan] 2026-09-08 KVN Einladung Bezirksversammlung because it contains this word: Vereinigung

[2026-10-31 13:55:18,473] [INFO] [paperless.handlers] [c4e3e427] Tagging „2026-09-08 dres.steudtner@t-online.de [Scan] 2026-09-08 KVN Einladung Bezirksversammlung“ with „KVN“

[2026-10-31 13:55:18,886] [DEBUG] [paperless.consumer] [c4e3e427] Deleting original file /tmp/paperless/paperless-mail-9a5okq__/2026-09-08 KVN Einladung Bezirksversammlung.pdf

[2026-10-31 13:55:18,887] [DEBUG] [paperless.consumer] [c4e3e427] Deleting working copy /tmp/paperless/paperless-ngxymvm2cln/2026-09-08 KVN Einladung Bezirksversammlung.pdf

[2026-10-31 13:55:18,963] [DEBUG] [paperless.parsing.tesseract] [c4e3e427] Cleaning up temporary directory /tmp/paperless/paperless-w5as9ni0

[2026-10-31 13:55:19,032] [INFO] [paperless.consumer] [c4e3e427] Document 2026-09-08 dres.steudtner@t-online.de [Scan] 2026-09-08 KVN Einladung Bezirksversammlung consumption finished

[2026-10-31 13:55:19,053] [INFO] [paperless.tasks] [c4e3e427] ConsumeTaskPlugin completed with: {‚document_id‘: 8872}

[2026-10-31 14:01:03,414] [INFO] [_granian.asgi.io] ASGI transport error: „Closed(..)“

[2026-10-31 14:01:03,443] [INFO] [_granian.asgi.io] ASGI transport error: „Closed(..)“

[2026-10-31 14:01:03,444] [INFO] [_granian.asgi.io] ASGI transport error: „Closed(..)“

[2026-10-31 14:01:03,451] [INFO] [_granian.asgi.io] ASGI transport error: „Closed(..)“

[2026-10-31 14:01:03,452] [INFO] [_granian.asgi.io] ASGI transport error: „Closed(..)“

[2026-10-31 14:01:03,453] [INFO] [_granian.asgi.io] ASGI transport error: „Closed(..)“

RKuehne · 31. Oktober 2026 um 13:52

1. Die Dokumente kommen per E-Mail-Fetch (erkennbar an paperless-mail-irltgl6c als Temp-Pfad) – nicht aus dem Scan-Ordner.

2. Paperless erkennt zwar Duplikate, konsumiert sie aber trotzdem:

WARNING: Consuming duplicate Rechnung_RE995513.pdf: 
         179 existing document(s) share the same content.
...
INFO: Document ... consumption finished  ← wird trotzdem verarbeitet!

Ursache

In V3 wurde das Mail-Handling überarbeitet. Das Problem ist fast sicher die Aktion nach dem E-Mail-Abruf im Mail-Account: Wenn diese auf „Nichts tun“ steht, holt Paperless bei jedem Mail-Check dieselben E-Mails erneut und konsumiert sie wieder.

zum einen kannst du in die docker-compose.env diesen eintrag mit aufnehmen

PAPERLESS_CONSUMER_DELETE_DUPLICATES= true

Seit der Version 3 werden automatisch duplikate erlaubt das war vorher nicht so. mit diesem befehl werden duplikate verboten
Was hast du bei den E-mail Regeln unter Action zu stehen ?

Sofortmaßnahme gegen die bereits doppelt importierten Dokumente

Nach dem Fix die Duplikate in Paperless bereinigen:
Unter Dokumente nach dem Titel filtern und die ungewollten Duplikate löschen. Bei 179 Duplikaten eines einzigen Dokuments wird das leider manuell etwas Arbeit.

DocStephan · 31. Oktober 2026 um 21:32

Im email fetcher steht unter Action : in angegebenen Ordner verschieben.

CoolTux · 1. November 2026 um 06:14

Und wird dieser Ordner zufällig auch gescannt?

DocStephan · 1. November 2026 um 08:41

Was meintst du mit gescannt? Wie kann ich das erkennen? Der im email fetcher angegebene Ordner ist „ INBOx“. In der synology besitze ich einen scaninput Ordner. Ich scanne mit meinem fuitsuscanner nur sehr selten noch. Die meisten Dokumente werden per email fetcher abgegriffen oder mit dem Handy gescannt und per Weiterleitung per email oder via webdav an die Synology Nas geleitet.

DocStephan · 1. November 2026 um 08:45

Nachtrag noch. Ich habe in der env Datei nu angegeben, er solle alle Doppelten Dateien nicht verarbeiten. Das war insofern auch erfolgreich , da ich nun die roten Meldungen „Dokument existiert bereits“ erhalte.