Indexer thread panics on malformed PDF instead of skipping it #15

Open
opened 2026-10-15 12:17:43 +08:00 by Breadway · 0 comments
Owner

Found during RAM-30 isolated breadmill testing. Confidence: high that the panic occurred (observed in stderr); medium on downstream impact. A manually started isolated breadmill (empty temp state/cache/config, default index roots) logged model-not-ready lines then died in an indexer thread: pdf-extract 0.10.0 src/lib.rs:1578 called Result::unwrap on Err(Parse(InvalidContentStream)) while handling a real user PDF. The panic message names thread unnamed and the process continued serving (socket stayed bound), so at minimum one indexing worker is lost and the file is never skipped cleanly. Expected: catch per-file extraction errors, log and skip the file, keep the worker alive. Reproduce: run breadmill with default roots over a tree containing a malformed PDF and watch stderr. The RAM-30 bench avoids this entirely with explicit empty index roots.

Found during RAM-30 isolated breadmill testing. Confidence: high that the panic occurred (observed in stderr); medium on downstream impact. A manually started isolated breadmill (empty temp state/cache/config, default index roots) logged model-not-ready lines then died in an indexer thread: pdf-extract 0.10.0 src/lib.rs:1578 called Result::unwrap on Err(Parse(InvalidContentStream)) while handling a real user PDF. The panic message names thread unnamed and the process continued serving (socket stayed bound), so at minimum one indexing worker is lost and the file is never skipped cleanly. Expected: catch per-file extraction errors, log and skip the file, keep the worker alive. Reproduce: run breadmill with default roots over a tree containing a malformed PDF and watch stderr. The RAM-30 bench avoids this entirely with explicit empty index roots.
Sign in to join this conversation.
No labels
No milestone
No project
No assignees
1 participant
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set.

Reference
Breadway/breadsearch#15
No description provided.