Skip to content

Operator: enable & verify opt-in deletion propagation (#247) #407

Description

@CheeryProgrammer

By default deleted source content is kept (retention default #107). #247 added opt-in propagation: a file removed from your docs dir is removed from memory on the next auto-import sweep. Verify it on your box.

Enable

# add to .env:
#   INGEST_PRUNE_DELETED=true
docker compose up -d

(Only takes effect with a single docs dir — the minimal /data/docs setup. Multi-dir is tracked in #391.)

Verify

# 1. Drop a throwaway markdown file into ./data/docs and wait one INGEST_INTERVAL
echo '# Temp note

This is a disposable test document about the OrderService.' > ./data/docs/_delete_me.md
# 2. Confirm it's searchable (via WebUI/search/recall)
# 3. Delete it and wait one interval
rm ./data/docs/_delete_me.md
# 4. Confirm it's gone from memory; check the app log for the propagation line:
docker compose logs app | grep -i "document(s) removed"

Checklist

  • INGEST_PRUNE_DELETED=true set, stack restarted
  • Added file becomes searchable
  • After deleting the file, it disappears from memory on the next sweep
  • Log shows the "N document(s) removed (source-side deletion propagated)" line
  • Fail-safe understood: if a sweep has a read error, pruning is skipped that round (a transient glitch never looks like a deletion)

Related: #247. Streaming (Watch()-driven) single-doc deletion capability also exists (#323) but isn't wired into the running server yet — that's #395.

🤖 Generated with Claude Code

Metadata

Metadata

Labels

area:ingestionIngestion & connectorstype:opsOperations, security, backup, monitoring

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions