Terry You Need to Understand RAG, its Datastore Management and My Deployment

[Chip (OP)]

📎 Click on me to view all my attachmentsTheme: Deep IndigoMidnight DarkPink & PurpleSlate GraySolarized LightEmerald GreenCyberpunk NeonNordDraculaSunset OrangeWarm AmberOcean BreezeClassic LightCrimson DuskMatrix TerminalCoffee & CreamAutumn FrostRetro TerminalLavender MistNordic FrostMonochrome SlateTeal BreezeNo theme (plain)

ListAttBBC  |  v7.3.0  |  2026-10-26  |  Andrew.human & Claude.ai  |  live 17:45:12

#	File	Size	Downloads	Info	DL
00	instagram-1793160534252.mp4	4 MB	15	ℹ️	⬇️
Attachment ID 8019 Filename (display) instagram-1793160534252.mp4 File extension mp4 MIME type video/mp4 Size 4 MB (4159666 bytes) Downloads 15 Dimensions n/a Uploaded by Guest Message ID 49900 Attachment type Normal attachment (0) Storage folder ID 2 Thumbnail attach ID none File hash 3dfa2d640c8bf9b93adf4ffda7aee5d036842c27 Approved Yes Filename (on disk) 8019_3dfa2d640c8bf9b93adf4ffda7aee5d036842c27 Storage directory 2 (/var/www/html/attachments2) File exists on disk? Yes (core) — Media metadata (none) — Media metadata Unavailable - Neither getID3 nor ffprobe is available on this install
Chip — Today at 12:59:59 PM
01	RAG_for_Terry.md	6.4 KB	1	ℹ️	⬇️
Attachment ID 8020 Filename (display) RAG_for_Terry.md File extension md MIME type Size 6.4 KB (6603 bytes) Downloads 1 Dimensions n/a Uploaded by Guest Message ID 49900 Attachment type Normal attachment (0) Storage folder ID 2 Thumbnail attach ID none File hash c0b2cf7431a4575f2aedbb81206a34827ce358e7 Approved Yes Filename (on disk) 8020_c0b2cf7431a4575f2aedbb81206a34827ce358e7 Storage directory 2 (/var/www/html/attachments2) File exists on disk? Yes (core)
No recorded downloads yet.

⚠️ Unknown theme in [lmv=inline-theme-dracula]. Valid: indigo, none, pink, slate, emerald, amber, crimson, solarized-light, coffee, sepia, sunset-glow, lavender-mist, mint-cream, peach-puff, sky-blue, rose-quartz, lemon-chiffon, spring-bud, aqua-marine, coral-reef, lilac-dream, pearl-white.

📝 Inline Markdownv4.6.2 · 2026-10-28Theme: Deep IndigoNo Theme (Plain)Pink & PurpleSlate TechEmerald FreshWarm AmberCrimson RedSolarized LightCoffee BeanAntique SepiaSunset GlowLavender MistMint CreamPeach PuffSky BlueRose QuartzLemon ChiffonSpring BudAqua MarineCoral ReefLilac DreamPearl White

So how do you handle continuously changing documents in RAG ?"

Here's the full answer. Get it wrong, and your bot quotes last week's policy.

The naive fix: reembed everything after every edit.

Say 500 docs, about 10,000 chunks --- all reembedded to fix one sentence. The answer they want has three layers.

Layer one: detect what changed. The app sends a webhook, an instant ping, when a file changes. Then compare each chunk's hash, a fingerprint of its text. Same hash, skip it; new hash that chunk changed.

Layer two: update only that chunk. Reembed it and absurd it under the same ID. Absurd means override if it exists, insert if not. Doc deleted, delete all its chunks by its doc ID. One chunk reembedded, not 10,000.

Layer three: safety nets. Tag every chunk with a version, search only the latest. Webhooks can be missed, so run a scheduled full resync. Now your bot says 14 days.

Don't rebuild everything, touch only what changed.

Detect update, verify.