github/codegraph
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

fix(watcher): exclude ignored dirs before watching to prevent inotify exhaustion (#276)

Browse Source 
The file watcher registered a recursive watch over the entire project (node_modules, build output, caches included) and filtered only in the callback — exhausting the Linux inotify budget on large repos (#276). It now uses chokidar and excludes the same directories the indexer ignores (built-in default-ignore set + the project .gitignore) BEFORE registering a watch, so the watch count on a 900-dir node_modules drops from ~1200 to ~14 even with no .gitignore. Stacks with the shared daemon (#411): one watcher across agents, now small.

Also hardens the #411 daemon lockfile against a concurrent-startup race the new watcher timing made reproducible — the lock is now created atomically with its content (temp-write + hard-link), so racing daemons can never both win. Validated on macOS, Linux (Docker), and Windows (chokidar + fs.linkSync on NTFS).

Co-Authored-By: Colby McHenry <me@colbymchenry.com>
Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
This commit is contained in:
Lorenzo Feng
2026-05-25 20:12:44 -05:00
committed by GitHub
co-authored by Colby McHenry Claude Opus 4.7
parent 995da54430
commit b09b23cf54
7 changed files with 197 additions and 79 deletions
Download Patch File Download Diff File Expand all files Collapse all files
CHANGELOG.md
+14
View File
@@ -34,6 +34,20 @@ and adheres to [Semantic Versioning](https://semver.org/spec/v2.0.0.html).
already attached to the old daemon keep using it while new sessions run
standalone until it idles out — they never mix versions over the socket.
### Fixed
- **The file watcher no longer exhausts the OS file-watch budget on large
repos (#276).** It used to register a recursive watch over the *entire*
project — `node_modules/`, build output, caches and all — and filter only
after the fact. On Linux that meant hundreds of thousands of inotify watches
per project; enough that a second project, or codegraph alongside your editor
/ `next dev`, could hit the per-user ceiling and fail with "OS file watch
limit reached." The watcher now excludes the same directories the indexer
ignores (the built-in default-ignore set **plus** your `.gitignore`) *before*
registering a watch — so on a repo with a 900-directory `node_modules` the
watch count drops from ~1,200 to ~14, even when the project has no
`.gitignore`. (Stacks with the shared daemon from #411: one watcher across
agents, and now that watcher is small.)
## [0.9.5] - 2026-05-25
### Fixed