Commit Graph

19 Commits

Author SHA1 Message Date
zachary62 060bc9d50e update progress bar 2025-05-05 11:53:53 -04:00
Hari Haran 0b2078b12a Merge remote-tracking branch 'upstream/main' into crawling-progress 2025-05-05 10:39:02 +00:00
zachary62 c238dba586 make the way to count abstractions more robust 2025-05-02 09:53:40 -04:00
zachary62 c765bff257 fix the default chapter number 2025-05-01 11:00:54 -04:00
remy 51b64f8d28 feat: add --max-abstractions flag to control number of identified abstractions 2025-05-01 15:43:26 +10:00
remy 6f4d62f873 drop yaml fix 2025-05-01 15:31:54 +10:00
remy 98fa9fc0d5 fix: improve file filtering, add new utility,
- Improved the speed of file filtering in `crawl_local_files.py` with folder-level exclusion
- Added `fix_yaml.py` utility for YAML indentation fixes
- Updated `nodes.py` to support up to 20 core abstractions
- add option for no cache.
2025-04-30 19:00:50 +10:00
Hari Haran cd947bbdc6 #feat: Report progress of the crawling #64 2025-04-30 04:27:22 +00:00
Marcel Santee ae49c7cedc Raise zero files fetched error before proceeding 2025-04-19 22:08:54 -03:00
Zachary Huang 08b2cade4f Update nodes.py 2025-04-18 21:05:11 -04:00
zachary62 2d4aaacc32 update nodes 2025-04-16 13:49:04 -04:00
zachary62 711edc7618 remove translation from the CombineTutorial 2025-04-16 13:15:31 -04:00
sublimegame 5e16ee74a8 Translate index.md too 2025-04-16 16:15:29 +07:00
sublimegame ad9573a7eb Add language parameter for multi-language support 2025-04-16 15:37:01 +07:00
zachary62 6178f6f42e update readme and design 2025-04-09 11:12:36 -04:00
zachary62 0d2c29e7c7 move crawl local to utils 2025-04-09 11:09:33 -04:00
SpeedOfSpin b6ab52aaa1 Made the source argument mutually exclusive - you must specify either --repo or --dir
Added a new crawl_local_files() function that mimics the interface of crawl_github_files()
Modified the FetchRepo node to handle both cases
Project name is now derived from either:
The repository name (from GitHub URL)
The directory name (from local path)
Or can be manually specified with -n/--name
The tool will use the same file pattern matching and size limits for both sources. All other functionality (generating abstractions, relationships, chapters, etc.) remains unchanged since they work with the same file list format.
2025-04-08 18:27:32 +00:00
zachary62 dc4d445676 update readme examples 2025-04-04 15:06:41 -04:00
Zach 41ecb66b4a Initial commit 2025-04-02 16:56:35 -04:00