MarMar Labs 2f13f103a0 fix(token_utils): build the tiktoken encoder on first use, not at import (#18986)

2026-09-04 15:46:30 +08:00

..

chunker

fix(token_utils): build the tiktoken encoder on first use, not at import (#18986)

2026-09-04 15:46:30 +08:00

compiler

feat: adapt knowledge compilation concurrency (#19156)

2026-09-04 11:17:56 +08:00

extractor

Fix: pipeline with compilation + transfomer (extrator) does not work (#19045)

2026-08-31 16:45:21 +08:00

parser

fix(rag): unify parser_config delimiter defaults on a single constant (#19058)

2026-09-03 17:16:37 +08:00

tests

fix(token_utils): build the tiktoken encoder on first use, not at import (#18986)

2026-09-04 15:46:30 +08:00

tokenizer

refa: resolve tenant model refs consistently (#16744)

2026-07-09 14:02:08 +08:00

__init__.py

Feat: refine dataflow and initialize dataflow app (#9952)

2025-09-05 18:50:46 +08:00

base.py

Refactor: reformat all code for lefthook using ruff and gofmt (#16585)

2026-07-03 12:53:39 +08:00

file.py

Refactor: reformat all code for lefthook using ruff and gofmt (#16585)

2026-07-03 12:53:39 +08:00

pipeline.py

fix: optimize dataflow indexing and logs (#17737)

2026-08-03 19:15:44 +08:00