Commit Graph
10 Commits
Author SHA1 Message Date
JyongandClaude Fable 5.2 11947c8fdc Merge PR #46090 (file malware scan) into deploy/konwledge
Brings main up to f5c0b49d4b along with the file scan feature. Generated
console contracts and OpenAPI markdown are regenerated from the merged
backend; the GitHub preview spec keeps the deploy branch's version.

Co-Authored-By: Claude Fable 5.2 <noreply@anthropic.com>
2026-11-11 18:43:54 +08:00
JyongandClaude Fable 5.2 7d6c1845b8 feat(file-scan): scan uploaded knowledge base files for malware
Add a shared file malware-scanning module and use it in the Classic
Knowledge Base, RAG Pipeline local files and the Agent Knowledge Base.

- core/file_scan: scanner adapters for ClamAV (deployment-configured),
  Cloudmersive, Scanii, OPSWAT MetaDefender Cloud and API-based
  extensions (new `file.malware_scan` extension point).
- services/file_scan: FileScanService is the single entry point other
  modules call. Providers are workspace-wide; a policy belongs to a
  scope (dataset, knowledge_fs_space), so further modules can adopt
  scanning without schema changes.
- Each file is scanned on its own: a rejected file fails only its own
  document. Malware always blocks and deletes the stored original;
  invalid credentials and exhausted quota stop processing regardless of
  the "allow" fallback.
- Console: workspace scanner management and a per-knowledge-base
  policy section in both settings forms; the Agent Knowledge Base
  upload keeps going after a rejected file and explains each failure.
- Off by default behind FILE_SCAN_ENABLED.

Co-Authored-By: Claude Fable 5.2 <noreply@anthropic.com>
2026-11-11 18:37:03 +08:00
FFXNandautofix-ci[bot] f3f9b121a4 feat(knowledge): add GitHub tree previews to source selection (#45990)
Co-authored-by: autofix-ci[bot] <114827586+autofix-ci[bot]@users.noreply.github.com>
2026-11-11 02:47:23 +00:00
FFXN 8e077ab5a3 feat(knowledge-fs): add GitHub tree preview in connected sources 2026-11-09 16:28:28 +08:00
JyongandClaude Opus 5.5 62b44d2a90 feat(knowledge-fs): free Tidy duplicate review, conflict opt-in and progress
Sync with langgenius/knowledge-fs#94 revision 2 (13dbb69):

- Duplicate, overlapping and reworded content are detected from text and
  the embeddings indexing already created, with no model calls; the
  token consent now covers only factual conflict detection, with its own
  switch and a checkbox in the enable dialog.
- Proxy GET .../tidy/summary and the kind/state filters; settings expose
  conflicts and the space pause reason; findings may be outdated.
- Show scan progress and model calls, the pause reason with Retry,
  failed documents, counts per review status and per kind, a kind
  filter, and explain reworded duplicates found by stored vectors.
- Re-pin the KnowledgeFS contract; regenerate console contracts and docs;
  add the new copy to all 25 locales.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-11-04 16:41:01 +08:00
Jyong eae62f0142 feat(knowledge-fs): add opt-in Tidy review and source comparison 2026-11-03 19:11:13 +08:00
yyhandClaude f1739f12d7 fix: expose KnowledgeFS availability in workspace features (#45073)
Co-authored-by: Claude <noreply@anthropic.com>
2026-10-29 12:04:18 +00:00
Jyong 03fe4879a4 fix(knowledge-fs): preserve model settings failure details (#44971) 2026-10-29 01:05:06 +00:00
Stephen Zhouandautofix-ci[bot] e8b9a3c7fa fix(web): search all New RAG documents and restore scrolling (#44818)
Co-authored-by: autofix-ci[bot] <114827586+autofix-ci[bot]@users.noreply.github.com>
2026-10-27 08:24:39 +00:00
fd2db63184 feat: KnowledgeFS and New Knowledge (#44165)
Co-authored-by: Jyong <76649700+JohnJyong@users.noreply.github.com>
Co-authored-by: hjlarry <hjlarry@163.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
Co-authored-by: autofix-ci[bot] <114827586+autofix-ci[bot]@users.noreply.github.com>
Co-authored-by: zhaohao1004 <zhaohao1004@gmail.com>
Co-authored-by: yyh <yuanyouhuilyz@gmail.com>
Co-authored-by: FFXN <lizy@dify.ai>
2026-10-23 03:34:59 +00:00