Fangjun Kuang
8568fc4e5d
Remove cppjieba ( #2664 )
...
This PR removes the cppjieba dependency from the sherpa-onnx project by replacing its usage with character-based text processing. The main purpose is to simplify the codebase by eliminating the need for external jieba dictionary files and the cppjieba library.
- Replaces jieba-based word segmentation with UTF-8 character-level tokenization
- Removes all references to dict_dir and dictDir parameters across APIs
- Adds a new CharacterLexicon class to replace JiebaLexicon
2025-10-10 10:54:32 +08:00
..
2023-08-12 19:50:22 +08:00
2024-09-09 10:26:53 +08:00
2024-04-13 13:28:17 +08:00
2024-04-19 18:33:18 +08:00
2024-04-11 11:12:48 +08:00
2025-10-07 13:39:11 +08:00
2023-05-30 22:46:52 +08:00
2024-07-10 17:05:26 +08:00
2024-06-17 18:39:23 +08:00
2025-01-20 16:41:10 +08:00
2025-01-20 16:41:10 +08:00
2025-02-13 15:08:04 +08:00
2025-07-09 16:23:46 +08:00
2025-04-02 19:09:00 +08:00
2025-02-16 22:45:24 +08:00
2024-10-26 14:34:07 +08:00
2025-07-07 17:03:49 +08:00
2024-05-10 12:15:39 +08:00
2025-08-21 10:55:04 +08:00
2024-05-10 12:15:39 +08:00
2025-10-10 10:54:32 +08:00
2024-07-28 21:54:38 +08:00
2025-06-05 20:44:26 +08:00
2025-06-05 20:44:26 +08:00
2025-08-14 20:44:38 +08:00
2025-03-10 19:02:17 +08:00
2024-06-05 00:26:40 +08:00
2025-10-10 10:54:32 +08:00
2025-10-10 10:54:32 +08:00
2023-08-11 15:56:24 +08:00
2023-08-11 15:56:24 +08:00
2024-10-26 14:34:07 +08:00
2025-08-27 19:50:00 +08:00
2025-07-04 15:57:07 +08:00
2025-07-09 16:23:46 +08:00
2024-05-10 16:26:43 +08:00
2025-09-09 12:07:34 +08:00
2023-12-22 13:46:33 +08:00
2023-08-11 15:56:24 +08:00
2024-04-03 21:31:42 +08:00
2023-09-22 11:53:47 +08:00
2025-10-10 10:54:32 +08:00
2025-07-12 19:55:37 +08:00
2025-07-12 19:55:37 +08:00
2025-07-12 19:55:37 +08:00
2025-07-12 19:55:37 +08:00
2024-04-13 23:39:07 +08:00
2025-10-10 10:54:32 +08:00
2025-10-10 10:54:32 +08:00
2025-10-10 10:54:32 +08:00
2025-10-10 10:54:32 +08:00
2024-03-24 22:57:00 +08:00
2024-12-04 09:22:24 +08:00
2025-05-09 21:48:49 +08:00
2025-05-09 21:48:49 +08:00
2025-08-14 20:44:38 +08:00
2025-07-12 19:55:37 +08:00
2025-07-12 19:55:37 +08:00
2025-07-12 19:55:37 +08:00
2025-07-12 19:55:37 +08:00
2025-07-12 19:55:37 +08:00
2025-10-10 10:54:32 +08:00