mirror of
https://github.com/k2-fsa/sherpa-onnx.git
synced 2026-11-10 21:11:03 +08:00
Add Rust example for real-time ASR + VAD (#3397)
This pull request expands the Rust API examples by introducing a comprehensive set of simulated real-time ASR applications integrated with VAD. These additions allow users to interact with various ASR models directly through their microphone, providing a practical demonstration of the sherpa-onnx library's capabilities in a live audio processing context. The changes also include necessary infrastructure for audio resampling and improved output display.
This commit is contained in:
1 parent
e0579c8033
commit
b1f948315e
23 files changed
+2597
-36
No files matched your search
+24
@@ -0,0 +1,24 @@
|
||||
#!/usr/bin/env bash
|
||||
set -ex
|
||||
|
||||
# https://k2-fsa.github.io/sherpa/onnx/vad/silero-vad.html
|
||||
if [ ! -f "./silero_vad.onnx" ]; then
|
||||
curl -SL -O https://github.com/k2-fsa/sherpa-onnx/releases/download/asr-models/silero_vad.onnx
|
||||
fi
|
||||
|
||||
# see
|
||||
# https://k2-fsa.github.io/sherpa/onnx/pretrained_models/offline-transducer/zipformer-transducer-models.html#sherpa-onnx-zipformer-ja-reazonspeech-2024-08-01-japanese
|
||||
if [ ! -f ./sherpa-onnx-zipformer-ja-reazonspeech-2024-08-01/encoder-epoch-99-avg-1.int8.onnx ]; then
|
||||
curl -SsL -O https://github.com/k2-fsa/sherpa-onnx/releases/download/asr-models/sherpa-onnx-zipformer-ja-reazonspeech-2024-08-01.tar.bz2
|
||||
|
||||
tar xvf sherpa-onnx-zipformer-ja-reazonspeech-2024-08-01.tar.bz2
|
||||
rm sherpa-onnx-zipformer-ja-reazonspeech-2024-08-01.tar.bz2
|
||||
ls -lh sherpa-onnx-zipformer-ja-reazonspeech-2024-08-01
|
||||
fi
|
||||
|
||||
cargo run --example zipformer_transducer_simulate_streaming_microphone --features mic -- \
|
||||
--silero-vad-model ./silero_vad.onnx \
|
||||
--encoder ./sherpa-onnx-zipformer-ja-reazonspeech-2024-08-01/encoder-epoch-99-avg-1.int8.onnx \
|
||||
--decoder ./sherpa-onnx-zipformer-ja-reazonspeech-2024-08-01/decoder-epoch-99-avg-1.onnx \
|
||||
--joiner ./sherpa-onnx-zipformer-ja-reazonspeech-2024-08-01/joiner-epoch-99-avg-1.int8.onnx \
|
||||
--tokens ./sherpa-onnx-zipformer-ja-reazonspeech-2024-08-01/tokens.txt
|
||||
Reference in new issue
Block a user