rtf benchmark

funasr/runtime/onnxruntime/readme.md

@@ -41,8 +41,8 @@ pip install --editable ./
 ```
 导出onnx模型，[详见](https://github.com/alibaba-damo-academy/FunASR/tree/main/funasr/export)，参考示例，从modelscope中模型导出：
 
-```
-python -m funasr.export.export_model 'damo/speech_paraformer-large_asr_nat-zh-cn-16k-common-vocab8404-pytorch' "./export" true
+```shell
+python -m funasr.export.export_model --model-name damo/speech_paraformer-large_asr_nat-zh-cn-16k-common-vocab8404-pytorch --export-dir ./export --type onnx --quantize False
 ```
 
 ## Building Guidance for Linux/Unix

funasr/runtime/python/libtorch/README.md

@@ -19,11 +19,11 @@
 
        - `e.g.`, Export model from modelscope
          ```shell
-         python -m funasr.export.export_model 'damo/speech_paraformer-large_asr_nat-zh-cn-16k-common-vocab8404-pytorch' "./export" false
+         python -m funasr.export.export_model --model-name damo/speech_paraformer-large_asr_nat-zh-cn-16k-common-vocab8404-pytorch --export-dir ./export --type torch --quantize False
          ```
        - `e.g.`, Export model from local path, the model'name must be `model.pb`.
          ```shell
-         python -m funasr.export.export_model '/mnt/workspace/damo/speech_paraformer-large_asr_nat-zh-cn-16k-common-vocab8404-pytorch' "./export" false
+         python -m funasr.export.export_model --model-name ./damo/speech_paraformer-large_asr_nat-zh-cn-16k-common-vocab8404-pytorch --export-dir ./export --type torch --quantize False
          ```
 
 

funasr/runtime/python/libtorch/setup.py

@@ -28,7 +28,7 @@ setuptools.setup(
     install_requires=["librosa", "onnxruntime>=1.7.0",
                       "scipy", "numpy>=1.19.3",
                       "typeguard", "kaldi-native-fbank",
-                      "PyYAML>=5.1.2"],
+                      "PyYAML>=5.1.2", "torch-quant >= 0.4.0"],
     packages=find_packages(include=["torch_paraformer*"]),
     keywords=[
         'funasr,paraformer'

funasr/runtime/python/onnxruntime/README.md

@@ -24,11 +24,11 @@
 
        - `e.g.`, Export model from modelscope
          ```shell
-         python -m funasr.export.export_model 'damo/speech_paraformer-large_asr_nat-zh-cn-16k-common-vocab8404-pytorch' "./export" true
+         python -m funasr.export.export_model --model-name damo/speech_paraformer-large_asr_nat-zh-cn-16k-common-vocab8404-pytorch --export-dir ./export --type onnx --quantize False
          ```
        - `e.g.`, Export model from local path, the model'name must be `model.pb`.
          ```shell
-         python -m funasr.export.export_model '/mnt/workspace/damo/speech_paraformer-large_asr_nat-zh-cn-16k-common-vocab8404-pytorch' "./export" true
+         python -m funasr.export.export_model --model-name ./damo/speech_paraformer-large_asr_nat-zh-cn-16k-common-vocab8404-pytorch --export-dir ./export --type onnx --quantize False
          ```