No Description

游雁 3927728a43 docs		2 years ago
.github	6ff262c318 docs	2 years ago
docs	3927728a43 docs	2 years ago
docs_m2met2	d13218de97 update m2met2 pages	2 years ago
docs_m2met2_cn	d13218de97 update m2met2 pages	2 years ago
egs	8672352ecd merge many functions	2 years ago
egs_modelscope	3999789c18 docs	2 years ago
fun_text_processing	12a7adfdf3 update version 0.1.6	2 years ago
funasr	88f45071da docs	2 years ago
tests	ffb96a4f62 update	2 years ago
.gitignore	b3e53201da docs	2 years ago
LICENSE	c087854f71 create	3 years ago
README.md	3999789c18 docs	2 years ago
setup.py	b6439f0854 readme	2 years ago

FunASR: A Fundamental End-to-End Speech Recognition Toolkit

FunASR hopes to build a bridge between academic research and industrial applications on speech recognition. By supporting the training & finetuning of the industrial-grade speech recognition model released on ModelScope, researchers and developers can conduct research and production of speech recognition models more conveniently, and promote the development of speech recognition ecology. ASR for Fun！

Multi-Channel Multi-Party Meeting Transcription 2.0 (M2MET2.0) Challenge

We are pleased to announce that the M2MeT2.0 challenge will be held in the near future. The baseline system is conducted on FunASR and is provided as a receipe of AliMeeting corpus. For more details you can see the guidence of M2MET2.0 (CN/EN).

What's new:

For the release notes, please ref to news

Highlights

FunASR supports speech recognition(ASR), Multi-talker ASR, Voice Activity Detection(VAD), Punctuation Restoration, Language Models, Speaker Verification and Speaker diarization.
We have released large number of academic and industrial pretrained models on ModelScope
The pretrained model Paraformer-large obtains the best performance on many tasks in SpeechIO leaderboard
FunASR supplies a easy-to-use pipeline to finetune pretrained models from ModelScope
Compared to Espnet framework, the training speed of large-scale datasets in FunASR is much faster owning to the optimized dataloader.

Installation

Install from pip

pip install -U funasr
# For the users in China, you could install with the command:
# pip install -U funasr -i https://mirror.sjtu.edu.cn/pypi/web/simple

Or install from source code

git clone https://github.com/alibaba/FunASR.git && cd FunASR
pip install -e ./
# For the users in China, you could install with the command:
# pip install -e ./ -i https://mirror.sjtu.edu.cn/pypi/web/simple

If you want to use the pretrained models in ModelScope, you should install the modelscope:

pip install -U modelscope
# For the users in China, you could install with the command:
# pip install -U modelscope -f https://modelscope.oss-cn-beijing.aliyuncs.com/releases/repo.html -i https://mirror.sjtu.edu.cn/pypi/web/simple

For more details, please ref to installation

//: # ()

Contact

If you have any questions about FunASR, please contact us by

email: funasr@list.alibaba-inc.com

Dingding group	Wechat group

Contributors

Acknowledge

We borrowed a lot of code from Kaldi for data preparation.
We borrowed a lot of code from ESPnet. FunASR follows up the training and finetuning pipelines of ESPnet.
We referred Wenet for building dataloader for large scale data training.
We acknowledge DeepScience for contributing the grpc service.

License

This project is licensed under the The MIT License. FunASR also contains various third-party components and some code modified from other repos under other open source licenses.

Citations

@inproceedings{gao2020universal,
  title={Universal ASR: Unifying Streaming and Non-Streaming ASR Using a Single Encoder-Decoder Model},
  author={Gao, Zhifu and Zhang, Shiliang and Lei, Ming and McLoughlin, Ian},
  booktitle={arXiv preprint arXiv:2010.14099},
  year={2020}
}

@inproceedings{gao2022paraformer,
  title={Paraformer: Fast and Accurate Parallel Transformer for Non-autoregressive End-to-End Speech Recognition},
  author={Gao, Zhifu and Zhang, Shiliang and McLoughlin, Ian and Yan, Zhijie},
  booktitle={INTERSPEECH},
  year={2022}
}
@inproceedings{Shi2023AchievingTP,
  title={Achieving Timestamp Prediction While Recognizing with Non-Autoregressive End-to-End ASR Model},
  author={Xian Shi and Yanni Chen and Shiliang Zhang and Zhijie Yan},
  booktitle={arXiv preprint arXiv:2301.12343}
  year={2023}
}

README.md