# Speech-to-chat app

**URL:** </static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fspeech-to-chat-app%2F59353%3E%5C
**Category:** Show and Tell\
**Created:** [October 21, 2023, 3:15am UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fspeech-to-chat-app%2F59353 "2023-10-21T03:15:15Z")\
**Posts on this page:** 1\
**Page:** 1

<div class="post-metadata">

**Author:** ![kobakhit](https://sea2.discourse-cdn.com/hellohellohello/user_avatar/discuss.huggingface.co/kobakhit/32/20506_2.png) [@kobakhit](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Fu%2Fkobakhit)%5C
**Post date:** [October 21, 2023, 3:15am UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fspeech-to-chat-app%2F59353%2F1 "2023-10-21T03:15:15Z")

</div>

Check out this **streamlit** app I call speech-to-chat where given an audio file or a **youTube** link it will

- 
  1. Diarize speech

- 
  1. Transcribe each speaker’s audio track

- 
  1. Set up an LLM chat with the transcript loaded into its knowledge database

All that using OpenAI **Whisper** and **gpt** , and Hugging Face **pyannote**  **api** developed by the amazing Hervé Bredin.

I regularly watch long form **educational** videos and this tool enables me to

- Quickly summarize / analyze the content
- Identify main bullet points and find the corresponding timestamps
- Generate SEO keywords and more…

I learned a lot while building this app and it is mind-boggling the capabilities that are now available for content processing vs 5 years ago. I have not found an existing service/vendor that does the above, please share if you have seen similar tools.

The free version of the app is deployed on

- HuggingFace Spaces 🤗: [Speech To Chat - a Hugging Face Space by kobakhit](https://huggingface.co/spaces/kobakhit/speech-to-chat)

Below resources were invaluable:

- phData How to Guides
- pyannote
- Streamlit Forum

Please reach out if you have any questions or feedback!
