useWhisper for React Native

[chengsokdara]

useWhisper Native

• Dependencies

• Expo version

  • expo-av - speech recording
  • expo-file-system - convert speech binary data to base64
  • react-native-voice/voice - detect speaking event

• React Native version

  • react-native-audio-recorder-player: speech recording
  • react-native-audio-toolkit - speech recording
  • react-native-fs - convert speech binary data to base64
  • react-native-voice/voice - detect speaking event

• Tasks

  • speech recording

    • able to start recording
    • able to stop recording
    • able to pause recording
    • able to get recorded data in chunk

  • speech detection

    • able to detect speaking start event
    • able to detect speaking stop event

  • speech transcription

    • able to convert recorded data to base64 string
    • send base64 data to Whisper via multipart/form-data
    • able to transcribe in real-time via recorded chunks

  • silence removal (optional)

    • use ffmpeg to remove silence part from recorded audio

[jpreethi1522]

when will it be created and finished react-native whisper

[chen-rn]

This looks great! Looking forward to playing around with this!

[tsheaff]

How can I help contribute to this?

[tsheaff]

There's no code to fork and make a PR from. Has the work begun here? I see several checkboxes ticked @chengsokdara

[jpreethi1522]

Hi sir This is Preethi I'm an engineering student and currently working on projects .I'm trying to build a app using react native .so for this purpose I need speech to text conversion using react native Can you please help with this? I hope you can help me Thank you Yours sincerely Preethi J

…

On Thu, 30 Mar, 2023, 4:57 pm Tyler Sheaffer, ***@***.***> wrote: There's no code to fork and make a PR from. Has the work begun here? I see several checkboxes ticked @chengsokdara <https://github.com/chengsokdara> — Reply to this email directly, view it on GitHub <#1 (comment)>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/A4WPFEGD6XY3NHDX72FZAQLW6VUYPANCNFSM6AAAAAAVYDQ7MI> . You are receiving this because you commented.Message ID: ***@***.***>

[sidsarasvati]

Nice! Looking forward to contributing

[adamnation]

I'd like to contribute to this. LMK where I can help out.

[Balajirpurplelslate]

Did you done?

[hadnet]

Any updates @chengsokdara ?

[AVIVASHISHTA29]

Eagerly waiting for this! Please give an update @chengsokdara , would really love to help.

[tsheaff]

Any update on this? @chengsokdara if you started this project but haven't had time to finish it, I'm sure you posting the work-in-progress code you did write would help others take it across the finish line! I'd happily contribut to making this a reality. Any chance you could share what you've done so far even if it's incomplete?