Processing multiple audio at a time using multithreading

Archives DeepSpeech
13

You can either:

  1. rebuild the python client to use multi-processing Running multiple inferences in parallel on a GPU
  2. Run the DeepSpeech inference in a flask app. Flask will handle multithreading predict. Be sure to run 0.6.0 since 0.5.1 is not thread-safe.