On Mac I am getting the following error when running inference from checkpoint:
Fatal Python error: Segmentation fault
Thread 0x000000010e058dc0 (most recent call first):
File "/Users/Jedrzej/DeepSpeech/venv/lib/python3.7/site-packages/ds_ctcdecoder/swigwrapper.py", line 364 in ctc_beam_search_decoder_batch
File "/Users/Jedrzej/DeepSpeech/venv/lib/python3.7/site-packages/ds_ctcdecoder/__init__.py", line 128 in ctc_beam_search_decoder_batch
File "/Users/Jedrzej/DeepSpeech/gpu_worker.py", line 199 in run_transcribe
File "/Users/Jedrzej/DeepSpeech/gpu_worker.py", line 214 in evaluate
File "/Users/Jedrzej/DeepSpeech/gpu_worker.py", line 240 in main
File "/Users/Jedrzej/DeepSpeech/venv/lib/python3.7/site-packages/absl/app.py", line 250 in _run_main
File "/Users/Jedrzej/DeepSpeech/venv/lib/python3.7/site-packages/absl/app.py", line 299 in run
File "/Users/Jedrzej/DeepSpeech/gpu_worker.py", line 247 in <module>
I am using the master branch with the newest ds-ctcdecoder package:
ds-ctcdecoder 0.7.0a2
I have tested both my scorer and the one from data/lm.
There are no errors under Ubuntu 18.04 though.
lissyx
((slow to reply) [NOT PROVIDING SUPPORT])
2
We have not made a new alpha yet and we merged a few changes, I’m unsure if they are still compatible. Can you reproduce with 0.7.0 alpha 2 tag ?
I used the script generate_lm.py and python3 generate_package.py --lm lm.binary --vocab librispeech-vocab-500k.txt --package test.scorer --default_alpha 0.8 --default_beta 1.85
I tried to reinstall ctc_decoder. I also tried Alpha 0.7.0a2 and 0.7.0a3.
Maybe it’s the kenlm package or the ctc_decoder, or some dependencies.
Does anybody have any ideas, how I can solve this problem?
Test epoch | Steps: 0 | Elapsed Time: 0:00:00 2020-03-30 14:30:36.584604: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10.0
2020-03-30 14:30:36.810027: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7
Fatal Python error: Segmentation fault
Thread 0x00007f3c9e8cc200 (most recent call first):
File “~/.site-packages/lib64/3.7.4_intel_2019.6_mavx/site-packages/ds_ctcdecoder/swigwrapper.py”, line 364 in ctc_beam_search_decoder_batch
File “+/.site-packages/lib64/3.7.4_intel_2019.6_mavx/site-packages/ds_ctcdecoder/init.py”, line 128 in ctc_beam_search_decoder_batch
File “evaluate.py”, line 116 in run_test
File “evaluate.py”, line 134 in evaluate
File “evaluate.py”, line 147 in main
File “~/.site-packages/lib64/3.7.4_intel_2019.6_mavx/site-packages/absl/app.py”, line 250 in _run_main
File “~/.site-packages/lib64/3.7.4_intel_2019.6_mavx/site-packages/absl/app.py”, line 299 in run
File “evaluate.py”, line 156 in
./test.sh: line 14: 49508 Segmentation fault
Ps.
With the provided kenlm.scorer file the train phase is working.
lissyx
((slow to reply) [NOT PROVIDING SUPPORT])
5
Scorer is not used at training step.
Maybe, who knows if you don’t share your setup and what you did ?
I already trained a little bit.
It already works with the provided file.
So it should also work with the trained one.
Or can I not exchange the scorer file after training?
I don’t know what is worth to share:
Operating System: CentOS Linux 7 (Core)
nvidia-gpu Driver Version: 440.64.00 CUDA Version: 10.2
Python 3.7.4
pip Packages:
Package Version