Dockerfile build issue

[lissyx ((slow to reply) [NOT PROVIDING SUPPORT])]

@axcn

to ignore the error.

Again, can you reply to the questions I am asking ?
What does your statement means ?

You don’t have a file?
It is not readable ?

Why do you have path /usr/local ? That would imply you are not using a virtualenv ?

[axcn (Alex Chan (axcn))]

@lissyx

• make sure you git cloned proper tree
• make sure you have VERSION file at the root, and that it is readable
• make sure you have setup properly the virtualenv

I built the DeepSpeech with Dockerfile, i didn’t know i still need to run the command

python3 -m venv $HOME/tmp/deepspeech-train-venv/

[lissyx ((slow to reply) [NOT PROVIDING SUPPORT])]

@axcn

I built the DeepSpeech with Dockerfile, i didn’t know i still need to run the command

Well, it might not be needed, but I insist once again: this Dockerfile is provided as-is, and is only tested to build, not to train, it’s not mentionned in any doc.

Could you please be precise in how to “run training”: have you modified the Dockerfile, do you connect to the container, etc.

[lissyx ((slow to reply) [NOT PROVIDING SUPPORT])]

@axcn

I built the DeepSpeech with Dockerfile, i didn’t know i still need to run the command

I also asked you three questions, I don’t see any answer.

[lissyx ((slow to reply) [NOT PROVIDING SUPPORT])]

ls -halR /usr/local/lib/python3.6/dist-packages/deepspeech_training/

[axcn (Alex Chan (axcn))]

As i am a Newbie, Sorry for the inconvenience.

After I changed the VERSION to 0.7.0, I can run the training and testing. I had not trained in English, therefore i could not say whether be precise or not.

When i generated my own lm.binary and vocab-500000.txt, the training is in normal.
But there is error when start to run the testing.

Segmentation fault

i also got the Segmentation fault. root@4d8a33df56c5:/DeepSpeech# ./evaluate.py --test_files ./data/CV/zh-HK/clips/test.csv 2020-04-27 05:18:21.224252: I tensorflow/core/platform/cpu_feature_guard.cc:142] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2020-04-27 05:18:21.229519: I tensorflow/core/platform/profile_utils/cpu_utils.cc:94] CPU Frequency: 2400005000 Hz 2020-04-27 05:18:21.229722: I tensorflow/compiler/xla/service/service.cc:168] XLA …

[axcn (Alex Chan (axcn))]

/usr/local/lib/python3.6/dist-packages/deepspeech_training/:
total 84K
drwxr-sr-x 1 root staff 4.0K 4月  27 14:46 .
drwxrwsr-x 1 root staff 4.0K 4月  26 20:05 ..
-rw-r--r-- 1 root staff 5.7K 4月  26 19:22 evaluate.py
-rwxr-xr-x 1 root staff   19 4月  26 19:22 GRAPH_VERSION
-rw-r--r-- 1 root staff    0 4月  26 19:22 __init__.py
drwxr-sr-x 2 root staff 4.0K 4月  26 19:22 __pycache__
-rw-r--r-- 1 root staff  40K 4月  26 19:22 train.py
drwxr-sr-x 1 root staff 4.0K 4月  27 03:25 util
-rwxr-xr-x 1 root staff   14 4月  27 14:46 VERSION

/usr/local/lib/python3.6/dist-packages/deepspeech_training/__pycache__:
total 48K
drwxr-sr-x 2 root staff 4.0K 4月  26 19:22 .
drwxr-sr-x 1 root staff 4.0K 4月  27 14:46 ..
-rw-r--r-- 1 root staff 5.3K 4月  26 19:22 evaluate.cpython-36.pyc
-rw-r--r-- 1 root staff  147 4月  26 19:22 __init__.cpython-36.pyc
-rw-r--r-- 1 root staff  24K 4月  26 19:22 train.cpython-36.pyc

/usr/local/lib/python3.6/dist-packages/deepspeech_training/util:
total 168K
drwxr-sr-x 1 root staff 4.0K 4月  27 03:25 .
drwxr-sr-x 1 root staff 4.0K 4月  27 14:46 ..
-rw-r--r-- 1 root staff  15K 4月  26 19:22 audio.py
-rw-r--r-- 1 root staff 2.7K 4月  26 19:22 check_characters.py
-rw-r--r-- 1 root staff 6.1K 4月  26 19:22 checkpoints.py
-rw-r--r-- 1 root staff 5.7K 4月  26 19:22 config.py
-rw-r--r-- 1 root staff 1.1K 4月  26 19:22 downloader.py
-rw-r--r-- 1 root staff 4.0K 4月  26 19:22 evaluate_tools.py
-rw-r--r-- 1 root staff 9.5K 4月  26 19:22 feeding.py
-rw-r--r-- 1 root staff  16K 4月  27 03:25 flags.py
-rw-r--r-- 1 root staff  310 4月  26 19:22 gpu.py
-rw-r--r-- 1 root staff 4.2K 4月  26 19:22 helpers.py
-rw-r--r-- 1 root staff 3.3K 4月  26 19:22 importers.py
-rw-r--r-- 1 root staff    0 4月  26 19:22 __init__.py
-rw-r--r-- 1 root staff  969 4月  26 19:22 logging.py
drwxr-sr-x 1 root staff 4.0K 4月  27 03:38 __pycache__
-rw-r--r-- 1 root staff  15K 4月  26 19:22 sample_collections.py
-rw-r--r-- 1 root staff 9.6K 4月  26 19:22 sparse_image_warp.py
-rw-r--r-- 1 root staff 6.7K 4月  26 19:22 spectrogram_augmentations.py
-rw-r--r-- 1 root staff 1.9K 4月  26 19:22 stm.py
-rw-r--r-- 1 root staff 5.3K 4月  26 19:22 taskcluster.py
-rw-r--r-- 1 root staff 5.8K 4月  26 19:22 text.py

/usr/local/lib/python3.6/dist-packages/deepspeech_training/util/__pycache__:
total 152K
drwxr-sr-x 1 root staff 4.0K 4月  27 03:38 .
drwxr-sr-x 1 root staff 4.0K 4月  27 03:25 ..
-rw-r--r-- 1 root staff  13K 4月  26 19:22 audio.cpython-36.pyc
-rw-r--r-- 1 root staff 2.6K 4月  26 19:22 check_characters.cpython-36.pyc
-rw-r--r-- 1 root staff 4.8K 4月  26 19:22 checkpoints.cpython-36.pyc
-rw-r--r-- 1 root staff 3.7K 4月  26 19:22 config.cpython-36.pyc
-rw-r--r-- 1 root staff 1.1K 4月  26 19:22 downloader.cpython-36.pyc
-rw-r--r-- 1 root staff 4.0K 4月  26 19:22 evaluate_tools.cpython-36.pyc
-rw-r--r-- 1 root staff 7.5K 4月  26 19:22 feeding.cpython-36.pyc
-rw-r--r-- 1 root staff  15K 4月  27 03:38 flags.cpython-36.pyc
-rw-r--r-- 1 root staff  637 4月  26 19:22 gpu.cpython-36.pyc
-rw-r--r-- 1 root staff 5.3K 4月  26 19:22 helpers.cpython-36.pyc
-rw-r--r-- 1 root staff 3.1K 4月  26 19:22 importers.cpython-36.pyc
-rw-r--r-- 1 root staff  152 4月  26 19:22 __init__.cpython-36.pyc
-rw-r--r-- 1 root staff 1.4K 4月  26 19:22 logging.cpython-36.pyc
-rw-r--r-- 1 root staff  14K 4月  26 19:22 sample_collections.cpython-36.pyc
-rw-r--r-- 1 root staff 6.8K 4月  26 19:22 sparse_image_warp.cpython-36.pyc
-rw-r--r-- 1 root staff 4.6K 4月  26 19:22 spectrogram_augmentations.cpython-36.pyc
-rw-r--r-- 1 root staff 2.2K 4月  26 19:22 stm.cpython-36.pyc
-rw-r--r-- 1 root staff 4.6K 4月  26 19:22 taskcluster.cpython-36.pyc
-rw-r--r-- 1 root staff 5.2K 4月  26 19:22 text.cpython-36.pyc

[lissyx ((slow to reply) [NOT PROVIDING SUPPORT])]

@axcn

-rwxr-xr-x 1 root staff 14 4月 27 14:46 VERSION

So, again, what is the content of that file? (before you change it)

[lissyx ((slow to reply) [NOT PROVIDING SUPPORT])]

@axcn

As i am a Newbie, Sorry for the inconvenience.

Being a newbie does not excuse you for not answering the simple questions I am asking.

[lissyx ((slow to reply) [NOT PROVIDING SUPPORT])]

@axcn

When i generated my own lm.binary and vocab-500000.txt, the training is in normal.
But there is error when start to run the testing.

Can we please stick to one problem at a time? Also, “segfault” with regenerated lm.binary is proved by many examples on the forum to be people improperly following documentation and producing broken files. We can’t help with that.

[axcn (Alex Chan (axcn))]

Before i change the file, the content as below

…/…/VERSION

[lissyx ((slow to reply) [NOT PROVIDING SUPPORT])]

@axcn

Before i change the file, the content as below

Could you please be as explicite as possible to avoid any ambiguity? Please use cat and copy/paste full command line and output. Otherwise we made no progress.

[axcn (Alex Chan (axcn))]

Sorry for the inconvenience. I have been using the wrong reference function.

the content of the VERSION file as below:
root@4d8a33df56c5:/DeepSpeech# cat /usr/local/lib/python3.6/dist-packages/deepspeech_training/VERSION
../../VERSION

[lissyx ((slow to reply) [NOT PROVIDING SUPPORT])]

I still don’t see a cat nor a ls. So I don’t know if it’s a broken file, a symlink improperly read, …

[lissyx ((slow to reply) [NOT PROVIDING SUPPORT])]

@axcn

root@4d8a33df56c5:/DeepSpeech# cat /usr/local/lib/python3.6/dist-packages/deepspeech_training/VERSION
../../VERSION

Now, ls -hal /usr/local/lib/python3.6/dist-packages/deepspeech_training/VERSION

[axcn (Alex Chan (axcn))]

root@4d8a33df56c5:/DeepSpeech# ls -hal /usr/local/lib/python3.6/dist-packages/deepspeech_training/VERSION
-rwxr-xr-x 1 root staff 14 4月 27 14:46 /usr/local/lib/python3.6/dist-packages/deepspeech_training/VERSION

[lissyx ((slow to reply) [NOT PROVIDING SUPPORT])]

@axcn

-rwxr-xr-x 1 root staff 14 4月 27 14:46 /usr/local/lib/python3.6/dist-packages/deepspeech_training/VERSION

So, it’s a flat file instead of a symlink. Try and nchange the pip install step of the Dockerfile to the documented one:

pip3 install --upgrade pip==20.0.2 wheel==0.34.2 setuptools==46.1.3
pip3 install --upgrade --force-reinstall -e .

[axcn (Alex Chan (axcn))]

@lissyx

pip3 install --upgrade pip==20.0.2 wheel==0.34.2 setuptools==46.1.3 pip3 install --upgrade --force-reinstall -e .

insert the pip install command after Install pip step and build the DeepSpeech image again, right?

[lissyx ((slow to reply) [NOT PROVIDING SUPPORT])]

@axcn

insert the pip install command after Install pip step

change the current one with those two.

[axcn (Alex Chan (axcn))]

@lissyx

change the current one with those two.

Thank you very much.

Changed and rebuilding the DeepSpeech.

And it should be finish after 2 hour later.

Sorry for the inconvenience again.

After rebuild the image, i will RUN
python3 -m venv $HOME/tmp/deepspeech-train-venv/
in the image first.