Error: Can't parse trie file, invalid header. Try updating your trie file

DeepSpeech
#14

There’s a bug when uploading on Pypi :confused:

And also on Github … https://github.com/mozilla/DeepSpeech/releases/tag/v0.6.0-alpha.3

#15

lol Ok you right,
I did what you told me I did not rebuild and I used just the pre-built binaries for the deepspeech by executing this command :

python3 util/taskcluster.py --target .

I installed the deepspeech-gpu v0.6.0-alpha.1
and I am using Deepspeech version 0.6.0-alpha.3
also I have tensorflow 1.14
but I can not train my model,
here is the error I get :

tensorflow.python.framework.errors_impl.InvalidArgumentError: Cannot assign a device for operation tower_0/DeserializeSparse: Could not satisfy explicit device specification ‘/device:GPU:0’ because no supported kernel for GPU devices is available

#16

I just saw ur reply…
and Yeah I noticed that

#17

We’re preparing alpha4 that should fix it. pip install deepspeech-gpu==0.6.0a4 should work soon now.

Well, again, mismatching. Please let us breathe and time to fix the issue you reported.

1 Like
#18

@yasine.nifa It’s on github and pypi now, so you should be able to use 0.6.0a4 everywhere. Thanks for noticing the issue !

1 Like
#19

Thx !! I will try it right now :slight_smile:

#20

I am getting this error :

tensorflow.python.framework.errors_impl.InvalidArgumentError: Cannot assign a device for operation tower_0/DeserializeSparse: Could not satisfy explicit device specification '/device:GPU:0' because no supported kernel for GPU devices is available.
Colocation Debug Info:
Colocation group had the following types and supported devices: 
Root Member(assigned_device_name_index_=-1 requested_device_name_='/device:GPU:0' assigned_device_name_='' resource_device_name_='' supported_device_types_=[CPU] possible_devices_=[]
DeserializeSparse: CPU 

Colocation members, user-requested devices, and framework assigned devices, if any:
  tower_0/DeserializeSparse (DeserializeSparse) /device:GPU:0

Op: DeserializeSparse
Node attrs: dtype=DT_INT32, Tserialized=DT_VARIANT
Registered kernels:
  device='CPU'; Tserialized in [DT_VARIANT]
  device='CPU'; Tserialized in [DT_STRING]

	 [[{{node tower_0/DeserializeSparse}}]]

Is it due to cuda version ?
by the way I followed all what you did in “https://github.com/mozilla/DeepSpeech”

Here is all the command I executed :

virtualenv -p python3 $HOME/tmp/deepspeech-venv/
source $HOME/tmp/deepspeech-venv/bin/activate
pip install deepspeech-gpu==0.6.0a4 
cd DeepSpeech
pip3 install -r requirements.txt
pip3 install $(python3 util/taskcluster.py --decoder)
pip3 uninstall tensorflow
pip3 install 'tensorflow-gpu==1.14.0'

And I have cuda10.0. Here is the output of nvcc -V :

nvcc: NVIDIA ® Cuda compiler driver
Copyright © 2005-2018 NVIDIA Corporation
Built on Sat_Aug_25_21:08:01_CDT_2018
Cuda compilation tools, release 10.0, V10.0.130

Then when I execute the command to train my model, I get the above error.

#21

That looks weird, maybe a regression on GPUs from switching to TensorFlow r1.14 :confused:

@reuben can you check on your side ?

#22

This is weird. TensorFlow sometimes messes up when you mix CPU and GPU packages (or release and nightly packages) in the same virtual environment. Could you try doing the following steps in a fresh virtualenv? It’s basically avoiding the first install of tensorflow since you want to install tensorflow-gpu. Also, you don’t need the deepspeech package for training.

pip3 install -r <(grep -v tensorflow requirements.txt)
pip3 install $(python3 util/taskcluster.py --decoder)
pip3 install tensorflow-gpu==1.14.0
DeepSpeech problems with video card
#23

Thx for the reply,
I will try this… :slight_smile:

#24

Can we move that discussion to DeepSpeech problems with video card since it documents the very same issue ?

1 Like
#25

I tried what @reuben said and I get the same error :confused:

#26

I can’t reproduce your error. Did you change the code at all?

#27

No, I did not change it

#28

Nevermind, I made a mistake before, I can reproduce it now.

1 Like
#29

I have identified the cause and am testing a fix. It’s a regression from commit dc78f8d1e65c4b387aa335df243898cd04704f98, which caused us to fallback on the default value for allow_soft_placement, which apparently is not True :slight_smile:

2 Likes
#30

Thx for your help, I appreciate that
Can you please notify me when it’s fixed

#31

I’ve made a PR here, waiting for tests results: https://github.com/mozilla/DeepSpeech/pull/2245

Can you test it and let me know if it works for you?

1 Like
#32

it works perfectly … :wink:
Thx dude :slight_smile:

#33

Thanks! PR merged. _