Error while training alphabet, says it is missing characters

[MDupdup (Malo Dupont)]

Hi,

I am currently trying to create my own language model with Mozilla Deepspeech, but when I start the process, it rapidly ends displaying the following error:

KeyError: "ERROR: Your transcripts contain characters (e.g. 'c') which do not occur in data/alphabet.txt! Use util/check_characters.py to see what characters are in your [train,dev,test].csv transcripts, and then add all these to data/alphabet.txt."

First, I checked many times in my alphabet.txt which is located in an other path than the one displayed above. Both contain the ‘c’ character, along with the other characters present in my dataset transcriptions.

And then, why is it searching in data/alphabet.txt even if I expressly tell him to get this file in another location?

Below is the content of my alphabet.txt file:

t
r
a
n
s
c
i
p
v
o
l
à
 
e
q
u
d
é
f
m
x
j
'
h
g
è
y
b
ù
ç
ê
ô
z
â
œ
î
k
û
w

And here is the command I execute to start the training.

sudo python -u DeepSpeech.py   --train_files /media/sf_\[VRT\]_Debian_STT_v1/Language\ Model/script_preparation_data/train/train.csv   --dev_files /media/sf_\[VRT\]_Debian_STT_v1/Language\ Model/script_preparation_data/dev/dev.csv   --test_files /media/sf_\[VRT\]_Debian_STT_v1/Language\ Model/script_preparation_data/test/test.csv   --train_batch_size 80   --dev_batch_size 80   --test_batch_size 40   --n_hidden 375   --epochs 33   --early_stop True   --es_steps 6   --es_mean_th 0.1   --es_std_th 0.1   --dropout_rate 0.22   --learning_rate 0.00095   --report_count 100   --export_dir /media/sf_\[VRT\]_Debian_STT_v1/Language\ Model/script_preparation_data/results/model_export/   --checkpoint_dir /media/sf_\[VRT\]_Debian_STT_v1/Language\ Model/script_preparation_data/results/checkout/   --alphabet_config_path /media/sf_\[VRT\]_Debian_STT_v1/Language\ Model/script_preparation_data/alphabet.txt   --lm_binary_path /media/sf_\[VRT\]_Debian_STT_v1/Language\ Model/script_preparation_data/lm.binary   --lm_trie_path /media/sf_\[VRT\]_Debian_STT_v1/Language\ Model/script_preparation_data/trie

Do not hesitate to ask me for other information, code pieces…

Thanks by advance for your help!

[lissyx ((slow to reply) [NOT PROVIDING SUPPORT])]

@MDupdup

I checked many times in my alphabet.txt which is located in an other path than the one displayed above.

Are you sure you are passing this alphabet everywhere ? If somehow some component relies in the default data/alphabet.txt then you would get tricked.

@MDupdup

create my own language model

Which language are you working on ?

@MDupdup

Do not hesitate to ask me for other information, code pieces…

There’s mostly nothing we can do with that report except asking you to re-check, this code is well exercized now and if it’s outputing that error, then you really have a mismatch between your dataset and your alphabet …

Do you get the same alphabet generated with python util/check_characters.py --csv-files [...] --alphabet-format ?

[MDupdup (Malo Dupont)]

Hi, thanks for the fast answer!

@lissyx

re you sure you are passing this alphabet everywhere ? If somehow some component relies in the default data/alphabet.txt then you would get tricked.

That is why I copied and replaced the data/alphabet.txt with my own, but it does not seem to change anything…

@lissyx

Which language are you working on ?

Sorry, I am creating a generic french language model.

@lissyx

There’s mostly nothing we can do with that report except asking you to re-check, this code is well exercized now and if it’s outputing that error, then you really have a mismatch between your dataset and your alphabet …

I thought the same but even after hours of search I cannot find where I did something wrong…

I tried the command you gave me, copied/pasted the alphabet output in both the default and my own alphabets, but the same error outputs again, maybe I should re-install Deepspeech and the other modules.

[lissyx ((slow to reply) [NOT PROVIDING SUPPORT])]

@MDupdup

Sorry, I am creating a generic french language model.

Could you please have a look at https://github.com/Common-Voice/commonvoice-fr/blob/master/DeepSpeech/ and share the effort ?

@MDupdup

I tried the command you gave me, copied/pasted the alphabet output in both the default and my own alphabets, but the same error outputs again, maybe I should re-install Deepspeech and the other modules.

At that point, I guess you really need to explain what you do from scratch / how you run things.

There’s no “install deepspeech” involved in the training process, for example.

[lissyx ((slow to reply) [NOT PROVIDING SUPPORT])]

@MDupdup

sudo

You should not need sudo

I’m also unsure about your path, they contain a lot of backslashes as well as spaces, maybe it’s breaking some of the tensorflow flag parsing logic and it does not pick up your path ?

[MDupdup (Malo Dupont)]

I never thought that it would bother in any way but yeah I will try with more conventional paths, you’re right.

So I am working on a Ubuntu 18.04.3 Virtual Machine with the dataset being on a shared folder so I can work with it easily with both my host and client machines.

I need the sudo command because I am targeting the dataset located in my shared folder, seen by Ubuntu as an external drive.

I mainly followed the tutorial made by elpimous_robot (TUTORIAL : How I trained a specific french model to control my robot), adapting the links and commands on purpose, and using the 2018 french audio dataset provided by CommonVoice.

[lissyx ((slow to reply) [NOT PROVIDING SUPPORT])]

@MDupdup

I mainly followed the tutorial made by elpimous_robot (TUTORIAL : How I trained a specific french model to control my robot), adapting the links and commands on purpose, and using the 2018 french audio dataset provided by CommonVoice.

Well that tutorial might not be completely uptodate

@MDupdup

I need the sudo command because I am targeting the dataset located in my shared folder, seen by Ubuntu as an external drive.

Yeah but then it’s hard to know what python env etc is actually getting loaded

@MDupdup

I never thought that it would bother in any way but yeah I will try with more conventional paths, you’re right.

Without more context on your error, that’s the best I can bet.

But honestly, it would be cool if you could work around the work being done on french model, so that efforts are put in common.

[othiele (Olaf Thiele)]

Looks like the last line is not an emptyline , I usually start with this alphabet file and add characters later. It has 33 lines:

# Each line in this file represents the Unicode codepoint (UTF-8 encoded)
# associated with a numeric label.
# A line that starts with # is a comment. You can escape it with \# if you wish
# to use '#' as a label.
 
a
b
c
d
e
f
g
h
i
j
k
l
m
n
o
p
q
r
s
t
u
v
w
x
y
z
# The last (non-comment) line needs to end with a newline.

Last line is empty

[MDupdup (Malo Dupont)]

Hello, thanks for your answer!

I checked again and again, but the alphabet seems ok, no formatting issue, the newline is present at the end of the file, with the c letter on first position! But the issue remains the same…

[lissyx ((slow to reply) [NOT PROVIDING SUPPORT])]

@MDupdup

But the issue remains the same…

Even if you generate the alphabet from util/check_characters.py ? Please don’t rely on any copy/paste procedure, just pipe that to a file. There’s no reason it would not work, except if there is something really odd in your dataset …

[lissyx ((slow to reply) [NOT PROVIDING SUPPORT])]

Like: https://github.com/Common-Voice/commonvoice-fr/blob/e61a59e2de0e43cb2da82d32ff75a8d5457b41c5/DeepSpeech/generate_alphabet.sh#L14-L16

[MDupdup (Malo Dupont)]

Effectively, piping the result of util/check_characters.py into alphabet.txt resolved the issue… I’d have never thought it’d come from there

Sorry for the newbie error!

Also, I will definitely have a look on commonvoice-fr so we can work better together.

Thanks again.

[lissyx ((slow to reply) [NOT PROVIDING SUPPORT])]

@MDupdup

I’d have never thought it’d come from there

Very much likely you have some UTF-8 character looking like ASCII one. Copy/pasting could kill it.

[MDupdup (Malo Dupont)]

I already thought of it and rewrote myself the letters without copy/pasting (via nano/gedit, or even outside the VM with VSCode) but it didn’t help at all

[Shady7]

@MDupdup

KeyError: “ERROR: Your transcripts contain characters (e.g. ‘c’) which do not occur in data/alphabet.txt! Use util/check_characters.py to see what characters are in your [train,dev,test].csv transcripts, and then add all these to data/alphabet.txt.”

I am getting a similar error but except for a letter I’m getting a whole sentence…I don’t why is it looking into a whole sentence…can anyone help?
My alphabet.txt contains all the alphabets a-z and space.

Here is the error I’m getting,
“ERROR: Your transcripts contain characters (e.g. ‘show me todays vitals’) which do not occur in data/alphabet.txt! Use util/check_characters.py to see what characters are in your [train,dev,test].csv transcripts, and then add all these to data/alphabet.txt.”

Ask for any specifications you think I’ll need to put to help resolve the issue.

[reuben]

@Shady7

Here is the error I’m getting,
“ERROR: Your transcripts contain characters (e.g. ‘show me todays vitals’) which do not occur in data/alphabet.txt! Use util/check_characters.py to see what characters are in your [train,dev,test].csv transcripts, and then add all these to data/alphabet.txt.”

What version of the training code are you using? Did you modify the code?

[MDupdup (Malo Dupont)]

Did you use the util/check_characters.py script located in the DeepSpeech project?

[Shady7]

@reuben

What version of the training code are you using?

I am using Deepspeech v0.7.0-alpha.2

@reuben

Did you modify the code?

Yes, in util/feeding.py on line 122 I changed from

df[‘transcript’] = df.apply(text_to_char_array, alphabet=Config.alphabet, result_type=‘reduce’, axis=1)

to

df[‘transcript’] = text_to_char_array(df, alphabet=Config.alphabet)

[Shady7]

@MDupdup

Did you use the util/check_characters.py script located in the DeepSpeech project?

Yes I did…I created alphabet.txt using the characters given by check_characters.py and still I am getting the error.

[MaestusUada (eren)]

can you check is there a white-space after characters ?