Final results LPCNet + Tacotron2 (Spanish)

[carlfm01]

I could be wrong, but I think this noteboook might be what @carlfm01 had in mind: https://github.com/mozilla/TTS/blob/master/dataset_analysis/AnalyzeDataset.ipynb

You are correct, thanks for adding the link

I have a NVIDIA Tesla V100. ok i try I will try to do it and I tell you. Thank you

Thanks, the 16GB or 30GB version?

[manuel3265 (Manuel Garcia)]

@carlfm01 16GB version

[manuel3265 (Manuel Garcia)]

Hello @carlfm01.

I thank you for your answers, I already started with Tacotron training normally. I have another question.

Is it normal for audios generated in tacotron training to be heard like this?

http://www.mediafire.com/file/r7p3ggsbfqrqpud/step-2500-wave-from-mel.wav/file
(‘I’m still a new user’)

Thank you.

[carlfm01]

Please share your attention plot, sounds like the attention is broken.

[manuel3265 (Manuel Garcia)]

@carlfm01 this is my attention plot

[carlfm01]

feature_extract.sh

mkdir -p /home/manuel_garcia02/LPCNet/spanish/audio/
for i in /home/manuel_garcia02/LPCNet/spanish/s16/*.s16
do
./dump_data -test $i /home/manuel_garcia02/LPCNet/spanish/audio/$(basename “$i” | cut -d. -f1).npy
echo $i
done

header_removal.sh

Can you share a single file created by this script to see if it is correct? Try to use Mozilla Send

What about the silence at the beginning and at the end? long silence can damage the performance

Did you changed something?

[manuel3265 (Manuel Garcia)]

@carlfm01 this is an audio.

I can’t upload the file with Mozilla send. I’m still a new user.
https://transfer.sh/5kb14/audio-archivo-156579483968273.npy
I don’t change nothing

[carlfm01]

audio-archivo-156579483968273.zip (164,8 KB)

I’m able to synthesize your training file, thus your training format is correct, can be about transcription/audio quality, I mean wrong transcriptions or empty audio, like the last one you removed.

[manuel3265 (Manuel Garcia)]

The last thing I eliminated, they were audios with phrases too extensive. I used the erogol’s notebook and eliminated audio. these auidos
eliminated, if renian audio, worse ko could be processed, I do not know what it can be. After that, I had already trained tacotron without lpcnet. And this was the result.

Could it be that I took a workout that was already saved, before deleting the long sentences?

I think the problem is to resume training with different files. At this time, I executed a new training from scratch.

later I discuss the attention plot, when the 2 workouts understand at the same level of training

[carlfm01]

I executed a new training from scratch.

later I discuss the attention plot, when the 2 workouts understand at the same level of training

Ok, let’s wait.

Could it be that I took a workout that was already saved, before deleting the long sentences?

Yes, you need to delete the model trained with the wrong sentences.

[manuel3265 (Manuel Garcia)]

Hello @carlfm01
In fact, my attention plot doesn’t look like it used to. this is the current one.

but the audio is heard with the same noise as before.

[carlfm01]

Share the generated feature to test? Looks like it needs silence trimming at the end

[manuel3265 (Manuel Garcia)]

@carlfm01 This is an audio synthesized with tacotron, and processed with LPCNet.

https://transfer.sh/HvMt2/test-out.wav

[carlfm01]

Sounds good, but hard to tell if it needs more training with just 3 words, share a longer audio?

but the audio is heard with the same noise as before.

And the issue? How did you fix it?

[carlfm01]

Now I’m trying to adapt a new voice with just 3h using the pretrained model with the two old voices (Tux and Epachuko) with 10k steps
3h.zip (346,7 KB)

[manuel3265 (Manuel Garcia)]

the model still needs more training, when I have at least about 25 thousand steps, I will begin to carry out sentences with longer sentences.

The noise audio was an audio generated by tacotron, in the evaluation. these audios are still produced the same.

I appreciate all your support, all that is just your merits.

[manuel3265 (Manuel Garcia)]

@carlfm01 Have you tried to freeze the model?

[carlfm01]

Have you tried to freeze the model?

Yes, you need to use Tacotron_model/inference/add as output name

[manuel3265 (Manuel Garcia)]

@carlfm01 Could we talk through an email or other means,please?

[carlfm01]

Use the DM of the forum?