While make inference was always 58 seconds

I make use this notebook:

I replace with my model. Last block, is make inference. Why is length 58 seconds if sentence very short?

Thanks you.

Decoder can not β€žfindβ€œ the end and stops eventually at the maximum decoder step - which is set to 1280000 in your case, a quite high value. You can try to add a β€ž.β€œ at the end of your phrase. You also can try to set max_devoder_steps to a lower value.


Thanks you very much.