Dear Support
I have a training session, and validation session. afterwards comes test before the export of the model. I am facing this crash. Can you guess, how to resolve this.
I Restored variables from best validation checkpoint at /home/user/data/checkpoints_test01/best_dev-20326, step 20326
Testing model on /home/user/data/test.csv
Test epoch | Steps: 0 | Elapsed Time: 0:00:00
Test epoch | Steps: 1 | Elapsed Time: 0:00:36
Test epoch | Steps: 2 | Elapsed Time: 0:00:51
Traceback (most recent call last):
File "/home/user/.local/lib/python3.6/site-packages/tensorflow_core/python/client/session.py", line 1365, in _do_call
return fn(*args)
File "/home/user/.local/lib/python3.6/site-packages/tensorflow_core/python/client/session.py", line 1350, in _run_fn
target_list, run_metadata)
File "/home/user/.local/lib/python3.6/site-packages/tensorflow_core/python/client/session.py", line 1443, in _call_tf_sessionrun
run_metadata)
tensorflow.python.framework.errors_impl.InvalidArgumentError: Not enough time for target transition sequence (required: 52, available: 49)4You can turn this error into a warning by using the flag ignore_longer_outputs_than_inputs
[[{{node CTCLoss}}]]
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "DeepSpeech.py", line 976, in <module>
absl.app.run(main)
File "/home/user/.local/lib/python3.6/site-packages/absl/app.py", line 299, in run
_run_main(main, args)
File "/home/user/.local/lib/python3.6/site-packages/absl/app.py", line 250, in _run_main
sys.exit(main(argv))
File "DeepSpeech.py", line 953, in main
test()
File "DeepSpeech.py", line 686, in test
samples = evaluate(FLAGS.test_files.split(','), create_model, try_loading)
File "/home/user/soft/DeepSpeech/evaluate.py", line 155, in evaluate
samples.extend(run_test(init_op, dataset=csv))
File "/home/user/soft/DeepSpeech/evaluate.py", line 116, in run_test
session.run([batch_wav_filename, transposed, loss, batch_x_len, batch_y])
File "/home/user/.local/lib/python3.6/site-packages/tensorflow_core/python/client/session.py", line 956, in run
run_metadata_ptr)
File "/home/user/.local/lib/python3.6/site-packages/tensorflow_core/python/client/session.py", line 1180, in _run
feed_dict_tensor, options, run_metadata)
File "/home/user/.local/lib/python3.6/site-packages/tensorflow_core/python/client/session.py", line 1359, in _do_run
run_metadata)
File "/home/user/.local/lib/python3.6/site-packages/tensorflow_core/python/client/session.py", line 1384, in _do_call
raise type(e)(node_def, op, message)
tensorflow.python.framework.errors_impl.InvalidArgumentError: Not enough time for target transition sequence (required: 52, available: 49)4You can turn this error into a warning by using the flag ignore_longer_outputs_than_inputs
[[node CTCLoss (defined at /home/user/.local/lib/python3.6/site-packages/tensorflow_core/python/framework/ops.py:1748) ]]
Original stack trace for 'CTCLoss':
File "DeepSpeech.py", line 976, in <module>
absl.app.run(main)
File "/home/user/.local/lib/python3.6/site-packages/absl/app.py", line 299, in run
_run_main(main, args)
File "/home/user/.local/lib/python3.6/site-packages/absl/app.py", line 250, in _run_main
sys.exit(main(argv))
File "DeepSpeech.py", line 953, in main
test()
File "DeepSpeech.py", line 686, in test
samples = evaluate(FLAGS.test_files.split(','), create_model, try_loading)
File "/home/user/soft/DeepSpeech/evaluate.py", line 73, in evaluate
sequence_length=batch_x_len)
File "/home/user/.local/lib/python3.6/site-packages/tensorflow_core/python/ops/ctc_ops.py", line 176, in ctc_loss
ignore_longer_outputs_than_inputs=ignore_longer_outputs_than_inputs)
File "/home/user/.local/lib/python3.6/site-packages/tensorflow_core/python/ops/gen_ctc_ops.py", line 336, in ctc_loss
name=name)
File "/home/user/.local/lib/python3.6/site-packages/tensorflow_core/python/framework/op_def_library.py", line 794, in _apply_op_helper
op_def=op_def)
File "/home/user/.local/lib/python3.6/site-packages/tensorflow_core/python/util/deprecation.py", line 507, in new_func
return func(*args, **kwargs)
File "/home/user/.local/lib/python3.6/site-packages/tensorflow_core/python/framework/ops.py", line 3357, in create_op
attrs, op_def, compute_device)
File "/home/user/.local/lib/python3.6/site-packages/tensorflow_core/python/framework/ops.py", line 3426, in _create_op_internal
op_def=op_def)
File "/home/user/.local/lib/python3.6/site-packages/tensorflow_core/python/framework/ops.py", line 1748, in __init__
self._traceback = tf_stack.extract_stack()
Your advise will aid my way to proceed with this data.