I use evaluate.py to batch process a dataset and I want to compare how results differ when I plug different language models. To achieve this I have changed evaluate.py to output the full report (all results) as a simple CSV (just changed the print format). I plan to import the data from different CSVs as tables and join them. Unfortunately, there is no column of unique values.
The filenames would work perfectly, however I cannot figure out how to extract them from the TF iterator that consumes the dataset or how to match them to results if I manually import them as a list.
Any ideas for a straightforward solution to include filenames in the report produced by evaluate.py?
lissyx
((slow to reply) [NOT PROVIDING SUPPORT])
2
I am using v0.5.1 and there was a small change I had to do. Line 60 of evaluate.py had to be deleted as it complained create_model() was getting an extra argument: