How to create a mmap-able model from the output_graph.pb file

DeepSpeech
#1

I can see from the readme file here: https://github.com/mozilla/DeepSpeech#making-a-mmap-able-model-for-inference

but i didnt understand this

TensorFlow has tooling to achieve this: it requires building the target //tensorflow/contrib/util:convert_graphdef_memmapped_format

where do i find this client to achieve this:

`convert_graphdef_memmapped_format --in_graph=output_graph.pb --out_graph=output_graph.pbmm`

i am not able to find this in the taskcluster as well. Not sure where to find this.

Please help in sharing the steps to complete this.

Thanks

1 Like
How to download convert graphdef memmapped format binary file in safari broswer?
#2

https://index.taskcluster.net/v1/task/project.deepspeech.tensorflow.pip.master.cpu/artifacts/public/convert_graphdef_memmapped_format

1 Like
#3

Thanks @lissyx for the quick reply.
I tried this command out which is given on readme file of deep speech.

But I am getting command not found.

How do I run this ?? Please let me know where I am going wrong.

Thanks

#4

I just gave you the file, download it ?

#5

I downloaded it and then I tried to run that command but it says command not found error.

#6

Try ./convert_graphdef_memmapped_format [...] ?! Like as usual when your binary is not in the PATH ?

#7

Yes that was the issue. Thanks.
Also I can use this mmap model.dorectly like how I use the regular model right ?? Or do I need to pass any new flags to achieve this ??

Thanks

#8

Just pass the different filename

#9

Thanks alot for your help.

1 Like
#10

Is that working properly now ? :slight_smile:

#11

Hi @lissyx,

I did download the file you mentioned in this thread and it is in my current directory path. This is the command I am giving,

convert_graphdef_memmapped_format --in_graph=models/output_graph_trained_model_2.pb --out_graph=model/output_graph.pbmm

But I am getting,

convert_graphdef_memmapped_format: command not found

I also used,

./convert_graphdef_memmapped_format --in_graph=models/output_graph_trained_model_2.pb --out_graph=model/output_graph.pbmm

even here I am getting the same error.
where am I going wrong?

Thanks :slight_smile:

#12

I really cannot help you for that, the error sugests that the binary is not here, but this is your system, I cannot do anything.

#13

After download, you have to add executable permission for the file:
chmod +x convert_graphdef_memmapped_format

Then you can invoke the local command as:
./convert_graphdef_memmapped_format <your args>

4 Likes
#14

How to use convert_graphdef_memmapped_format_lib.dms file in macOS ???

“convert_graphdef_memmapped_format.dms --in_graph=output_graph.pb --out_graph=output_graph.pbmm”

#15

That’s the same as on any unix system, as explained above. I don’t know where you get convert_graphdef_memmapped_format_lib.dms from, it’s convert_graphdef_memmapped_format

#16

(post withdrawn by author, will be automatically deleted in 24 hours unless flagged)

#17

@inforahul92 Well, I’m sorry, but this link is valid, and produces convert_graphdef_memmapped_format as expected. Now, if you are on macOS, then it’s not the proper link, and using util/taskcluster.py as documented should produce you this link https://index.taskcluster.net/v1/task/project.deepspeech.tensorflow.pip.master.osx/artifacts/public/convert_graphdef_memmapped_format

#18

It might be possible that you have to rename to .gz and then gunzip before use.

#19

No luck with this hack :frowning:

#20

“no luck” is not really helpful: you report “issues”, refer to a filename that makes no sense, but you share no error at all. I don’t use macOS, I can’t help you if you don’t give more context.