Building ds-ctcdecoder on RaspberryPi?

DeepSpeech
#28

I did make some progress, my network now requires tflite-runtime only, but the ds-ctcdecoder is not yet working. I was able to cross-build it and install a copy of it on my raspbian container image, but when I try to import it I get following error:

ImportError: cannot import name '_swigwrapper' from 'ds_ctcdecoder'

I did follow the steps from https://github.com/mozilla/DeepSpeech/issues/3379, built swig on the raspi and replaced the original ds-swig directory with it.

In the build process it seems the wrapper is added, but was built with the wrong architecture:

creating temp_build/temp_build/ds_ctcdecoder-0.10.0a3.dist-info/WHEEL
creating 'dist/ds_ctcdecoder-0.10.0a3-cp37-cp37m-linux_armv7l.whl' and adding 'temp_build/temp_build' to it
adding 'ds_ctcdecoder/__init__.py'
adding 'ds_ctcdecoder/_swigwrapper.cpython-37m-x86_64-linux-gnu.so'
adding 'ds_ctcdecoder/swigwrapper.py'

I did start the build with make TARGET=rpi3 NUM_PROCESSES=$(nproc) bindings and I think the error is related to this build step:

/DeepSpeech/tensorflow/bazel-tensorflow/external/LinaroArmGcc72/bin/arm-linux-gnueabihf-c++ -pthread -shared -Wl,-O1 -Wl,-Bsymbolic-functions -Wl,-Bsymbolic-functions -Wl,-z,relro -Wl,--no-as-needed -march=armv7-a -mtune=cortex-a53 -mfpu=neon-fp-armv8 -mfloat-abi=hard -D_GLIBCXX_USE_CXX11_ABI=0 --sysroot /DeepSpeech/multistrap-raspbian-buster -march=armv7-a -mtune=cortex-a53 -mfpu=neon-fp-armv8 -mfloat-abi=hard -D_GLIBCXX_USE_CXX11_ABI=0 --sysroot /DeepSpeech/multistrap-raspbian-buster -Wdate-time -D_FORTIFY_SOURCE=2 temp_build/temp_build/swigwrapper_wrap.o -o temp_build/temp_build/ds_ctcdecoder/_swigwrapper.cpython-37m-x86_64-linux-gnu.so first_party.a third_party.a

Do you know if there is some flag I did miss? Or something other I can change?

#29

You are doing something wrong, see the x86-64 here. We have some hack in place in definitions.mk to fix that

#30

It’s related to this: https://github.com/mozilla/DeepSpeech/blob/master/native_client/definitions.mk#L105

But you will likely have to read more of the makefiles and hack around, sorry.

#31

What exactly do I need to change in the line you linked? And shouldn’t it be that line: https://github.com/mozilla/DeepSpeech/blob/master/native_client/definitions.mk#L86?

The wrong .so file is created somewhere in here: https://github.com/mozilla/DeepSpeech/blob/dd4122a04a084a7a60f27f3c592b2a1153dc20b4/native_client/ctcdecode/setup.py#L70

This is called from here: https://github.com/mozilla/DeepSpeech/blob/8f9d6ad02467bdf79e9e150a41fb1ddbd8eabfaa/native_client/ctcdecode/Makefile#L48

The logged cmd is
DISTUTILS_USE_SDK=1 PATH=/DeepSpeech/native_client/ds-swig/bin:/DeepSpeech/tensorflow/bazel-tensorflow/external/LinaroArmGcc72/bin/arm-linux-gnueabihf-:$PATH SWIG_LIB="/DeepSpeech/native_client/ds-swig/share/swig/4.0.2/" AS=/DeepSpeech/tensorflow/bazel-tensorflow/external/LinaroArmGcc72/bin/arm-linux-gnueabihf-as CC=/DeepSpeech/tensorflow/bazel-tensorflow/external/LinaroArmGcc72/bin/arm-linux-gnueabihf-gcc CXX=/DeepSpeech/tensorflow/bazel-tensorflow/external/LinaroArmGcc72/bin/arm-linux-gnueabihf-c++ LD=/DeepSpeech/tensorflow/bazel-tensorflow/external/LinaroArmGcc72/bin/arm-linux-gnueabihf-ld LIBEXE=/DeepSpeech/tensorflow/bazel-tensorflow/external/LinaroArmGcc72/bin/arm-linux-gnueabihf- CFLAGS="-march=armv7-a -mtune=cortex-a53 -mfpu=neon-fp-armv8 -mfloat-abi=hard -D_GLIBCXX_USE_CXX11_ABI=0 --sysroot /DeepSpeech/multistrap-raspbian-buster -march=armv7-a -mtune=cortex-a53 -mfpu=neon-fp-armv8 -mfloat-abi=hard -D_GLIBCXX_USE_CXX11_ABI=0 --sysroot /DeepSpeech/multistrap-raspbian-buster " LDFLAGS="-Wl,--no-as-needed" PYTHONPATH=/DeepSpeech/multistrap-raspbian-buster/usr/lib/python3.7/:/DeepSpeech/multistrap-raspbian-buster/usr/lib/python3/dist-packages/ NUMPY_INCLUDE=/DeepSpeech/multistrap-raspbian-buster/usr/include/python3.7m/ python ./setup.py build_ext --num_processes 16 --plat-name linux_armv7l

For me the paths and architecture seem to be correct.

#32

Nothing

There is no sysconfig info passed, see the calling code on the python binding: https://github.com/mozilla/DeepSpeech/blob/8f9d6ad02467bdf79e9e150a41fb1ddbd8eabfaa/native_client/python/Makefile#L13

#33

As you can see, no $(PYTHON_SYSCONFIGDATA) on the ctcdecode part (which is not surprising, since we don’t support this).

I guess adding that should be enough, but I can’t guarantee anything since I have no time to actually check.

#34

Thanks. If I add the flag to the Makefile line, it tries to build ds_ctcdecoder/_swigwrapper.cpython-37m-arm-linux-gnueabihf.so, but now it doesn’t find swig anymore.

swig -python -c++ -extranative -o swigwrapper_wrap.cpp swigwrapper.i
unable to execute 'swig': No such file or directory

A few log lines before calling the changed line, swig was working:

swig -version
SWIG Version 4.0.2
Compiled with g++ [armv7l-unknown-linux-gnueabihf]

Do you have an idea for that too?

#35

Found the solution. Had to link the files from ds-swig to /usr/bin/ that I can use swig system wide.

#36

The created ds_ctcdecoder.whl is now working in my raspbian container:)

Will do some cleanup and then share all the build steps…

#37

That’s likely an oversight, it should not be required if you have it under ds-swig or there’s something else messing with your PATH

Nice. Overall, I guess it was not “that” complicated, just a bit of stuff spreads here and there?

#38

Hmm, as someone who had no idea what he was doing, and one solved error resulted in another error, I’m sorry, but I have to disagree with you here :smile:. Thank you very much for your help:)
I was glad that I did the building from inside a container, because that way I could just restart the container everytime I messed up the system :laughing:

#39

The build steps and output files can be found here: https://gitlab.com/Jaco-Assistant/deepspeech-polyglot/-/tree/dspol/extras/misc
Use at your own risk, this is not officially supported from me or the DeepSpeech team.

#40

While this is nice of you and it probably serves as notes for you, I’d really like we warn people this is not something the project supports. It’s not unusual people come here to complain about “this” and we discover later that “this” is not made by us (and is wrong) and cover unsupported things.

#41

Did update the text. Totally understand that, the full code is in my project’s unsupported experiments section, too.

#42

See I was not wrong, I believe this is leading to that kind of noise on Gitub :confused: https://github.com/mozilla/DeepSpeech/issues/3529

Although if you properly state this is handled by you, i’m not sure what can be done more …

#43

Nice job. I know my feeling, when I tried to get it run on our ppc64le. :slight_smile:

I took a look into your Containerfile_DecoderCrossbuild1.
You ran
RUN wget http://prdownloads.sourceforge.net/swig/swig-4.0.2.tar.gz

According to @lissyx comments on my ppc64le build one should use
https://github.com/lissyx/swig/tree/taskcluster or is this not an issue here?
However, I also did not have any problems with official swig. :grin:
Just as a remark for your next build.

1 Like
#44

As far as I did understand, lissyx fork is only required for NodeJs

#45

Technically, yes, but 4.x branch also fixes some Java and Python leaking and upgrades the code, so it’s better to avoid mixing versions here to limit the risks of support / bugs.

#46

Hi i’m trying to install ds_ctcdecoder on my raspberry pi with pip but i get the error like no maching distribution found for ds_ctcdecoder, could you find a solution for installing?

#47

You should be able to use this one (The link from above, but it was moved): https://gitlab.com/Jaco-Assistant/Scribosermo/-/blob/master/extras/misc/ds_ctcdecoder-0.10.0a3-cp37-cp37m-linux_armv7l.whl

-------- Original-Nachricht --------

1 Like