CUDA model compiled can not be invoked for inference on Jetson

Questions
#1

Hi All,

Host
Windows 8.1 64bit
CUDA 10.0
CUDNN 7
LLVM 8.0 (biuld from source successfully)
TVM 0.6dev
PYTHON 3.5
GPU RTX 2070
Device
Jetson Nano Ubuntu18.04 (aarch64-linux-gnu)
CUDA 10.0
CUDNN 7
TVM 0.6dev (TVM Runtime built with CUDA)
PYTHON 3.6
GPU 128-core Maxwell
CPU Quad-core ARM A57 @ 1.43 GHz

CPU model can be compiled on PC and invoked for reference successfully on Jetson Nano.

Though CUDA model can be compiled successfully on PC , It’s aborted with error as below when inference.

RuntimeError: Compilation error:
/tmp/tmpyrgrc0ue/lib.o: file not recognized: File format not recognized

I tried a lot , but no lucky. How to find the problem?
Help me please! thanks !

#2

I had the same issue and resolved it by adding the missing target_host parameter of the build function.

You can get the desired value by executing “gcc -v” on your board and look for the “Target” field. For example, in the case of a Raspberry Pi 4 instead of a Jetson Nano, you would get “arm-linux-gnueabihf” and so pass target_host=“arm-linux-gnueabihf” to the build function.

1 Like