Does TVM use NPU on Kirin970 chip?


#1

Some arm chips on the market have a neural processing unit (NPU).
e.g. RK3399Pro, Kirin970

Does TVM actually use NPU?
Does OpenCL driver use NPU?


#2

This is an interesting target, but we do not have any running examples that I know of. Do you happen to know some more details about the NPU (e.g., is it programmable, does it use a proprietary compiler)?


#3

Hi @eqy

https://drive.google.com/drive/folders/1AXsJK0bZ_j52Gh2PxKoYXNbnDdVdszme?usp=sharing

It’s all document about RK3399Pro. Can you help me check NPU?


#4

Hi @eqy,

This is an interesting target, but we do not have any running examples that I know of.

refer example below

Do you happen to know some more details about the NPU (e.g., is it >programmable, does it use a proprietary compiler)?

programmable, but not sure about its compiler.

Thanks!


#5

hi,@eqy , NPU will be the center role for efficiency . Is there any plan?


#6

it’s impossible to support Cambrian NPU which is on Kirin 970 if we don’t have Cambrian’s compiler and runtime support. anyone from Cambrian team can give some information.