Does TVM use NPU on Kirin970 chip?

apivovarov · February 14, 2019, 10:42pm

Some arm chips on the market have a neural processing unit (NPU).
e.g. RK3399Pro, Kirin970

Does TVM actually use NPU?
Does OpenCL driver use NPU?

eqy · February 14, 2019, 10:50pm

This is an interesting target, but we do not have any running examples that I know of. Do you happen to know some more details about the NPU (e.g., is it programmable, does it use a proprietary compiler)?

pttoan88 · February 18, 2019, 10:26am

Hi @eqy

https://drive.google.com/drive/folders/1AXsJK0bZ_j52Gh2PxKoYXNbnDdVdszme?usp=sharing

It’s all document about RK3399Pro. Can you help me check NPU?

wei · June 22, 2019, 3:34am

Hi @eqy,

This is an interesting target, but we do not have any running examples that I know of.

refer example below

github.com

rockchip-linux/rknn-toolkit/blob/master/example/mobilenet_v1/test.py

import numpy as np
import cv2
from rknn.api import RKNN

def show_outputs(outputs):
    output = outputs[0][0]
    output_sorted = sorted(output, reverse=True)
    top5_str = 'mobilenet_v1\n-----TOP 5-----\n'
    for i in range(5):
        value = output_sorted[i]
        index = np.where(output == value)
        for j in range(len(index)):
            if (i + j) >= 5:
                break
            if value > 0:
                topi = '{}: {}\n'.format(index[j], value)
            else:
                topi = '-1: 0.0\n'
            top5_str += topi
    print(top5_str)

This file has been truncated. show original

Do you happen to know some more details about the NPU (e.g., is it >programmable, does it use a proprietary compiler)?

programmable, but not sure about its compiler.

Thanks!

nopattern · July 3, 2019, 4:02am

hi,@eqy , NPU will be the center role for efficiency . Is there any plan?

xqdan · July 3, 2019, 5:52am

it’s impossible to support Cambrian NPU which is on Kirin 970 if we don’t have Cambrian’s compiler and runtime support. anyone from Cambrian team can give some information.