[AutoTVM] Vulkan much slower than CPU on Pixel 3

I’ve been doing some autotuning on a Pixel 3 and have consistently found that even after a full tuning pass, Vulkan is 2-5 times slower than just running on CPU. This is pretty surprising to me. Is there any special type of convolution or tuning procedure that’s needed to better leverage Vulkan?

As far as I know, we have not yet look into the vulkan optimization, so there might be some gaps in the gpu templates

1 Like