I tried to compile and run resnet50_v2 model with relay with avx512 on i7 cpu which only supports avx2.
frontend = 'relay' model_name = 'resnet50_v2' target = 'llvm -mcpu=skylake-avx512'
If I tried March 31st TVM version (commit
model.run() fails as expected with
Illegal instruction (core dumped)
But if I try April 17th version (
12257ddd2d2ee3a9bd58b7f92c4a66d9cca4fa45) then it works.
Performance is similar to llvm without any flags
I guess the latest TVM relay does not use avx2 or avx512 for model compilation at all.
I also tried the same test with
nnvm frontend - model.run() fails for both April 17th and March 31st tvm versions. So, the issue with avx exists only in relay but not in nnvm.