Matmul op for relay


#1

Feel free to close the topic. Just wanna know the reason why we don’t implement matmul op for relay, I know we can use dense instead, is there any other reason?


#2

What’s the diff between the two? bias?


#3

yup, bias. Y = XW^T + b


#4

I guess that you don’t have to provide the bias term, so that dense degenerates to matmul.


#5

yeah, dense will do the same thing as matmul without specifying bias. I like the name tvm.relay.matmul more than tvm.relay.nn.dense for matrix mulitiplication. Anyway, dense is good.


#6

Sure. That sounds reasonable.


#7

I guess I misread relay for topi…anyway…


#8

We could expose matmul as a synonym. I think this might actually be a good idea, the overloaded use of dense has confused many users (including me when I started working on TVM).


#9

thanks, I agree. Confused me, too


#10

I will send out a pr to expose matmul then