Hi, I’m attempting to integrate Arm Compute Library using the external c-codegen route but I’m running into an issue within codegen where I would like to declare weights as constant. Currently, it seems a relay sub-graph used in c-codegen is expected to have weights (and other tensors) declared as variables rather than as constants. I assume this is so that they can be treated like normal inputs to the subgraph. However, this means I cannot perform passes like constant folding of layout_transform operators on the sub-graph.
I’ve been looking into ways to overcome this, but the only solution I can think of is to output these tensors directly into the codegen stream. This would be ok for very small tensors, however weight tensors can get very large for graphs like VGG16. I was wondering if there was any way around this?