As the VTA infrastructure is taking shape, we need to slide into the industry ecosystem, and be able to demonstrate viability. MLperf appears to be a reasonable path to take. I would like to start collaborating with folks that are working on VTA implementations to create an MLPerf capability for testing and measuring the performance of these VTA implementations.
Getting MLperf coverage on VTA and it’s variants should definitely be a target. I’ll be pushing coverage for more models once Relay support is upstreamed (almost there!). Let me know if you wish to get involved.
yes, please let me know where I can help