In reference to @tqchen’s previous RFC on ahead-of-time (AoT) compilation, I believe we should consider incorporating the already-existing Relay AoT compiler, mostly written by @MarisaKirisame, into TVM’s codebase as a potential step towards achieving the goals outlined in the previous RFC.
The tool was originally kept separate from the TVM codebase because it was built for rapidly changing research goals, but it has been stable in its current form since April. Having the tool in the official TVM codebase and incorporated in the CI will help ensure that it does not break and make it more easily available for TVM users. Additionally, having more members of the community give feedback about the AoT compiler’s interfaces and implementation would help resolve design issues with it and potentially address low-level bugs arising due to interactions with changing APIs. I think that simply having the existing (quite compact) AoT compiler in the codebase would be useful as a concrete starting point for iterating on the goals in the previous RFC.
Note that the Python debug converter was based on the AoT compiler, so we could potentially restructure the AoT compiler to deduplicate code between these and allow for further extension.