We recently open sourced an ahead of time compiler for Relay programs.
The ahead of time compiler produces a native library given a Relay expression, and
dynamically loads it and wraps it in Python. This makes it possible to easily/compile/deploy
A few optimizations are still to be implemented, they will likely land with the VM,
and VM compiler, specifically ones around memory planning.
I encourage everyone to checkout the compiler, open issues, or follow up
with questions about how to use it.