When we are saving the shared library then .o files are being passed to form a .so file. There should be a .h file also for linking. Where can I get that .h file?
There is no header. We dynamically load a shared lib at runtime using a wrapper over OS API (dlopen or LoadLibrary). See here for an example of c++ api usage.
Pardon me if my questions are vague, but how then will be able to get the prototype of the function that we have used to compute something in scheduling?
When you compile your model, you should know the number of input tensors, and the name of each tensor (“data”, “x” etc). That’s all you need to know to use C++ api.