Infery is Deci’s Python runtime engine that lets you run inference locally or on edge devices with only 3 simple commands. In this quick tutorial, Ofer Baratz, technical product manager at Deci, walks you through installing Infery, loading your trained model, and running inference and benchmark tests.
You can read the documentation here.