The most advanced inference SDK
for LLM optimization and deployment 🚀
Use Deci’s open source generative AI models to:
✅ Run inference 15x faster & retain your desired accuracy
✅ Cut your compute cost by 70%
✅ Deploy large models on more widely available GPUs
Infery includes unique features such as optimized kernels, continuous batching, advanced selective quantization, ultra-efficient beam search, parallel execution, and more.
📩 Sign Up Now for a Personalized Demo!
from transformers import AutoFeatureExtractor, AutoModelForImageClassification
extractor = AutoFeatureExtractor.from_pretrained("microsoft/resnet-50")
model = AutoModelForImageClassification.from_pretrained("microsoft/resnet-50")