This innovative leap in code generation, powered by a 1B-parameter LLM, sets the bar for unprecedented efficiency and performance
TEL AVIV, Israel, August 16, 2023 — Deci, the deep learning company harnessing AI to build AI, today released DeciCoder, its inaugural foundation model in generative AI helping users generate programming language code. This groundbreaking Large Language Model (LLM), dedicated to code generation with 1 billion parameters and an expansive 2048-context window, surpasses results released in equivalent models and effectively redefines the standards of efficient code generation.
DeciCoder’s unmatched throughput and low memory footprint enables teams to achieve extensive code generation with low latency, and migrate workloads to more affordable and widely available GPUs such as the NVIDIA A10G, resulting in substantial cost savings. When DeciCoder was benchmarked on Hugging Face Inference Endpoints against well-established code LLMs such as SantaCoder, DeciCoder showcased a 22% increase in throughput, a significant reduction in memory usage, and a 1.5-2.4 percentage point improvement in accuracy on the HumanEval benchmark. Notably, when combining DeciCoder with Deci’s LLM inference acceleration library, Infery, its throughput outperforms that of SantaCoder by 350%.
“From enabling the fastest and most cost-efficient deployment for enterprises, to now branching into generative AI, we are relentlessly pushing boundaries and empowering developers with the advanced models and tools needed to effectively implement AI-powered applications across industries,” said Yonatan Geifman PhD, CEO & co-founder of Deci. “Utilizing DeciCoder means less operations during inference, which translates to lower computational costs.”
DeciCoder was generated using Deci’s proprietary Automated Neural Architecture Construction (AutoNAC) engine, the most advanced Neural Architecture Search (NAS)-based technology on the market. AutoNAC identifies the ideal architecture that strikes a perfect balance between accuracy and processing speed, tailored for distinct data features, tasks, performance goals, and inference environment. Deci’s AutoNAC has generated some of the world’s most efficient computer vision and NLP models such as YOLO-NAS, DeciBERT and DeciSeg, among others.
The rollout of DeciCoder is the first in a series of the highly anticipated releases outlining Deci’s Generative AI offering, which are due to be released in the coming weeks. DeciCoder and its pre-trained weights are available under the permissive Apache 2.0 License, granting developers broad usage rights and positioning the model for real-world, commercial applications.
To gain early access to Deci’s Infery and upcoming generative models, please visit https://deci.ai/get-early-access-deci-generative-ai/
This announcement was originally published on Cision PRWeb.
