Turnkey AI inference solution for data centres

SambaNova has launched SambaManaged, said to be the industry’s first inference-optimized datacenter product offering, deployable in just 90 days — dramatically faster than the typical 18 to 24 months. Designed for rapid deployment, this modular product enables existing datacenters to immediately stand up AI inference services with minimal infrastructure modification.

As global AI inference demands soar, traditional datacenters grapple with lengthy deployment timelines of 18–24 months, extensive power requirements, and costly facility upgrades. SambaManaged addresses these critical barriers, enabling organizations to quickly launch profitable AI inference services leveraging existing power and network infrastructure.

“Data centers are struggling with power, cooling, and expertise challenges as AI demand grows,” said Abhi Ingle, Chief Product and Strategy Officer at SambaNova. “SambaManaged delivers high-performance AI with just 10kW of air-cooled power and minimal infrastructure changes—making rapid deployment simple for any data center.”

Key Advantages for Data Centers and Cloud Providers:

●        Unmatched Efficiency: Sets a new industry benchmark for performance per watt, maximizing return on investment and reducing total cost of ownership.

●        Rapid Deployment: Launch a fully managed AI inference service in as little as 90 days, minimizing integration challenges and accelerating time to value.

●        Open Model Flexibility: Achieve lightning-fast inference with leading open-source models, ensuring no vendor lock-in and future-proof operations.

●        Modular, Scalable Design: Scale from small to large deployments with ease, including the capability to build a 1 MW “Token Factory” (100 racks or 1,600 chips) or larger that scales with evolving business needs.

●        Managed or Self-Service Options: Choose a fully managed service or take over operations as internal expertise grows, supported by a customizable developer/enterprise UI and flexible pricing models.

SambaManaged is already being adopted by a major US public company with a large power footprint. The platform will deliver the highest throughput on DeepSeek and similar models, empowering them to maximize inference revenue while optimizing Power Usage Effectiveness (PUE).

“While others talk about the future of AI, we’re delivering it — today,” said Rodrigo Liang, CEO and co-founder of SambaNova. “SambaManaged is a game-changer for organizations that want to accelerate their AI initiatives without compromising on speed, scale, or efficiency. Anywhere you have power and networking, we can bring your AI infrastructure online in record time.”

Standard Chartered teams up with Alibaba Group to leverage AI technologies, enhancing operations...
IFS introduces a new Emissions Management module in partnership with Climatiq to embed...
ACTFORE secures a pioneering patent in the data mining field, revolutionising breach response with...
A new vision for AI design emphasises the importance of humanities and cultural understanding for...
Confluent announces a $200 million investment to enhance its partner ecosystem, driving innovation...
Arctera unveils updates to help organisations manage AI compliance risks through capture,...
Parallel Works introduces its ACTIVATE AI Partner Ecosystem, enhancing AI infrastructure with...
Korean researchers develop a cutting-edge NPU core enhancing generative AI performance by over 60%...