Sacra Logo
View PDF
Details
Headquarters
Palo Alto, CA
CEO
Rodrigo Liang
Website
Listed In
Home  >  Companies  >  SambaNova Systems
SambaNova Systems
SambaNova Systems combines custom AI hardware and software solutions to run large language models and AI workloads at high performance.

Valuation

$5.10B

2024

Funding

$1.13B

2024

Product

None

SambaNova Systems was founded in 2017 by Stanford professors Kunle Olukotun and Christopher Ré, along with former Oracle executive Rodrigo Liang. The founders set out to create a new type of AI chip architecture that could handle increasingly complex AI workloads more efficiently than traditional GPUs.

The company's core product, the SambaNova Suite, combines custom-designed AI chips with software that allows organizations to train and run large language models within their own data centers. Their dataflow architecture enables organizations to run multiple AI models simultaneously while using less power than traditional GPU clusters.

What sets SambaNova's technology apart is its ability to handle multiple AI workloads on a single system. For example, a bank can use the same SambaNova system to analyze financial documents, detect fraud patterns, and power customer service chatbots - all while keeping sensitive data within their own infrastructure. The system also allows organizations to fine-tune models on their private data without sending it to external cloud providers.

The company has since expanded its offering to include cloud-based options through their DataFlow-as-a-Service platform, enabling organizations to access SambaNova's AI capabilities without managing physical hardware.

Business Model

SambaNova Systems is a full-stack AI infrastructure company that generates revenue through hardware sales, professional services, and subscription-based access to its AI models and computing resources. The company's core offering combines proprietary AI chips with software and models optimized for enterprise deployment.

The business model is built around three main revenue streams. First, SambaNova sells its DataScale hardware systems powered by their custom chips to enterprises and government agencies seeking high-performance AI computing capabilities. Second, they offer professional services, which account for 25-33% of new customer engagements, including data preparation, model training, and optimization. Third, they provide subscription-based access to pre-trained foundation models and computing resources through their Dataflow-as-a-Service offering.

SambaNova's competitive advantage stems from their integrated approach that simplifies AI deployment for enterprises. Unlike competitors who focus solely on chips or software, SambaNova provides end-to-end solutions that include hardware, software, and services. This allows them to capture value across the entire AI stack while reducing implementation complexity for customers. Their land-and-expand strategy typically begins with hardware sales or subscription services, followed by professional services engagements that drive additional revenue and deepen customer relationships.

Competition

SambaNova Systems operates in the AI accelerator hardware and services market, competing across several distinct segments that have emerged as AI computing demands grow.

Traditional AI hardware manufacturers

NVIDIA dominates this space with roughly 85% market share through their H100 GPUs and CUDA software ecosystem. AMD and Intel represent the other major players, with AMD's MI300 series and Intel's Gaudi2 chips gaining traction. These companies focus on general-purpose AI acceleration through traditional chip architectures that can be clustered together.

Cloud AI infrastructure providers

Major cloud providers have developed proprietary AI chips to reduce NVIDIA dependence. Google's TPUs, Amazon's Trainium/Inferentia, and Microsoft's Maia target different aspects of AI workloads. These providers typically offer their chips as part of broader cloud services rather than selling hardware directly.

AI chip startups

Several well-funded startups are pursuing novel architectures for AI computation. Graphcore's Intelligence Processing Units (IPUs) target machine learning workloads, while Groq's tensor streaming processors focus on inference. Cerebras Systems takes a unique approach with wafer-scale technology that puts an entire AI system on a single massive chip.

The competitive dynamics are shifting as enterprises demand more efficient ways to train and deploy large language models. While NVIDIA's software ecosystem remains a significant moat, new entrants are finding success by focusing on specific workloads or deployment scenarios. The market increasingly values full-stack solutions that combine hardware, software, and services - evidenced by SambaNova's approach of offering pretrained models optimized for their hardware platform.

TAM Expansion

SambaNova Systems has tailwinds from the explosive growth in enterprise AI adoption and has the opportunity to expand into adjacent markets through inference optimization, industry-specific solutions, and cloud services delivery.

Enterprise AI infrastructure

The AI hardware market is projected to reach $250B by 2030, with enterprises increasingly seeking alternatives to NVIDIA's dominance. SambaNova's unique architecture, which enables 10x performance improvements at one-tenth the power consumption, positions them to capture share in this expanding market. Their full-stack approach, combining chips, software, and services, addresses the acute shortage of AI talent while simplifying deployment for enterprises.

Inference and deployment

While initially focused on training large language models, SambaNova can expand into the growing inference market through their partnership with Qualcomm. This allows them to offer end-to-end solutions for enterprises deploying AI models into production environments. The inference market is expected to exceed the training market in size, representing a significant expansion opportunity.

Industry solutions and cloud delivery

SambaNova can leverage their expertise in specific verticals like financial services, healthcare, and energy to develop pre-trained, industry-specific models. Their "composition of experts" architecture enables rapid customization for different use cases. By offering their technology through cloud services and subscription models, they can expand beyond high-end customers to reach mid-market enterprises that want AI capabilities without massive upfront investments. Their recent partnership with Saudi Aramco demonstrates the potential for industry-specific solutions at scale.

Risks

Dependency on open source models: SambaNova's Samba-1 platform relies heavily on integrating open source models like Llama and Mistral. If these models' performance or licensing terms change significantly, or if proprietary models become the clear industry standard, SambaNova's value proposition of bundling and optimizing open source models could be undermined. The company would need to either develop its own foundational models or negotiate costly licensing agreements.

Hardware commoditization risk: SambaNova's competitive advantage stems partly from its specialized AI chips that enable efficient multi-tenant model hosting. As NVIDIA and other chip makers advance their architectures to better handle multiple concurrent models, SambaNova's hardware differentiation could erode. This would pressure margins and force greater reliance on their software and services offerings.

Enterprise adoption complexity: SambaNova's full-stack approach requires enterprises to adopt both their hardware and software ecosystem. This creates a higher barrier to adoption compared to solutions that can integrate with existing infrastructure. While this strategy enables better performance, it may limit growth to only the largest enterprises willing to commit to a complete platform switch.

Funding Rounds

Share Name Issue Price Issued At
Series D-3 $95.02 Apr 2021
Series D-1 $95.02 Apr 2021
Series D-2 $95.02 Apr 2021
Series D $95.01804 Apr 2021
Share Name Issue Price Issued At
Series C-2 $53.24 Feb 2020
Series C-1 $53.24 Feb 2020
Series C $53.24146
Share Name Issue Price Issued At
Series B $22.06539 Apr 2019
Share Name Issue Price Issued At
Series A $6.51241 Jun 2018
Share Name Issue Price Issued At
Series Seed $0.78571 Sep 2017
View the source Certificate of Incorporation copy.

News

DISCLAIMERS

This report is for information purposes only and is not to be used or considered as an offer or the solicitation of an offer to sell or to buy or subscribe for securities or other financial instruments. Nothing in this report constitutes investment, legal, accounting or tax advice or a representation that any investment or strategy is suitable or appropriate to your individual circumstances or otherwise constitutes a personal trade recommendation to you.

This research report has been prepared solely by Sacra and should not be considered a product of any person or entity that makes such report available, if any.

Information and opinions presented in the sections of the report were obtained or derived from sources Sacra believes are reliable, but Sacra makes no representation as to their accuracy or completeness. Past performance should not be taken as an indication or guarantee of future performance, and no representation or warranty, express or implied, is made regarding future performance. Information, opinions and estimates contained in this report reflect a determination at its original date of publication by Sacra and are subject to change without notice.

Sacra accepts no liability for loss arising from the use of the material presented in this report, except that this exclusion of liability does not apply to the extent that liability arises under specific statutes or regulations applicable to Sacra. Sacra may have issued, and may in the future issue, other reports that are inconsistent with, and reach different conclusions from, the information presented in this report. Those reports reflect different assumptions, views and analytical methods of the analysts who prepared them and Sacra is under no obligation to ensure that such other reports are brought to the attention of any recipient of this report.

All rights reserved. All material presented in this report, unless specifically indicated otherwise is under copyright to Sacra. Sacra reserves any and all intellectual property rights in the report. All trademarks, service marks and logos used in this report are trademarks or service marks or registered trademarks or service marks of Sacra. Any modification, copying, displaying, distributing, transmitting, publishing, licensing, creating derivative works from, or selling any report is strictly prohibited. None of the material, nor its content, nor any copy of it, may be altered in any way, transmitted to, copied or distributed to any other party, without the prior express written permission of Sacra. Any unauthorized duplication, redistribution or disclosure of this report will result in prosecution.