Key Highlights

  • Broadcom (NASDAQ: AVGO) reports private cloud AI revenue grew over 70% year-over-year, its fastest segment ever.
  • Enterprises are shifting AI inference to private clouds, with 56% now preferring on-premises solutions.
  • Data sovereignty, latency, and cost concerns at scale are driving this migration from public clouds.
  • Dell Technologies (NYSE: DELL) and Hewlett Packard Enterprise (NYSE: HPE) stand to benefit from infrastructure demand.
  • Valuations for private cloud infrastructure providers appear more attractive than for pure-play AI cloud firms.

The On-Premises AI Revolution

A significant shift in artificial intelligence deployment is underway, with large enterprises increasingly favouring private cloud infrastructure over public cloud offerings. Recent disclosures from Broadcom reveal that its private cloud AI revenue experienced a remarkable surge of over 70% year-over-year, marking it as the fastest-growing segment in the company's history. This data point provides the first concrete evidence that enterprises are actively moving AI workloads on-premises, a trend driven by critical considerations such as data sovereignty, reduced latency requirements for sophisticated applications, and the economic efficiencies of managing AI at scale internally.

This move challenges the long-held assumption that public cloud providers like Amazon Web Services (AWS), Microsoft Azure, and Google Cloud would be the sole beneficiaries of the AI boom. The implications are profound, suggesting a recalibration of the entire AI ecosystem and its associated supply chains.

Quantifying the Tipping Point

The "tipping point" for private cloud AI is not merely anecdotal; it is quantifiable through the financial performance of companies enabling this transition. Broadcom's management highlighted that its private cloud AI segment, powered by custom ASICs and the VMware software stack, is not only growing at an accelerated rate but also achieving profit margins significantly higher than those associated with public cloud equivalents. This suggests a more favourable unit economics for on-premises AI deployments.

Furthermore, a recent outlook report indicates that 56% of enterprises are now shifting AI inference workloads to private clouds, a 15-percentage-point downgrade from their previous reliance on public cloud services. This decisive move towards private infrastructure underscores a strategic re-evaluation by businesses concerning the placement of their most sensitive and performance-critical AI operations, as noted by industry analysis.

Winners in the Infrastructure Race

This burgeoning demand for private cloud AI infrastructure positions companies like Dell Technologies and Hewlett Packard Enterprise as key beneficiaries. These firms are central to providing the server and networking hardware essential for enterprise-grade private AI deployments. As these on-premises AI solutions scale at rates previously only seen among hyperscale public cloud providers, the hardware backbone supplied by Dell and HPE becomes increasingly critical.

The investment narrative around these companies is further enhanced by their current valuation metrics. While pure-play AI cloud companies often trade at price-to-earnings ratios in the 28-30x range, Dell and HPE are valued at a more conservative 12-14x P/E. This suggests that the market may not have fully priced in the substantial growth potential driven by the private cloud AI migration.

Broader Strategic Drivers

Beyond the immediate technological and financial metrics, several broader strategic factors are accelerating the enterprise embrace of private cloud AI. Geopolitical considerations are playing an increasingly significant role, prompting many organisations to seek greater control over their data and infrastructure to mitigate risks associated with international data regulations and potential supply chain disruptions. The imperative to keep sensitive data within national borders or under direct corporate control is a powerful motivator for on-premises deployments.

Moreover, as AI applications mature and move from experimental phases to production environments, the need for predictable performance, enhanced security, and tailored configurations becomes paramount. Private clouds offer a more customisable and controlled environment, allowing enterprises to fine-tune their AI infrastructure to meet specific business objectives and regulatory requirements, thereby solidifying the private cloud's role as the strategic core of enterprise IT.

Investment Recalibration

The observable shift towards private cloud AI necessitates a recalibration of investment strategies. Investors looking for exposure to the AI revolution may find compelling opportunities beyond the highly valued public cloud giants. The robust growth in private cloud AI, coupled with the more attractive valuations of infrastructure providers like Broadcom, Dell, and HPE, presents a potentially more advantageous risk-reward profile.

This trend suggests that the AI narrative is diversifying, moving beyond a singular focus on public cloud dominance. As enterprises solidify their commitment to on-premises AI, the demand for the hardware, software, and integration services that underpin these private clouds is set to expand significantly, offering a compelling case for a more balanced approach to AI investment.