Global AI Server Shipments Forecasted to Increase 40% in 2023 amid Rising AI Demand
May 31, 2023 | TrendForceEstimated reading time: 2 minutes
TrendForce predicts a dramatic surge in AI server shipments for 2023, with an estimated 1.2 million units—outfitted with GPUs, FPGAs, and ASICs—destined for markets around the world, marking a robust YoY growth of 38.4%. This increase resonates with the mounting demand for AI servers and chips, resulting in AI servers poised to constitute nearly 9% of the total server shipments, a figure projected to increase to 15% by 2026. TrendForce has revised its CAGR forecast for AI server shipments between 2022 and 2026 upwards to an ambitious 22%. Furthermore, AI chip shipments in 2023 are slated to increase by an impressive 46%.
TrendForce analysis indicates that NVIDIA’s GPUs currently dominate the AI server market, commanding an impressive 60–70% market share. Hot on its heels are ASIC chips, independently developed by CSPs, seizing over 20% of the market. Three crucial factors fuel NVIDIA’s market dominance: First, NVIDIA’s A100 and A800 models are sought after by both American and Chinese CSPs. Interestingly, the demand curve for 2H23 is predicted to gradually tilt towards the newer H100 and H800 models. These models carry an ASP that’s 2–2.5 times that of the A100 and A800, amplifying their allure. Furthermore, NVIDIA isn’t resting on its laurels; it’s proactively bolstering the appeal of these models through aggressive promotion of its self-developed machine solutions, such as DGX and HGX.
Second, the profitability of high-end GPUs, specifically the A100 and H100 models, plays a vital role. TrendForce research suggests that NVIDIA’s supreme positioning in the GPU market allows for a significant price variation of the H100, which could amount to a stark difference of nearly US$5,000, depending on the buyer’s purchase volume.
Lastly, the pervasive influence of ChatBOTs and AI computations is predicted to persist, expanding its footprint across various professional fields such as cloud and e-commerce services, intelligent manufacturing, financial insurance, smart healthcare, and advanced driver-assistance systems as we move into the latter half of the year. Simultaneously, there’s been a noticeable upswing in demand for AI servers—particularly cloud-based ones equipped with 4–8 GPUs and edge AI servers boasting 2–4 GPUs. TrendForce forecasts an annual growth rate surprising 50% in the shipment of AI servers armed with NVIDIA’s flagship A100 and H100 models.
TrendForce reports that HBM, a high-speed RAM interface deployed in advanced GPUs, is poised for a significant uptick in demand. The forthcoming H100 GPU from NVIDIA, slated for release this year, is equipped with the faster HBM3 technology. This improvement over the previous HBM2e standard amplifies the computation performance of AI server systems. As the need for cutting-edge GPUs—including NVIDIA’s A100 and H100, AMD’s MI200 and MI300, and Google’s proprietary TPU—continues to escalate, TrendForce forecasts a striking 58% YoY increase in HBM demand for 2023, with an estimated further boost of 30% expected in 2024.
Suggested Items
Mycronic Releases Interim Report January–March 2024
04/18/2024 | MycronicNet sales increased 39 percent to SEK 1,692 (1,219) million. Based on constant exchange rates, net sales increased 42 percent.
Real Time with... IPC APEX EXPO 2024: Exploring Silicone Solutions with R&D Director of CHT
04/17/2024 | Real Time with...IPC APEX EXPOIn this interview, Gerry Ellis, the R&D director for CHT, discusses the product range offered by his company. He explains the challenges in creating base formulations, the drive to make products more user-friendly, and the various application techniques involved. Ellis also highlights the key market segments and the significance of providing efficient solutions to customers.
Gartner Forecasts Worldwide IT Spending to Grow 8% in 2024
04/17/2024 | Gartner, Inc.Worldwide IT spending is expected to total $5.06 trillion in 2024, an increase of 8% from 2023, according to the latest forecast by Gartner, Inc. This is an increase from the previous quarter’s forecast of 6.8% growth and puts worldwide IT spending on track to surpass $8 trillion well before the end of the decade.
Catching Up With Chasom Electronics
04/16/2024 | Dan Beaulieu, D.B. Management GroupI recently met with Chasom Electronics’ founding director Anil Kumar. Chasom offers a unique menu of services for companies looking to extend their technology capabilities on a short- or long-term basis. Read on to learn about this very unique service company.
Cicor Records Solid Growth in Q1
04/16/2024 | CicorThe Cicor Group continued to grow in the first three months of the year. Quarterly sales increased by 11.8% to CHF 107.3 million compared to the first quarter of the previous year (Q1/2023: CHF 96.0 million).