Ayar Labs to Accelerate Development, Application of Optical Interconnects in AI/Machine Learning Architectures with NVIDIA


Reading time ( words)

Ayar Labs, the leader in chip-to-chip optical connectivity, is developing with NVIDIA groundbreaking artificial intelligence (AI) infrastructure based on optical I/O technology to meet future demands of AI and high performance computing (HPC) workloads. The collaboration will focus on integrating Ayar Labs’ technology to develop scale-out architectures enabled by high-bandwidth, low-latency and ultra-low-power optical-based interconnects for future NVIDIA products. Together, the companies plan to accelerate the development and adoption of optical I/O technology to support the explosive growth of AI and machine learning (ML) applications and data volumes.

Meeting Future Performance and Power Requirements with Optical I/O

Optical I/O uniquely changes the performance and power trajectories of system designs by enabling compute, memory and networking ASICs to communicate with dramatically increased bandwidth, at lower latency, over longer distances and at a fraction of the power of existing electrical I/O solutions. The technology is also foundational to enabling emerging heterogeneous compute systems, disaggregated/pooled designs, and unified memory architectures that are critical to accelerating future data center innovation.

“Today’s state-of-the-art AI/ML training architectures are limited by current copper-based compute-to-compute interconnects to build scale-out systems for tomorrow’s requirements,” said Charles Wuischpard, CEO of Ayar Labs. “Our work with NVIDIA to develop next-generation solutions based on optical I/O provides the foundation for the next leap in AI capabilities to address the world’s most sophisticated problems.”

Delivering the ‘Next Million-X’ Speedup for AI with Optical Interconnect

“Over the past decade, NVIDIA-accelerated computing has delivered a million-X speedup in AI,” said Rob Ober, Chief Platform Architect for Data Center Products at NVIDIA. “The next million-X will require new, advanced technologies like optical I/O to support the bandwidth, power and scale requirements of future AI and ML workloads and system architectures.” 

As AI model sizes continue to grow, by 2023 NVIDIA believes that models will have 100 trillion or more connections – a 600X increase from 2021 – exceeding the technical capabilities of existing platforms. Traditional electrical-based interconnects will reach their bandwidth limits, driving lower application performance, higher latency and increased power consumption. New interconnect solutions and system architectures are needed to address the scale, performance and power demands of the next generation of AI. Ayar Labs’ collaboration with NVIDIA is focused on addressing these future challenges by developing next-generation architectures with optical I/O.

Share




Suggested Items

AIS, Qualcomm, ZTE Announce the World’s First 5G NR-DC Showcase for 2.6GHz and 26GHz in Thailand

04/01/2022 | Qualcomm Technologies, Inc.
AIS, Qualcomm Technologies, Inc. and ZTE announced the world’s first 5G NR-DC (New Radio Dual Connectivity) showcase in the field with 2.6GHz and 26GHz, achieving 8.5Gbps peak downlink speed and 2.17Gbps peak uplink speed with a single mobile device.

My View from CES 2021: Day 1

01/12/2021 | Dan Feinberg, Technology Editor, I-Connect007
What a difference a year makes. One year ago, those of us who cover and attend CES were going from one press conference to the next; this year, we are at home going from link to link. Confusing and challenging, yes, but there are some advantages: no masks, only five steps to get to a restroom, being able to have three of four events or more displaying on your screens at the same time and being able to download press kits as needed. So far, many new devices are being introduced, but of course, they are all online, so you wonder if some of them really exist or are truly operational as yet.

CES 2021: Just How Different Will It Be?

01/11/2021 | Dan Feinberg, I-Connect007
CES 2021 starts today and this year there is no need for an overpriced hotel room in Vegas, no long lines to get a taxi or board a bus, and no crowded exhibit halls (one good thing this year). On the other hand, you must decide ahead of time what you want to see and make a reservation or appointment if you wish to have time and access assured.



Copyright © 2022 I-Connect007. All rights reserved.