NVIDIA Corporation (NASDAQ:NVDA) Q3 2024 Earnings Call Transcript

Meanwhile, while that’s being ramped, you see that we’re starting to partner with enterprise software companies who would like to build chatbots and copilots and assistants to augment the tools that they have on their platforms. You’re seeing GPU specialized CSPs cropping up all over the world and they are dedicated to do really one thing, which is processing AI. You’re seeing sovereign AI infrastructures, people — countries that now recognize that they have to utilize their own data, keep their own data, keep their own culture, process that data and develop their own AI. You see that in India. Several — about a year ago in Sweden, you are seeing in Japan. Last week, a big announcement in France. But the number of sovereign AI clouds that are being built is really quite significant.

And my guess is that almost every major region will have and surely every major country will have their own AI clouds. And so I think you’re seeing just new developments as the generative AI wave propagates through every industry, every company, every region. And so we’re at the beginning of this inflection, this computing transition.

Operator: Your next question comes from the line of Aaron Rakers of Wells Fargo. Your line is open.

Aaron Rakers: Yeah. Thanks for taking the question. I wanted to ask about kind of the networking side of the business. Given the growth rates that you’ve now cited, I think, it’s 155% year-over-year and strong growth sequentially, it looks like that business is like almost approaching $2.5 billion to $3 billion quarterly level. I’m curious of how you see Ethernet involved evolving and maybe how you would characterize your differentiation of Spectrum-X relative to the traditional Ethernet stack as we start to think about that becoming part of the networking narrative above and maybe beyond just InfiniBand as we look into next year? Thank you.

Jensen Huang: Yeah. Thanks for the question. Our networking business is already on a $10 billion plus run rate and it’s going to get much larger. And as you mentioned, we added a new networking platform to our networking business recently. The vast majority of the dedicated large scale AI factories standardize on InfiniBand. And the reason for that is not only because of its data rate and not only just the latency, but the way that it moves traffic around the network is really important. The way that you process AI and a multi-tenant hyperscale Ethernet environment, the traffic pattern is just radically different. And with InfiniBand and with software defined networks, we could do congestion control, adaptive routing, performance isolation and noise isolation, not to mention, of course, the day rate and the low latency that — and a very low overhead of InfiniBand that’s natural part of InfiniBand.

And so, InfiniBand is not so much just the network, it’s also a computing fabric. We’ve put a lot of software-defined capabilities into the fabric including computation. We will do 40-point calculations and computation right on the switch, and right in the fabric itself. And so that’s the reason why that difference in Ethernet versus InfiniBand or InfiniBand versus Ethernet for AI factories is so dramatic. And the difference is profound. And the reason for that is because you’ve just invested in a $2 billion infrastructure for AI factories. A 20%, 25%, 30% difference in overall effectiveness, especially as you scale up is measured in hundreds of millions of dollars of value. And if you will, renting that infrastructure over the course of four to five years, it really, really adds up.

And so InfiniBand’s value proposition is undeniable for AI factories. However, as we move AI into enterprise. This is enterprise computing what we’d like to enable every company to be able to build their own custom AIs. We’re building customer AIs in our company based on our proprietary data, our proprietary type of skills. For example, recently we spoke about one of the models that we’re creating, it’s called ChipNeMo; we’re building many others. There’ll be tens, hundreds of custom AI models that we create inside our company. And our company is — for all of our employee use, doesn’t have to be as high performance as the AI factories we used to train the models. And so we would like the AI to be able to run in Ethernet environment. And so what we’ve done is we invented this new platform that extends Ethernet; doesn’t replace Ethernet, it’s 100% compliant with Ethernet.

And it’s optimized for East-West traffic, which is where the computing fabric is. It adds to Ethernet with an end-to-end solution with Bluefield, as well as our Spectrum switch that allows us to perform some of the capabilities that we have in InfiniBand, not all but some. And we achieved excellent results. And the way we go to market is we go to market with our large enterprise partners who already offer our computing solution. And so, HP, Dell and Lenovo has the NVIDIA AI stack, the NVIDIA AI Enterprise software stack and now they integrate with Bluefield, as well as bundle — take a market there, Spectrum switch, and they’ll be able to offer enterprise customers all over the world with their vast sales force and vast network of resellers a fully integrated, if you will, fully optimized, at least end-to-end AI solution.