AI firms are grappling\u00a0with a shortage of chips that are critical to developing and improving AI systems. The shortfall of the much-needed advanced graphics processing units (GPUs) is causing a race among firms to secure capacity, with many resorting to their connections to gain access to more chips.\u00a0Nvidia, the biggest player in the market currently, saw its stock soar 25% in a day recently after reporting a robust, strong quarter that surpassed earnings expectations.<\/p>\n
Nvidia currently produces the vast majority of GPUs used in AI development. The company has seen a\u00a0sharp spike in demand\u00a0as AI tools require vast amounts of data and enormous processing power, and building just one AI system can require thousands of chips.<\/p>\n
While Nvidia initially focused on manufacturing graphics-processing chips for the video gaming industry, the company has diversified its customer base. In recent years, the chipmaker has expanded into AI and cryptocurrency mining, broadening its range of products and services.<\/p>\n
More recently, the company\u2019s AI chips helped its data center division surpass its gaming division in revenues. This has even prompted the chipmaker to offer a new generation of AI chips for data centers that promise a substantial performance upgrade.<\/p>\n
Earlier this month, Nvidia announced the shipment of its DGX H100 systems. The product features eight H100 Tensor Core GPUs that are connected via NVLink, alongside dual Intel Xeon Platinum 8480C processors, 2TB of system memory, and 30 terabytes of NVMe SSD, the company said in a\u00a0blog post.<\/p>\n
Last week, Nvidia CEO Jensen Huang said the company is\u00a0working on a new generation of advanced Nvidia chips\u00a0for AI calculations in data centers to meet the surging demand. \u201cWe are significantly increasing our supply to meet surging demand for them,\u201d he added.<\/p>\n
However, the company has ostensibly failed to meet the overwhelming demand for its products. \u201cIt\u2019s like toilet paper during the pandemic,\u201d said Sharon Zhou, co-founder and CEO of Lamini, a startup that helps companies build chatbots using AI models.<\/p>\n
The shortage has reportedly restricted the processing power cloud service providers like Microsoft and Amazon can offer clients such as OpenAI, the company behind the popular AI chatbot called ChatGPT.<\/p>\n
As UBS analysts estimate, an earlier version of ChatGPT could require up to 10,000 graphic chips, while Musk estimates that an updated version requires three to five times as many of Nvidia\u2019s advanced processors.<\/p>\n
In particular, Companies in the AI space are struggling to secure the necessary computing power needed to develop and operate their increasingly complex models and help other companies build AI services. Even industry insiders are finding it challenging to secure the necessary computing capacity.<\/p>\n
In a recent Wall Street Journal CEO Council Summit, Elon Musk\u00a0stated\u00a0that GPUs are more difficult to get now than drugs. Similarly, OpenAI CEO Sam Altman said fewer people should use ChatGPT because of the processor bottleneck during a recent congressional hearing on AI.<\/p>\n
Startups are now relying on their networks to find spare computing power, while some founders are also begging salespeople at Amazon and Microsoft for more power. At the same time, others are blocking cloud capacity in fear that they might be unable to access the relevant resources later.<\/p>\n
Some AI investors and startups have also started shrinking their AI models to make them more efficient, buying their physical servers or switching to less popular cloud providers until the shortage is resolved. Additionally, others are orchestrating bulk orders of processors and server capacity that can be shared across their AI startups.<\/p>\n
While Nvidia is scaling up its production to meet the increasing demand, many AI founders expect the shortage to persist until at least next year. Due to the shortage, the cost of Nvidia\u2019s advanced GPU chips ranges from $33,000 upwards in secondary markets.<\/p>\n
The chipmaker has also added $220 billion to its market share since the start of the year, with the\u00a0stock surging 165% in 2023 alone. Moreover, the company has projected $11 billion in sales for the current quarter, far above the $7.2 billion Wall Street estimated and the highest quarterly total ever for the firm.<\/p>\n
This article originally appeared on The Tokenist<\/i><\/p>\n
Sponsored: Find a Qualified Financial Advisor<\/b><\/p>\n
Finding a qualified financial advisor doesn’t have to be hard. SmartAsset’s free tool matches you with up to 3 fiduciary financial advisors in your area in 5 minutes. Each advisor has been vetted by SmartAsset and is held to a fiduciary standard to act in your best interests. If you’re ready to be matched with local advisors that can help you achieve your financial goals, get started now.<\/p>\n