From Ideation to Implementation: How Microsoft Achieved its ChatGPT Goals

Microsoft Corp (NASDAQ: MSFT) pledged to build a massive, cutting-edge supercomputer for OpenAI in 2019 when it invested $1 billion.
  • Microsoft Corp (NASDAQ:MSFT) pledged to build a massive, cutting-edge supercomputer for OpenAI in 2019 when it invested $1 billion.
  • Microsoft had to find ways to string together tens of thousands of Nvidia Corp’s (NASDAQ: NVDA) A100 graphics chips, the workhorse for training AI models, and change how it positions servers on racks, Bloomberg reports.
  • OpenAI needed access to robust cloud computing services for long periods as it tried to train an increasingly large set of AI programs called models.
  • Microsoft executive vice president Scott Guthrie said it cost Microsoft over several hundred million dollars.
  • “We built a system architecture that could operate and be reliable at a very large scale. That’s what resulted in ChatGPT being possible,” said Nidhi Chappell, Microsoft general manager. 
  • “That’s one model that came out of it. There’s going to be many, many others.”
  • Microsoft uses the same resources it built for OpenAI to train and run its own large AI models, including the new Bing search bot.
  • Microsoft is already at work on the next generation of the AI supercomputer, part of an expanded deal with OpenAI in which Microsoft added $10 billion.
  • Training a massive AI model requires a large pool of connected graphics processing units in one place, like the AI supercomputer Microsoft assembled.
  • For the AI supercomputer, Microsoft had to develop software to get the best results from the GPUs and the networking equipment. 
  • Microsoft also deploys graphics chips for inference which are geographically dispersed throughout the company’s more than 60 regions of data centers.  
  • The company is adding the latest Nvidia graphics chip for AI workloads, the H100, and the newest version of Nvidia’s Infiniband networking technology to share data even faster.
  • Price Action: MSFT shares traded higher by 2.61% at $255.09 on the last check Monday.
Total
0
Shares
Related Posts
Read More

Markets Dip, Signaling Pause In Rally As Focus Shifts To Next Week’s Fed Decision: Analyst Says Brace For More Volatility Near Term

Risk aversion escalated on Wall Street Friday, with all major indices trading in the red, as investors remain skeptical about the stability of the banking sector in the wake of recent turmoil in the U.S. and Europe. Cues From Friday's Trading:

BAC