7/30/24

Holding all the chips: Meta has nearly 600,000 Nvidia H100 GPUs

At the SIGGRAPH conference in Denver yesterday, Nvidia CEO Jensen Huang interviewed Meta CEO Mark Zuckerberg. The hour-long, wide-ranging conversation touched on Huang’s love of black leather jackets, Meta’s new Llama 3.1 large language model, and eating Zuckerberg’s “delicious” cows from his Hawaiian ranch.

Towards the end of the interview, Huang revealed an eye-popping stat that hasn’t been made public before.

Huang and Zuckerberg were discussing how Nvidia bucked the norm of moving computing to smaller and smaller devices, and instead focused on building out massive computing systems powered by their specialized GPUs like the ones that Meta has invested heavily in.

Huang said, “When Zuck calls it his ‘data center of H100s’ there's like, I think you're coming up on 600,000.”

Zuckerberg smiled and nodded in response. “We're good customers. That's how you get the Jensen Q&A at SIGGRAPH.”

The H100 GPUs are a hot item in the AI industry, and companies are hoarding them to train larger and larger AI models. The price for each GPU is estimated between $20,000 and $40,000 meaning Meta’s investment in Nvidia chips may be north of $12 billion.

600,000

META’S H100 GPU HOARD

$20,000 to $40,000

Estimated COST OF EACH GPU

MORE THAN $12 BILLION Worth of Chips

More Tech

Tesla gets permit to test autonomous cars in Nevada as autonomous driving heats up there

Amazon’s self-driving Zoox launched service this week, and Google’s Waymo is testing there.

Las Vegas Exteriors And Landmarks - 2024

tech

9/11/25

OpenAI and Microsoft reach agreement that moves OpenAI closer to for-profit status

In a joint statement, OpenAI and Microsoft announced a “non-binding memorandum of understanding” for their renegotiated $13 billion partnership, which was a source of recent tension between the two companies.

Settling the agreement is a requirement to clear the way for OpenAI to convert to a for-profit public benefit corporation, which it must do before a year-end deadline to secure a $20 billion investment from SoftBank.

OpenAI also announced that the controlling nonprofit arm would hold an equity stake in the PBC valued at $100 billion, which would make it “one of the most well-resourced philanthropic organizations in the world.”

The statement read:

“This recapitalization would also enable us to raise the capital required to accomplish our mission — and ensure that as OpenAI’s PBC grows, so will the nonprofit’s resources, allowing us to bring it to historic levels of community impact.”

A joint statement from OpenAI and Microsoft

A joint statement from OpenAI and Microsoft

Settling the agreement is a requirement to clear the way for OpenAI to convert to a for-profit public benefit corporation, which it must do before a year-end deadline to secure a $20 billion investment from SoftBank.

OpenAI also announced that the controlling nonprofit arm would hold an equity stake in the PBC valued at $100 billion, which would make it “one of the most well-resourced philanthropic organizations in the world.”

The statement read:

“This recapitalization would also enable us to raise the capital required to accomplish our mission — and ensure that as OpenAI’s PBC grows, so will the nonprofit’s resources, allowing us to bring it to historic levels of community impact.”

tech

9/11/25

BofA doesn’t expect Tesla’s ride-share service to have an impact on Uber or Lyft this year

Analysts at Bank of America Global Research compared Tesla’s new Bay Area ride-sharing service with its rivals and found that, for now, it’s not much competition for Uber and Lyft. “Tesla scale in SF is still small, and we don’t expect impact on Uber/Lyft financial performance in ’25,” they wrote.

Tesla is operating an unknown number of cars with drivers using supervised full self-driving in the Bay Area, and roughly 30 autonomous robotaxis in Austin. The company has allowed the public to download its Robotaxi app and join a waitlist, but it hasn’t said how many people have been let in off that waitlist.

While the analysts found that Tesla ride-shares are cheaper than traditional ride-share services like Uber and Lyft, the wait times are a lot longer (nine-minute wait times on average, when cars were available at all) and the process has more friction. They also said the “nature of [a] Tesla FSD ‘driver’ is slightly more aggressive than a Waymo,” the Google-owned company that’s currently operating 800 vehicles in the Bay Area.

APPLE INTELLIGENCE

Apple AI was MIA at iPhone event

A year and a half into a bungled rollout of AI into Apple’s products, Apple Intelligence was barely mentioned at the “Awe Dropping” event.

Jon Keegan9/10/25

tech

9/10/25

Oracle’s massive sales backlog is thanks to a $300 billion deal with OpenAI, WSJ reports

OpenAI has signed a massive deal to purchase $300 billion worth of cloud computing capacity from Oracle, according to a report from The Wall Street Journal.

The report notes that the five-year deal would be one of the largest cloud computing contracts ever signed, requiring 4.5 gigawatts of capacity.

The news is prompting shares to pare some of their massive gains, presumably because of concerns about counterparty and concentration risk.

Yesterday, Oracle shares skyrocketed as much as 30% in after-hours trading after the company forecast that it expects its cloud infrastructure business to see revenues climb to $144 billion by 2030.

Oracle shares were up as much as 43% on Wednesday.

It’s the second example in under a week of how much OpenAI’s cash burn and fundraising efforts are playing a starring role in the AI boom: the Financial Times reported that OpenAI is also the major new Broadcom customer that has placed $10 billion in orders.

Exclusive | Oracle, OpenAI Sign Massive $300 Billion Cloud Computing Deal

Exclusive | Oracle, OpenAI Sign Massive $300 Billion Cloud Computing Deal

Yesterday, Oracle shares skyrocketed as much as 30% in after-hours trading after the company forecast that it expects its cloud infrastructure business to see revenues climb to $144 billion by 2030.

Oracle shares were up as much as 43% on Wednesday.

It’s the second example in under a week of how much OpenAI’s cash burn and fundraising efforts are playing a starring role in the AI boom: the Financial Times reported that OpenAI is also the major new Broadcom customer that has placed $10 billion in orders.

Latest Stories

Sherwood Media, LLC produces fresh and unique perspectives on topical financial news and is a fully owned subsidiary of Robinhood Markets, Inc., and any views expressed here do not necessarily reflect the views of any other Robinhood affiliate, including Robinhood Markets, Inc., Robinhood Financial LLC, Robinhood Securities, LLC, Robinhood Crypto, LLC, or Robinhood Money, LLC.

©2025 Sherwood Media, LLC