Tech
AWS re:Invent 2024
Amazon CEO Andy Jassy at AWS re:Invent 2024 (Noah Berger/Getty Images)
super mega ultra

Amazon’s AI plans: custom chips, an Anthropic “ultracluster,” and its own foundation model

While Amazon’s new models appear to be competitive in terms of features and performance, that isn’t the main thing that the company is touting — it’s the cost.

Jon Keegan

This week at Amazon’s AWS re:Invent conference in Las Vegas, the company fleshed out its plans to both serve and compete with the larger AI industry.

AWS is largely AI agnostic. Customers can use pretty much any of the major AI models on the cloud-computing platform, running on servers that use chips from Nvidia, AMD, Qualcomm, and others.

But Amazon has also been building and selling computing powered by its purpose-built AI chips, including its latest Trainium2 chip, which Amazon is now making widely available on AWS’s EC2 service. Amazon says these new Trainium2 instances are built for training and deploying jumbo-sized large language models with better price performance than its current offerings.

Amazon also deepened its partnership with AI startup Anthropic, announcing that it’s building an “ultracluster” of “hundreds of thousands” of Trainium2 servers to train Anthropic’s next-generation LLM. Amazon recently doubled its investment in Anthropic, bringing the total to $8 billion.

Probably the most significant announcement was Amazon’s late entry to the foundational AI-model club. Named “Amazon Nova,” the new LLM comes in four flavors: a text-only Micro and three multimodal models, Lite, Pro, and Premier. Amazon touted benchmark scores for the Nova models, which place it in the same class as OpenAI’s GPT-4o and Meta’s Llama 3. Amazon’s multimodal Nova models can ingest and generate images and videos, like many of the other top models out there today.

While Amazon’s new models appear to be competitive in terms of features and performance, that isn’t the main thing that the company is touting — it’s the models’ low, low cost.

Running Amazon models on Amazon servers, powered by Amazon chips, yields significant cost savings and low latency. Amazon says its Nova models are “at least 75% less expensive” than the best-performing models available on AWS today.

More Tech

See all Tech
tech

Sora’s ghoulish reanimation of dead celebrities raises alarms

OpenAI’s video generation app Sora has spent its first two weeks at the top of the charts.

The startup’s fast-and-loose approach to enforcing intellectual property rights has seen the app flooded with videos of trademarked characters in all sorts of ugly scenarios.

But another area where Sora users have been pushing the limits involves videos that reanimate dead celebrities.

And we’re not talking just JFK, MLK, and Einstein. Videos featuring more recently deceased figures such as Robin Williams (11 years ago), painter Bob Ross (30 years ago), Stephen Hawking (seven years ago), and even Queen Elizabeth II (three years ago) have been generated. Some of the videos are racist and offensive, shocking the relatives of the figures.

OpenAI told The Washington Post that it is now allowing representatives of “recently deceased” celebrities and public figures to request that their likenesses be blocked from the service, though the company did not give a precise time frame for what it considered recent.

But another area where Sora users have been pushing the limits involves videos that reanimate dead celebrities.

And we’re not talking just JFK, MLK, and Einstein. Videos featuring more recently deceased figures such as Robin Williams (11 years ago), painter Bob Ross (30 years ago), Stephen Hawking (seven years ago), and even Queen Elizabeth II (three years ago) have been generated. Some of the videos are racist and offensive, shocking the relatives of the figures.

OpenAI told The Washington Post that it is now allowing representatives of “recently deceased” celebrities and public figures to request that their likenesses be blocked from the service, though the company did not give a precise time frame for what it considered recent.

tech

Tesla is selling unsold Cybertrucks to Elon Musk’s other companies

Sales of Tesla’s Cybertruck, once expected to reach hundreds of thousands per year, are currently in the low tens of thousands range and falling. Last quarter in the US, Tesla sold fewer than 5,400 of the “apocalypse-proof” vehicles, for a total of about 16,000 this year, Business Insider reports, citing Cox Automotive data.

That’s a 63% drop from the same quarter a year ago, even as Tesla as a whole notched its best quarterly sales ever, spurred by the expiration of the $7,500 federal EV tax credit.

With sales lagging, the company has dialed back production of the stainless steel behemoths, but there’s still been an excess.

Fortunately for Tesla, Electrek reports that CEO Elon Musk has other uses for Cybertrucks within his other companies, which often share resources and personnel. Tesla is delivering truckloads of the EV to both xAI (which Tesla shareholders will vote next month on whether to invest in) and SpaceX, where Cybertrucks are replacing internal combustion engine support fleets.

There’s a lot of chatter about “circular deals” in the billion-dollar pacts announced in the AI space on a weekly basis. But it doesn’t get much more circular than this, with production and buying activity kept within the Musk corporate family.

That’s a 63% drop from the same quarter a year ago, even as Tesla as a whole notched its best quarterly sales ever, spurred by the expiration of the $7,500 federal EV tax credit.

With sales lagging, the company has dialed back production of the stainless steel behemoths, but there’s still been an excess.

Fortunately for Tesla, Electrek reports that CEO Elon Musk has other uses for Cybertrucks within his other companies, which often share resources and personnel. Tesla is delivering truckloads of the EV to both xAI (which Tesla shareholders will vote next month on whether to invest in) and SpaceX, where Cybertrucks are replacing internal combustion engine support fleets.

There’s a lot of chatter about “circular deals” in the billion-dollar pacts announced in the AI space on a weekly basis. But it doesn’t get much more circular than this, with production and buying activity kept within the Musk corporate family.

tech

Tesla has begun selling the Model Y Standard in parts of Europe, where it has lots of cheaper competition

Days after rolling out “Standard” trim levels of its Model Y and Model 3 in the US, Tesla has started selling the Model Y Standard in some European countries. Standard Model Ys begin at about 40,000 euros, depending on the country, roughly 10,000 euros cheaper than the current Premium versions. In the US, Standard versions are about $5,000 cheaper than their souped-up peers. The model isn’t yet on sale in the UK or Ireland, where cars are driven on the left-hand side of the road.

While the Standard Teslas are cheaper, they pale in comparison to the many affordable EV options available in Europe, including those from China’s BYD, some of which start below 25,000 euros. CEO Elon Musk has called Europe the company’s “weakest market,” blaming the lack of approval for Tesla’s full self-driving technology for the shortfall.

Model 3 Standards don’t appear to be available yet in Europe.

tech
Jon Keegan

OpenAI commits up to $25 billion for 500-megawatt “Stargate Argentina” data center

OpenAI has reportedly signed a letter of intent to invest up to $25 billion on “Stargate Argentina,” a new 500-megawatt AI data center.

Reuters reports that the deal would involve tax incentives.

In a video announcing the project, OpenAI CEO Sam Altman said:

“Our vision for Stargate Argentina is to deliver a major boost to the country’s AI infrastructure, creating a foundation for new capabilities from smarter public services to tools that help small businesses compete globally.

OpenAI did not immediately respond to a request for comment.

You may remember the name “Stargate” from the megaproject that tech giants and the Trump administration announced earlier this year to build a huge number of data centers in the US. And you may remember Argentina as the nation the Trump administration is now bailing out with a $20 billion currency swap.

Latest Stories

Sherwood Media, LLC produces fresh and unique perspectives on topical financial news and is a fully owned subsidiary of Robinhood Markets, Inc., and any views expressed here do not necessarily reflect the views of any other Robinhood affiliate, including Robinhood Markets, Inc., Robinhood Financial LLC, Robinhood Securities, LLC, Robinhood Crypto, LLC, or Robinhood Money, LLC.