Meta Unveils New In-House Chip Family for AI Data Centers

Meta Unveils New In House Chip Family for AI Data Centers

Meta Platforms announced on Thursday that it was working on new initiatives to make its data centers more capable of supporting artificial intelligence tasks, including a custom-made chip “family” that it said it was creating in-house.

The company that owns Facebook and Instagram said in a series of blog posts that it developed a first-generation chip in 2020 as part of the Meta Training and Inference Accelerator (MTIA) program, which was aimed at enhancing efficiency for the recommendations models it uses to deliver ads and other content in news feeds.

Reuters previously reported that the company did not intend to deploy its first in-house AI chip widely and was already working on a successor. The blog posts described the first MTIA chip as a learning experience.

See also  ChatGPT arrives on iOS and Android app is on the way

“From this initial program, we have learned invaluable lessons that we are incorporating into our roadmap,” it wrote.

The first MTIA chip was focused solely on an AI process called inference, in which algorithms trained on huge amounts of data make decisions about whether to show, for example, a dance video or a cat meme as the next post in a user’s feed, the posts said.

A Meta spokesperson declined to comment on deployment timelines or elaborate on the company’s plans to develop chips that could train the models as well.

See also  Elon Musk hires 14-year-old prodigy for Starlink project

Meta has been involved in a massive project to upgrade its AI infrastructure this past year, after executives realized it lacked the hardware and software needed to support demand from product teams building AI-powered features.

As part of that, the company scrapped plans for a large-scale rollout of an in-house inference chip and started work on a more ambitious chip capable of performing both training and inference, according to the Reuters reporting.

Meta acknowledged in its blog posts that its first MTIA chip struggled with high-complexity AI models, although it said the chip handled low- and medium-complexity models more efficiently than competitor chips.

See also  Portland radio station introduces first AI DJ in history

The MTIA chip also used only 25 watts of power — a fraction of what market-leading chips from suppliers such as Nvidia consume — and used an open-source chip architecture called RISC-V, Meta said.

In addition to detailing its chip work, Meta provided an update on plans to redesign its data centers around more modern AI-oriented networking and cooling systems, saying it would break ground on its first such facility this year.

The new design would be 31 percent cheaper and could be built twice as quickly as the company’s current data centers, an employee said in a video explaining the changes.

Related Articles

Lawmakers call for AI regulation in the country
  • Artificial Intelligence
  • News

June 8, 2023

Lawmakers call for AI regulation in the country

Meta unveils its own AI chips — and a supercomputer
  • Artificial Intelligence

May 19, 2023

Meta unveils its own AI chips — and a supercomputer

Apple Vision Pro The new mixed reality headset that blends AR and VR
  • Artificial Intelligence
  • Technology

June 6, 2023

Apple Vision Pro: The new mixed reality headset that blends AR and VR

Leave the first comment