Now Reading
KAIST develops next-generation ultra-low energy LLM accelerator

KAIST develops next-generation ultra-low energy LLM accelerator

2024-03-06 00:21:47

By Kim Na-young

SEOUL, March 6 (Yonhap) — A analysis crew on the Korea Superior Institute of Science and Know-how (KAIST) has developed the world’s first synthetic intelligence (AI) semiconductor able to processing a big language mannequin (LLM) with ultra-low energy consumption, the science ministry stated Wednesday.

The crew, led by Professor Yoo Hoi-jun on the KAIST PIM Semiconductor Analysis Middle, developed a “Complementary-Transformer” AI chip, which processes GPT-2 with an ultra-low energy consumption of 400 milliwatts and a excessive velocity of 0.4 seconds, in response to the Ministry of Science and ICT.

The 4.5-mm-square chip, developed utilizing Korean tech big Samsung Electronics Co.’s 28 nanometer course of, has 625 occasions much less energy consumption in contrast with world AI chip big Nvidia’s A-100 GPU, which requires 250 watts of energy to course of LLMs, the ministry defined.

The chip can be 41 occasions smaller in space than the Nvidia mannequin, enabling it for use on units like cell phones.

The ministry stated the utilization of neuromorphic computing expertise, particularly spiking neural networks (SNNs), is important to the achievement.

Beforehand, the expertise was much less correct than deep neural networks (DNNs) and primarily able to easy picture classifications, however the analysis crew succeeded in bettering the accuracy of the expertise to match that of DNNs to use it to LLMs.

The crew stated its new AI chip optimizes computational power consumption whereas sustaining accuracy through the use of distinctive neural community structure that fuses DNNs and SNNs, and successfully compresses the big parameters of LLMs.

See Also

A photo describing an artificial intelligence chip which processes a large language model with neuromorphic computing technology provided by the Ministry of Science and ICT on March 6, 2024 (PHOTO NOT FOR SALE) (Yonhap)

A photograph describing a synthetic intelligence chip which processes a big language mannequin with neuromorphic computing expertise supplied by the Ministry of Science and ICT on March 6, 2024 (PHOTO NOT FOR SALE) (Yonhap)

nyway@yna.co.kr
(END)

Source Link

What's Your Reaction?
Excited
0
Happy
0
In Love
0
Not Sure
0
Silly
0
View Comments (0)

Leave a Reply

Your email address will not be published.

2022 Blinking Robots.
WordPress by Doejo

Scroll To Top