When you purchase through links on our site, we may earn an affiliate commission.Heres how it works.
The researchers claim despite cutting energy consumption, there is no impact on the performance of AI applications.
However, while the Linear-Complexity Multiplication method shows great promise, its adoption faces certain challenges.
One significant drawback is that the new technique requires different hardware to what is currently in use.
Most AI applications today run on hardware optimized for floating-point computations, such as GPUs made by companies likeNvidia.
The new method would require redesigned hardware to function effectively.
The team notes the hardware needed for its method has already been designed, built, and tested.
Estimates suggestChatGPTalone currently consumes approximately 564 MWh of electricity daily, enough to power 18,000 US households.
ViaTechXplore
