When you purchase through links on our site, we may earn an affiliate commission.Heres how it works.
Apples benchmarks show that this method generates 2.7x more tokens per second compared to traditional auto-regression.
Could it extend beyond Nvidia?
Breakthroughs like this can help improve machine learning efficiency.
you might read more about the collaboration with Apple on theNvidia Developer Technical Blog.
