Gaudi

Breaking the Host Memory Bottleneck: How Peer Direct Transformed Gaudi’s Cloud Performance

introduced Gaudi accelerators to Amazon’s EC2 DL1 instances, we faced a challenge that threatened your complete deployment. The performance numbers were not only disappointing; they were disastrous. Models that required training effectively were...

Squeeze Beats launches LLM serving optimization solution ‘Matches on Chips’

Squeeze Beats (CEO Kim Hyeong-jun), a specialist in artificial intelligence (AI) lightweighting and optimization, announced on the third that it has launched 'Matches on Chips', a customized solution for serving large language models (LLM). Matches...

Recent posts

Popular categories

ASK ANA