GPU

Microsoft (MS) introduced the world's first server composed of NVIDIA's latest 'Blackwell' chip. Contrary to expectations that the server can be accepted in early December, it was revealed that the server was already in...

SKT is opening a man-made intelligence (AI) data center in Seoul in partnership with cloud startup Lambda. SK Telecom (CEO Yoo Young-sang) announced on the twenty first that it has signed a partnership with Lambda...

Meta announced that it is going to train its next-generation model, Rama 4, with 10 times more GPUs than Rama 3.1. Which means that it is going to construct a cluster of roughly 160,000...

Gwangju Institute of Science and Technology (GIST, President Lim Ki-cheol) announced on the twenty sixth that it held a deep learning model training (DLI Day) along with the Supercomputing Center (Director Kim Jong-won) and...

Large Language Models (LLMs) deploying on real-world applications presents unique challenges, particularly when it comes to computational resources, latency, and cost-effectiveness. On this comprehensive guide, we'll explore the landscape of LLM serving, with a...

As transformer models grow in size and complexity, they face significant challenges by way of computational efficiency and memory usage, particularly when coping with long sequences. Flash Attention is a optimization technique that guarantees...

Elon Musk's AI startup xAI and Oracle's large-scale server rental negotiations have fallen through. Because of this, Oracle will provide 100,000 GPUs to Microsoft (MS), which can likely be used to develop OpenAI's models. The...

It has been reported that users are flocking to Upstage's 'translation expert' artificial intelligence (AI) model. Accordingly, the corporate has begun expanding its related infrastructure. Artificial intelligence (AI) specialist Upstage (CEO Seonghun Kim)...