artificial intelligence

Meta’s massive AI compute push

Good morning, AI enthusiasts. Meta spent the summer poaching top AI talent, and now it's build up the compute power to match.Mark Zuckerberg just unveiled Meta Compute, an initiative to construct tens of gigawatts...

Apple, Google go official for Siri revamp

Good morning, AI enthusiasts. The Siri AI saga finally has a solution — and it's Google. Apple just officially confirmed a multi-year deal, making Gemini the backbone of its AI strategy and handing a...

Optimizing Data Transfer in Batched AI/ML Inference Workloads

is a to Optimizing Data Transfer in AI/ML Workloads where we demonstrated using NVIDIA Nsight™ Systems (nsys) in studying and solving the common data-loading bottleneck — occurrences where the GPU idles while it waits for input...

When Does Adding Fancy RAG Features Work?

an article about overengineering a RAG system, adding fancy things like query optimization, detailed chunking with neighbors and keys, together with expanding the context. The argument against this type of work is that for a...

Anthropic blocks xAI’s Claude access

Good morning, AI enthusiasts. Nothing says “your AI model is great” quite like a competitor secretly using it for their very own development.Anthropic just cut off xAI's Claude access after discovering Musk's lab was...

Federated Learning, Part 1: The Basics of Training Models Where the Data Lives

I the concept of federated learning (FL) through a comic by Google in 2019. It was a superb piece and did a fantastic job at explaining how products can improve without sending user...

How LLMs Handle Infinite Context With Finite Memory

1. Introduction two years, we witnessed a race for sequence length in AI language models. We regularly evolved from 4k context length to 32k, then 128k, to the huge 1-million token window first promised...

Gmail’s Gemini glow-up

Good morning, AI enthusiasts. Google's taken a slower, measured approach to weaving Gemini into its flagship products, however the pace is now picking up. Gmail just landed a wave of recent features, including AI...

Recent posts

Popular categories

ASK ANA