math

Learning Triton One Kernel at a Time: Softmax

Within the previous article of this series, operation in all fields of computer science: matrix multiplication. It's heavily utilized in neural networks to compute the activation of linear layers. Nevertheless, activations on their...

How Relevance Models Foreshadowed Transformers for NLP

— that he saw further only by standing on the shoulders of giants — captures a timeless truth about science. Every breakthrough rests on countless layers of prior progress, until someday … all...

We Didn’t Invent Attention — We Just Rediscovered It

, someone claims they’ve invented a revolutionary AI architecture. But if you see the identical mathematical pattern — selective amplification + normalization — emerge independently from gradient descent, evolution, and chemical reactions, you realize...

MIT affiliates win AI for Math grants to speed up mathematical discovery

MIT Department of Mathematics researchers David Roe ’06 and Andrew Sutherland ’90,...

The Theory of Universal Computation: Bayesian Optimality, Solomonoff Induction & AIXI

In a seminal but underappreciated book titled , Marcus Hutter attempted a mathematical formulation of universal artificial intelligence, shortened to AIXI. This text goals to make AIXI accessible to data scientists, technical enthusiasts and...

Implementing the Gaussian Challenge in Python

Carl Gauss was a German mathematician and astronomer, also generally known as the “Prince of Mathematics”. He's well known for his contributions within the fields of science and arithmetic, comparable to number theory, geometry,...

Cracking the Density Code: Why MAF Flows Where KDE Stalls

Certainly one of the essential problems that arises in high-dimensional density estimation is that as our dimension increases, our data becomes more sparse. Due to this fact, for models that depend on local neighborhood...

OpenAI claims gold on math olympiad

Good morning, AI enthusiasts. OpenAI just claimed one in all the longstanding grand challenges in AI: gold-level performance with an experimental LLM on the International Math Olympiad (IMO) 2025.While questions remain over OpenAI’s grading,...

Recent posts

Popular categories

ASK ANA