Gradient

Non-Linearity: Can Linear Regression Compete With Gradient Boosting?

Some weeks ago, I published a post on LinkedIn.The post was based on the next figure, comparing the predictions made by two models: Linear Regression, and CatBoost.This began a discussion, and I discovered the...

Making a Gradient Descent Animation in Python

Find out how to plot the trajectory of some extent over a fancy surfaceI’ll walk you thru the steps of the method I followed.A little bit of backgroundJust a few days ago, I published...

The Necessity of a Gradient of Explainability in AI

An excessive amount of detail might be overwhelming, yet insufficient detail might be misleading.“Any sufficiently advanced technology is indistinguishable from magic” — Arthur C. ClarkeWith the advances in self-driving cars, computer vision, and more...

Top 10 Machine Learning Algorithms Every Programmer Should Know #1. Linear Regression: The Oldie but Goodie #2. Logistic Regression: It’s Not All About Numbers #3. Decision Trees:...

Boosting Your Method to SuccessImagine running a relay race. Each runner improves upon the previous one’s performance, and together, they win the race. That’s how these algorithms work — every latest model compensates for...

XGBoost: How Deep Learning Can Replace Gradient Boosting and Decision Trees — Part 1 XGBoost is extremely efficient, but… Constructing Decision Trees just isn’t a differentiable...

If you've gotten read my previous articles on Gradient Boosting and Decision Trees, you're aware that Gradient Boosting, combined with Ensembles of Decision Trees, has achieved excellent performance in classification or regression tasks involving...

XGBoost: How Deep Learning Can Replace Gradient Boosting and Decision Trees — Part 1 XGBoost is very efficient, but… Constructing Decision Trees shouldn’t be a differentiable...

If you may have read my previous articles on Gradient Boosting and Decision Trees, you might be aware that Gradient Boosting, combined with Ensembles of Decision Trees, has achieved excellent performance in classification or...

Exploring Gradient Boosting vs Linear Regression: Selecting the Best Prediction Tool and Developing a Streamlit App Creating your project’s environment Using VSCode for data evaluation Data Treatment Data...

Hey there! I’m Ana, a knowledge enthusiast and a machine learning apprentice. Welcome to my first post on Medium, where I’ll be sharing my journey and insights into the exciting world of knowledge evaluation...

Improve your Gradient Descent: The Epic Quest for the Optimal Stride Contents Introduction Method 1: Fixed Step Size Method 2: Exact Line Search Method 3: Backtracking Line Search Conclusion

Techniques for Optimizing Step-Size/Learning Rate in Gradient Descent for Machine LearningIn this text, we familiarised ourselves with a few of the useful techniques to optimize for the step size within the gradient descent algorithm....

Recent posts

Popular categories

ASK ANA