Home Artificial Intelligence Simplify Your Machine Learning Projects Don’t give attention to complex techniques Creating an MVP Conclusion

Simplify Your Machine Learning Projects Don’t give attention to complex techniques Creating an MVP Conclusion

200
Simplify Your Machine Learning Projects
Don’t give attention to complex techniques
Creating an MVP
Conclusion

Why shouldn’t the main focus of a project be on using complex techniques? For my part there are three predominant reasons, which I’ll explain here.

Reason 1. The business doesn’t care

The primary and most vital reason is that the business doesn’t care! Your stakeholders will not be serious about the technical details of your model. Whether you used boosted trees or a neural network, to them, it’s all the identical. What they need to know is how your model helps them achieve their business goals. If the model must be retrained often, you possibly can justify your decision to make use of a straightforward model like logistic regression over a neural network since it’s super fast to coach.

Often, the predominant goal of a machine learning model shouldn’t be to succeed in 100% accuracy. As a substitute, a machine learning model helps with business processes. Spending an excessive amount of time optimizing the model will delay the time it takes to deliver a working product to the market. It’s higher to create an MVP, ensure it meets the business requirements, and get it into production. It’s essential to take not only performance but in addition interpretability, computation speed, development costs, robustness, and training time under consideration. These aspects are necessary too and may be as relevant to business people as performance.

Besides yourself, there are other individuals who care a few complex model and state-of-the-art methods. Those persons are often researchers or data science colleagues. If you happen to work too closely with them as a substitute of with the business, you possibly can get to the purpose where you think modeling is the predominant goal. To beat this, attempt to work closer with business people. Demo your product after every recent feature implementation and ask the business in case your assumptions are correct. Decisions that appear small may be really necessary for business people.

Reason 2. A fancy model adds less value than a working MVP

The more time you spend on the model, the less time you’ve got for good engineering principles, similar to writing modular code, testing, architecture, logging, and monitoring. Setting these items up in a very good way originally saves plenty of time later. You possibly can easily add recent features to a solid codebase. That is more useful than having a posh model in a Jupyter Notebook that performs barely higher but doesn’t run in production. One other good thing about a straightforward model is interpretability, which may help persuade stakeholders because they’ll see the predictions make sense.

Especially to start with, give attention to making a product that works and has robust code and a well-crafted CI/CD pipeline. This makes it easier to enhance the answer in a while. If the business doesn’t feel the urge to enhance the present solution, you possibly can move on to a different project. You didn’t waste your time making a ‘perfect’ model.

What pertains to that is the Pareto principle. It’s a rule that states that 80% of results may be achieved through 20% of our efforts (aka the 80/20 rule). Often, creating a posh model that performs barely higher than a straightforward model doesn’t fall into the 80% of the outcomes but is a task that is difficult and takes plenty of time. The complex model is that last hard-to-reach 20% that takes 80% of the trouble. Before you begin, persuade yourself it’s value it.

The Pareto principle. 20% of the trouble brings 80% of the result. The opposite 20% of the result takes 80% of the trouble. By prioritizing in the suitable way you possibly can give attention to the 80% of the result you possibly can reach with 20% of the trouble. Image by writer.

Reason 3. Complex projects require more maintenance

The more complex the project, the more resources and time are needed to keep up it. Because of this you’ll spend more time fixing bugs, optimizing the model, keeping the info up so far, and fewer time adding recent features or improving the product. A straightforward project, however, requires less maintenance, which implies that you could spend more time iterating on the MVP and adding recent features to enhance the product.

A vital thought to be mindful is that the most effective solution is commonly the only solution that matches the necessities. This could assist you determine if that deep learning state-of-the-art model is actually definitely worth the extra work that comes with it! If there are two models that perform equally well, and one is easy and the opposite is complex, go together with the easy one.

One example from my work at an organization: I attempted to unravel a scheduling problem with reinforcement learning. It was quite complex, and we were progressing slowly. The business became a bit annoyed and upset because we couldn’t show good results. After we switched our solution method to (good old) mathematical optimization, it went much faster! It was less interesting, but we gained the trust of the business and will implement recent features and constraints easily.

200 COMMENTS

  1. … [Trackback]

    […] Informations on that Topic: bardai.ai/artificial-intelligence/simplify-your-machine-learning-projectsdont-give-attention-to-complex-techniquescreating-an-mvpconclusion/ […]

  2. … [Trackback]

    […] Read More to that Topic: bardai.ai/artificial-intelligence/simplify-your-machine-learning-projectsdont-give-attention-to-complex-techniquescreating-an-mvpconclusion/ […]

  3. Having read this I thought it was extremely enlightening. I appreciate you finding the time and energy to put this information together. I once again find myself spending way too much time both reading and posting comments. But so what, it was still worth it!|

  4. A person necessarily lend a hand to make
    severely posts I’d state. This is the very first
    time I frequented your web page and thus far?
    I amazed with the analysis you made to create this particular
    put up amazing. Magnificent job!

  5. I am extremely impressed with your writing skills and also with the layout on your blog.
    Is this a paid theme or did you customize it yourself?

    Either way keep up the excellent quality writing,
    it is rare to see a nice blog like this one these days.

  6. Hi there excellent website! Does running a blog similar to this require a massive amount work? I’ve absolutely no understanding of coding but I had been hoping to start my own blog in the near future. Anyways, if you have any suggestions or tips for new blog owners please share. I understand this is off topic however I just wanted to ask. Thanks a lot!|

  7. Aw, this was a very good post. Taking a few minutes and actual effort to generate a very good article… but what can I say… I put things off a lot and never seem to get nearly anything done.|

  8. Howdy, I do believe your website might be having browser compatibility problems.
    When I take a look at your website in Safari, it looks fine but when opening in IE, it’s got
    some overlapping issues. I simply wanted to provide you with a
    quick heads up! Besides that, excellent website!

  9. I’ll immediately take hold of your rss feed as I can not to find your
    email subscription link or newsletter service.
    Do you’ve any? Kindly permit me know in order that I may just subscribe.
    Thanks.

  10. Hey there I am so excited I found your blog, I really found you by error, while I was browsing
    on Askjeeve for something else, Regardless I am here now and would just like to say many thanks for
    a remarkable post and a all round interesting blog (I also
    love the theme/design), I don’t have time to read it
    all at the moment but I have bookmarked it and also included your RSS feeds,
    so when I have time I will be back to read more, Please do keep up the excellent work.

  11. I must thank you for the efforts you have put in penning this site.
    I’m hoping to view the same high-grade content from you later on as well.

    In truth, your creative writing abilities has motivated me
    to get my own website now 😉

  12. When do you think this Real Estate market will go back in a positive direction? Or is it still too early to tell? We are seeing a lot of housing foreclosures in Altamonte Springs Florida. What about you? Would love to get your feedback on this.Vildmarksbad tilbud

  13. Thanks for every other excellent post. The place else may just anyone get that kind of info in such an ideal manner of writing? I’ve a presentation subsequent week, and I am at the look for such information.sex 667

  14. Hi there! I know this is somewhat off topic but I was wondering which blog
    platform are you using for this website? I’m getting
    sick and tired of WordPress because I’ve had issues with hackers and
    I’m looking at alternatives for another platform. I would
    be awesome if you could point me in the direction of a good platform.

  15. Hi there, i read your blog occasionally and
    i own a similar one and i was just curious if you get a lot of spam remarks?

    If so how do you protect against it, any plugin or anything you can suggest?
    I get so much lately it’s driving me mad so any assistance is very much appreciated.

  16. Hi this is somewhat of off topic but I was wondering if blogs use WYSIWYG editors or if you have to manually code with HTML. I’m starting a blog soon but have no coding knowledge so I wanted to get guidance from someone with experience. Any help would be greatly appreciated!kontol kuda

  17. I’m impressed, I have to admit. Rarely do I encounter a blog that’s both equally educative and engaging,
    and without a doubt, you have hit the nail on the
    head. The issue is something which too few folks are speaking intelligently about.
    I’m very happy that I found this in my hunt for something regarding this.

  18. Hey there! I’m at work browsing your blog from my new iphone 3gs! Just wanted to say I love reading through your blog and look forward to all your posts! Keep up the great work!|

  19. Wow that was strange. I just wrote an really long comment but after I clicked submit my comment didn’t show up. Grrrr… well I’m not writing all that over again. Regardless, just wanted to say great blog!|

  20. Hey there! Do you know if they make any plugins to safeguard against hackers? I’m kinda paranoid about losing everything I’ve worked hard on. Any suggestions?|

  21. Heya i am for the first time here. I found this board and I find It truly useful & it helped me out much. I hope to give something back and aid others like you helped me.|

  22. I loved as much as you will receive carried out right here. The sketch is attractive, your authored subject matter stylish. nonetheless, you command get bought an edginess over that you wish be delivering the following. unwell unquestionably come further formerly again since exactly the same nearly a lot often inside case you shield this increase.|

  23. Undeniably imagine that that you stated. Your favourite reason seemed to be on the internet the easiest factor to be aware of. I say to you, I certainly get irked whilst other folks consider issues that they just do not know about. You managed to hit the nail upon the highest as smartly as defined out the entire thing without having side-effects , people could take a signal. Will probably be back to get more. Thank you|

  24. Hello There. I found your blog using msn. This is a really smartly written article. I will be sure to bookmark it and come back to read more of your helpful information. Thank you for the post. I will certainly comeback.|

  25. This design is spectacular! You certainly know how to keep a reader amused. Between your wit and your videos, I was almost moved to start my own blog (well, almost…HaHa!) Fantastic job. I really loved what you had to say, and more than that, how you presented it. Too cool!|

  26. Appreciating the persistence you put into your site and in depth information you provide. It’s awesome to come across a blog every once in a while that isn’t the same unwanted rehashed information. Fantastic read! I’ve saved your site and I’m adding your RSS feeds to my Google account.|

  27. Its like you read my mind! You appear to know so much about this, like you wrote the book in it or something. I think that you could do with some pics to drive the message home a little bit, but instead of that, this is magnificent blog. A fantastic read. I’ll definitely be back.|

Leave a Reply to rendingnicheblog Cancel reply

Please enter your comment!
Please enter your name here