Learn how model observability can help you stay on top of ML in the wild and bring value to your business.
December 23rd, 2021
Model observability: The path to production-first data science
Model observability has been all the rage in 2021, and with good reason. Applied machine learning is crossing the technology chasm, and for more and more companies, ML is becoming a core technology driving daily business decisions. Now that ML is front and center, in production, and business-critical, the need for model monitoring and observability...
December 13th, 2021
So you want to be API-first?
Deciding to become an API-first product is not a trivial decision to be made by a company. There needs to be a deep alignment throughout the company, from R&D all the way to marketing, on why and how an API-first approach will accelerate development, go-to-market, and the business at large. But more importantly, just like...
November 25th, 2021
Something is rotten in the holi-dates of models
Let’s get the obvious out of the way. First, ML models are built on the premise that the data observed in the past on which we trained our models reflects production data accurately. Second, “special” days like holidays such as Thanksgiving or, more specifically, the online shopping bonanza boom of the last decade, have different...
October 14th, 2021
Scaling model observability with Superwise & New Relic
Let’s skip the obvious, if you’re reading this it’s a safe bet that you already know that ML monitoring is a must; data integrity, model drift, performance degradation, etc., are already the basic standard of any MLOps monitoring tool. But as any ML practitioner will attest to, it’s one thing to monitor a single machine...
May 12th, 2021
Stories from the ML trenches
What led us to create the #MLTalks initiative Back in February when we were on our 3rd lockdown, my team and I regrouped to think about our next steps. As we are in a fortunate position to meet with dozens of leading DS teams every week to brainstorm and discuss their challenges with scaling ML,...
April 19th, 2021
Thinking about building your own ML monitoring solution?
“We already have one!” That’s the first sentence most of our customers said when we met to discuss AI assurance solutions. Most AI-savvy organizations today have some form of monitoring. Yet, as they scale their activities, they find themselves at a crossroads: should they invest more in their homegrown solution or receive support from vendor...
Everything you need to know about AI direct to your inbox
April 19th, 2021
Facing the challenges of day 2 with your models in production
AI is everywhere. Businesses from all verticals are promptly adopting AI algorithms to automate some of their most important decisions: from approving transactions to diagnosing cancers, to granting credit, and so much more. As the AI race is booming, more organizations step into “Day 2”, the day their models are moved out of the realms...
March 18th, 2021
Framework for a successful continuous training strategy
ML models are built on the assumption that the data used in production will be similar to the data observed in the past, the one that we trained our models on. While this may be true for some specific use cases, most models work in dynamic data environments where data is constantly changing, and where...
March 4th, 2021
Measuring the performance of sub-groups
Just like in some cases “the whole is greater than the sum of its parts”, in machine learning “the performance of the model is not a reflection of the sum of its sub-groups.” Indeed, the good performance of machine learning models does not necessarily mean that every sub-group is optimized. Quite the contrary. Models don’t...
December 9th, 2020
Fundamentals for efficient ML model monitoring
Today’s enterprises rely on machine learning-powered predictions to guide business strategies, such as forecasting demand and mitigating risk. For an increasing number of businesses, machine learning (ML) underpins their core business model, like financial institutions that use ML models to approve or reject loan applications. As ML is drastically different from other software or traditional...
November 26th, 2020
How to get your business closer to your models?
If I were to select one image to describe the relationships of business teams with AI, I would choose the opening scene from 2001 space odyssey. Do you remember that scene, and the use of the black monolith, often interpreted as the allegory of change? It seems so well adjusted to the depiction of how...
November 5th, 2020
Part II: Safely rolling out models to production
This piece is the second part of a series of articles on production pitfalls and how to rise to the challenge. – In the first part of this article, we looked at the reasons that make “the ML Orchestra” such a complex one to tune, and laid out the best practices and processes to be...