Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

fix(dswm): Add missing post #6

Merged
merged 1 commit into from
Aug 20, 2023
Merged
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
58 changes: 58 additions & 0 deletions ds-with-mac/content/posts/testing-ml/index.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,58 @@
---
title: Testing of ML Systems
seo_title: Testing of ML Systems
summary: Testing of ML systems, what I wish I knew when I deployed my first ML system.
description:
slug: testing-ml
author: Marcus Elwin

draft: false
date: 2023-08-20T12:58:11+02:00
lastmod:
expiryDate:
publishDate:

feature_image:
feature_image_alt:

categories:
- MLOps
tags:
- Machine Learning
- Testing
series:

toc: true
related: true
social_share: true
newsletter: true
disable_comments: false
---

So you have secured data :tada: for your model and trained it with `model.train`, and maybe you have evaluate its performance on a hold-out test set or potential done an `A/B-test`. However, how do you know that your model will work, when deployed?

Can you ensure that your model still works after some slight changes in input data? In this article we will cover some considerations for how you can test your ML system to mitigate and take any relevant actions before and after you have deployed your model.

This post has been inspired by some previous work such as:
* :computer: [How to Test Machine Learning Code and Systems](https://eugeneyan.com/writing/testing-ml/)
* :computer: [Effective testing for machine learning systems](https://www.jeremyjordan.me/testing-ml/)

## What is an ML system?
__TODO__

## Why should you think about tests for your ML system?
__TODO__

## Testing a ML system vs testing a traditional software system
__TODO__

## Pre-training test(s)
__TODO__

## Post-training test(s)
__TODO__

## Data-drift test(s)
__TODO__