Skip to content

MLOps Guide

MlOps Banner

This site is intended to be a MLOps Guide to help projects and companies to build more reliable MLOps environment. This guide should contemplate the theory behind MLOps and an implementation that should fit for most use cases. Made by Arthur Olga, Gabriel Monteiro, Guilherme Leite and Vinicius Lima

What is MLOps?

MLOps is a methodology of operation that aims to facilitate the process of bringing an experimental Machine Learning model into production and maintaining it efficiently. MLOps focus on bringing the methodology of DevOps used in the software industry to the Machine Learning model lifecycle. In that way we can define some of the main features of a MLOPs project:

  • Data and Model Versioning
  • Feature Management and Storing
  • Automation of Pipelines and Processes
  • CI/CD for Machine Learning
  • Continuous Monitoring of Models

What is Contemplated on This Guide?

  • Introduction to MLOps Concepts
  • Tutorial for Building a MLOps Environment

MLOps Environment

This video shows how an example of workflow with a complete MLOps project. This exact project can be found here and is an example end-to-end made for this guide.

Architecture

The following diagram shows the complete MLOps flow used on the tutorial. Since the guide is modular, a team can choose to swap tools at any point due to project preferences and use cases.

Diagram

Project Tools

The main tools discussed in the guide are shown in the following table.

Tools Function Developer License
IBM Watson ML Deploying model as API IBM Proprietary
IBM Watson OpenScale Monitoring Model in production IBM Proprietary
DVC Data and Model Versioning Iterative Apache License 2.0
CML Pipeline Automation Iterative Apache License 2.0
Terraform Setups IBM infrastructure with script HashiCorp Mozilla Public License v2.0
Github Code versioning Github Proprietary
Github Actions CI/CD Automation Github Proprietary
Pytest Python script testing Pytest-dev MIT
Pre-commit Running tests on local commit Pre-commit MIT
Cookiecutter Creating folder structure and files Cookiecutter BSD 3-Clause

Next

MLOps Theory

📚 Learn More About MLOps Theory

Tip

It is recommended that you learn about the theory before implementing MLOps into your project

Implementation Guide

📃 Follow the Tutorial to Start a Project