MLA 020 Kubeflow

Machine Learning Guide

Support my new podcast: Lefnire's Life Hacks

Conversation with Dirk-Jan Kubeflow (vs cloud native solutions like SageMaker)

Dirk-Jan Verdoorn - Data Scientist at Dept Agency

Kubeflow. (From the website:) The Machine Learning Toolkit for Kubernetes. The Kubeflow project is dedicated to making deployments of machine learning (ML) workflows on Kubernetes simple, portable and scalable. Our goal is not to recreate other services, but to provide a straightforward way to deploy best-of-breed open-source systems for ML to diverse infrastructures. Anywhere you are running Kubernetes, you should be able to run Kubeflow.

TensorFlow Extended (TFX). If using TensorFlow with Kubeflow, combine with TFX for maximum power. (From the website:) TensorFlow Extended (TFX) is an end-to-end platform for deploying production ML pipelines. When you're ready to move your models from research to production, use TFX to create and manage a production pipeline.

Alternatives:

• Airflow
• MLflow