Skip to main content
Presentation

Implementing Machine Learning Workflows on Nomad

As machine learning becomes more widespread across industries, the need to enable teams to quickly and efficiently train, evaluate and serve models becomes important for a successful ML project. In this talk I'll explain how we're using HashiCorp and Jupyter Notebooks to handle the machine learning lifecycle. I'll give an overview on a basic setup we established to manage, train and serve ML Applications and challenges we're facing moving forward to a Nomad driven MLOps platform. Finally, I demo our self-service approach for data scientist to spin up isolated Jupyter Notebooks on a nomad cluster via Jupyter Hub for their experiments. By the end of this talk, you will learn how a ML workflow can be implemented with Nomad and give developers the ability to train models in a self-served manner. Knowledge of ML is not required and all ML concept that are relevant to the talk will be introduced. While the talk will use NLP as an example, the processes described will largely be generic and adaptable to other types of machine learning models.

As machine learning becomes more widespread across industries, the need to enable teams to quickly and efficiently train, evaluate and serve models becomes important for a successful ML project.

In this talk I'll explain how we're using HashiCorp and Jupyter Notebooks to handle the machine learning lifecycle.

I'll give an overview on a basic setup we established to manage, train and serve ML Applications and challenges we're facing moving forward to a Nomad driven MLOps platform.

Finally, I demo our self-service approach for data scientist to spin up isolated Jupyter Notebooks on a nomad cluster via Jupyter Hub for their experiments.

By the end of this talk, you will learn how a ML workflow can be implemented with Nomad and give developers the ability to train models in a self-served manner. Knowledge of ML is not required and all ML concept that are relevant to the talk will be introduced. While the talk will use NLP as an example, the processes described will largely be generic and adaptable to other types of machine learning models.

More resources like this one

  • 1/19/2023
  • Presentation

10 Things I Learned Building Nomad-Packs

  • 12/31/2022
  • Presentation

All Hands on Deck: How We Share Our Work

  • 12/31/2022
  • Presentation

Launching the Fermyon Cloud with Nomad and WebAssembly

  • 12/31/2022
  • Presentation

Portable CD pipelines for Nomad with Vault and Dagger

HashiCorp uses data collected by cookies and JavaScript libraries to improve your browsing experience, analyze site traffic, and increase the overall performance of our site. By using our website, you’re agreeing to our Privacy Policy and Cookie Policy.

The categories below outline which companies and tools we use for collecting data. To opt out of a category of data collection, set the toggle to “Off” and save your preferences.