Jul 28 2020|Erik Veld
A couple of years ago cloud bursting was all the rage, but it never delivered on its promise because of the inherent complexity that it comes with. But in this day and age, is cloud bursting still relevant? Let's see what Nomad and Consul can do to solve some of the problems it promised to.
Jul 24 2020|Kyle Penfound, Chloe Cota, and Omar Khawaja
Today we’re happy to announce HashiCorp’s official Linux repository, a source of Debian and RPM packages for HashiCorp products. These packages will provide Linux users with a better installation and upgrade experience.
Jul 09 2020|Yishan Lin
This release also delivers 15+ new and powerful features with thematic emphasis on application deployment flexibility and operator maintainability at scale. We are pleased to announce the general availability of HashiCorp Nomad 0.12.
Jul 09 2020|Tim Gross
Nomad Enterprise 0.12 multi-cluster deployments enable organizations to deploy applications seamlessly to federated Nomad clusters with configurable rollout and rollback strategies. It achieves simple and elegant federated deployments without the architectural complexity and overhead of running clusters on clusters.
Jul 09 2020|Luiz Aoqui
Today we are happy to announce the new release of the Nomad Autoscaler, which is now in beta. The highlight of this release is the long-awaited horizontal cluster autoscaling capability. This feature allows you to automatically add or remove clients from your Nomad cluster as your load changes, with initial support for Autoscaling Groups in AWS.
Jul 09 2020|Nick Ethier and Michael Schurter
Nomad 0.12 includes significant networking improvements for Nomad managed services. The two most significant networking improvements are multi-interface networking and CNI plugin support. Both features may be enabled by Nomad cluster administrators and then leveraged by Nomad job authors. Existing clusters and workloads will continue to work as they do today.
Jun 26 2020|Chang Li
Bowery, a Google-backed modern farming startup, shares their story about how Nomad powers their data engineers to optimize the production process from germination to harvest. Nomad made it possible for Bowery to deploy a Nomad client at each edge location and build one single cluster across their distributed and hybrid infrastructures. It also helped the teams to automate and standardize their application deployment workflow.
Jun 22 2020|Yishan Lin
Nomad 0.12 introduces our breakthrough Multi-Cluster Deployment feature, which makes Nomad the first and only orchestrator on the market with complete and fully-supported federation capabilities for production. This release also delivers 15+ new and powerful features with thematic emphasis on application deployment flexibility and operator maintainability at scale.
May 08 2020|Chang Li
Introducing a new livestreaming series, Nomad Under the Hood. In these sessions, Nomad engineers will walkthrough how a particular feature or function gets developed, share the thinking behind the feature design, and provide insights on how to contribute. Join us on YouTube.
Apr 08 2020|Chang Li
Announcing the general availability of Nomad 0.11! This release delivers a set of new features including extensible, pluggable storage volumes and autoscaling to enhance its core orchestration capabilities. For enterprise customers, audit logging brings administrative visibility and operational traceability to fulfill compliance requirements.
Mar 26 2020|Chris Baker
Nomad 0.11 announced a Technical Preview of the HashiCorp Nomad Autoscaler. This is a new open source project that provides the ability to automatically scale workloads running on a Nomad cluster. It's capable of being easily deployed on Nomad, and it employs a plugin system that allows operators to perform autoscaling in whatever way is appropriate for their workloads.
Mar 25 2020|Yishan Lin
Nomad 0.11 delivers a set of new features including extensible, pluggable storage volumes and autoscaling to enhance its core orchestration capabilities. For enterprise customers, audit logging brings administrative visibility and operational traceability to fulfill compliance requirements.
Oct 22 2019|Chang Li
We're excited to announce the general availability of Nomad 0.10. This release focuses on Consul Connect integration and storage features that enhance our support for advance networking with service mesh and stateful workloads, including network namespaces, host volumes and Web UI enhancements.
Jun 05 2019|Preetha Appan
We are pleased to announce the availability of Hashicorp Nomad 0.9.2, which enables developers and operators to easily interact with task environments, run allocation lifecycle management commands, and configure canary-based deployments to auto-promote. This release also adds preemption capabilities for service and batch jobs to Nomad Enterprise.
May 06 2019|Chris Baker and Renaud Gaubert
HashiCorp Nomad 0.9 introduces device plugins which support an extensible set of devices for scheduling and deploying workloads. A device plugin allows physical hardware devices to be detected, fingerprinted, and made available to the Nomad job scheduler. The 0.9 release includes a device plugin for NVIDIA GPUs.
Apr 18 2019|Eduardo Arango
Containers are changing the software packaging and distribution paradigm. Singularity takes this to the next level by offering a simple platform designed around container mobility, reproducibility, security, and performance.
Apr 09 2019|Rob Genova
We are pleased to announce the public availability of HashiCorp Nomad 0.9.
Nomad is a flexible workload orchestrator that can be used to deploy and manage a diverse set of workloads of different types, like micro-service, batch, containerized, and legacy applications across multiple regions or cloud providers. Nomad is easy to operate and scale, and integrates seamlessly with HashiCorp Consul for service discovery and HashiCorp Vault for secrets management.
Oct 23 2018|Armon Dadgar
Today at HashiConf 2018 in San Francisco, we are announcing major updates across our entire suite of open source and enterprise products. Our mission is to allow users to run applications on any infrastructure, cloud or on-premises, using a modern infrastructure as code approach. This blog is a summary of the announcements being made at the event.
Sep 20 2018|Christie Koehler
In this series we explore how Nomad handles unexpected failures, outages, and routine maintenance of cluster infrastructure, often without operator intervention.
In this post we’ll explore how Nomad is designed to handle transient and permanent failures of both clients and servers gracefully to make it easy to run highly reliable infrastructure.
Sep 13 2018|Christie Koehler
This is the third in a series Building Resilient Infrastructure with Nomad (Part 1, Part 2). In this series we explore how Nomad handles unexpected failures, outages, and routine maintenance of cluster infrastructure, often without operator intervention required.
In this post we’ll look at how Nomad adds resiliency to your computing infrastructure by providing a consistent workflow for managing the entire job lifecycle, including robust options for updating and migrating jobs that help minimize or even eliminate down time.
Aug 29 2018|Christie Koehler
This is the second post in our series Building Resilient Infrastructure with Nomad. In this series we explore how Nomad handles unexpected failures, outages, and routine maintenance of cluster infrastructure, often without operator intervention required.
In this post we’ll look at how the Nomad client enables fast and accurate scheduling as well as self-healing through driver health checks and liveness heartbeats.
Aug 22 2018|Christie Koehler
Welcome to our series on Building Resilient Infrastructure with Nomad, where we explore how Nomad handles unexpected failures, outages, and routine maintenance of cluster infrastructure, often without operator intervention required.
In this first post, we'll look at how Nomad automates the restart of failed and unresponsive tasks as well as reschedule of repeatedly failing tasks to other nodes.
Apr 13 2018|Anubhav Mishra
HashiCorp Nomad 0.8 introduces advanced node draining to simplify cluster wide upgrades of Nomad client nodes. This post explores how HashiCorp Nomad’s improved draining features can be used to drain an existing workload from one set of nodes to a new set of nodes without downtime.
Apr 13 2018|Rob Genova
We are pleased to announce the release of HashiCorp Nomad 0.8. Version 0.8 enhances Nomad's cluster management features and reliability, helping to ensure a seamless operational experience as a growing number of enterprises adopt Nomad, move into production, and scale out.
Apr 04 2018|Stephen Wilson
It seems that containers are everywhere. They should be. They make it easier to deploy applications into environments for development, testing and in production. However, what about when containers just don’t work? To take full advantage of the container orchestration platforms currently available there has to be considerable changes made to the applications and the deployment processes. For green field applications this is not a problem as they are usually built with containers in mind. What do you do if you want to have the advantages of a container-like scheduler but for your legacy applications? Enter HashiCorp Nomad.
Mar 29 2018|Boyang Jerry Peng
Apache Heron is a stream processing engine (SPE) open sourced by Twitter in 2016 and now currently in incubation under the auspices of the Apache Software Foundation. At Twitter, Heron was built to provide multi-tenancy, efficient resource usage, support for a variety of programming languages and APIs, operational simplicity at massive scale, and high productivity for developers building both real-time and batch services. Today, Heron serves the lion’s share of Twitter’s massive real-time processing needs, is used by numerous large enterprises, and has a thriving open source community.
As a core contributor to Heron, I’m excited to announce that Nomad is being added as a fully supported scheduler for Heron.
Mar 28 2018|Paddy Carver
At HashiCorp, we’ve always said that all of our projects should work well separately, but better together. This is certainly true for HashiCorp Terraform and HashiCorp Nomad. Terraform provisions the infrastructure and Nomad schedules and deploys applications. When deploying Nomad, you may do this however you like, and the Nomad team strives to make that easy to do, but if you opt to use Terraform to manage the servers that Nomad runs on, we believe that should offer a first-class experience.
Mar 22 2018|Nicolas Corrarello
A lot of HashiCorp users and employees love our whole suite of products, but like with your grandmother, it’s almost impossible not to have one slight predilection over one of our creations (says the favorite grandchild). In my case, my predilection for HashiCorp Nomad is quite evident, to the point of being a running joke among the European team. I think not a single customer meeting goes by without someone saying "yeah, that’s Nomad, Nico’s favorite product…".
Mar 07 2018|Jeff Silberman
No one wants to manage storage, but high-value applications aren’t going to run without it. In an ideal world, storage would “just be there” without having to think about it --- or provision and manage it, right?
Portworx, a software-defined persistent storage solution for container workloads, provides a highly-available elastic data fabric. Portworx cloud native storage allows jobs to seamlessly run hyper-converged with the storage layer for best performance --- and also provides a rich spectrum of options for data availability.
Jan 10 2018|Nic Jackson
OpenFaaS (or Functions as a Service) is a framework for building serverless functions but with containers. With OpenFaaS you can package any process or container as a serverless function for either Linux or Windows - just bring your Nomad cluster. The project focuses on ease of use through its UI and CLI which can be used to test and monitor functions in tandem with Prometheus enabling auto-scaling.
Nov 21 2017|Pavel Klushin
Guest post from Pavel Klushin, Solutions Architect at Spotinst.
Utilizing capacity in the cloud can save a lot of money, but taking advantage of those savings requires a lot of work. Spotinst, is a platform for running and managing elastic cloud compute and enables companies to reduce their compute infrastructure costs by 60-80%. HashiCorp Nomad provides easy-to-use and flexible cluster management and container scheduling. Nomad and Spotinst Elastigroup together allow you to efficiently deploy containerized workloads and easily manage clusters at any scale for a fraction of the cost.
Nov 01 2017|Rob Genova
We are pleased to announce the release of HashiCorp Nomad 0.7. Nomad is HashiCorp's lightweight and flexible cluster scheduler designed to easily integrate into your existing workflows. Nomad can run both microservice and batch workloads, and has first-class support for Docker as well as non-containerized applications.
Sep 19 2017|Armon Dadgar
Today at HashiConf 2017 in Austin, Texas, we announced major updates and new features across our entire suite of open source and enterprise products, including HashiCorp Terraform, HashiCorp Vault, HashiCorp Consul, and HashiCorp Nomad. In addition to these product updates, we announced the release of Sentinel, our new policy as code framework that integrates across the Enterprise product suite, and the Terraform Module Registry, which provides example infrastructure templates to make provisioning across cloud environments easier, and so much more.
Aug 11 2017|Nic Jackson
This post explores how to use the Nomad Terraform provider to control the lifecycle of a Nomad service.
Both HashiCorp Nomad and Terraform allow you to declaratively define infrastructure as code, but they serve different functions in the organization. Nomad schedules and monitors applications, making sure the application stays running and automatically reconciles any failure. Nomad supports rolling deploys to deliver safer convergence. Nomad also integrates with Consul for service discovery and Vault for secrets management. Terraform, on the other hand, is a lifecycle management and provisioning tool. It creates, updates, and destroys the underlying infrastructure which Nomad will use to run applications. But Terraform is much more than a infrastructure tool - Terraform can also manage the process of submitting, updating, and deleting Nomad applications, which will allows modeling your entire infrastructure as code.
The Nomad Terraform provider is perfect for continuous delivery for your applications, and in this post we will look at how these tools work seamlessly together to enable this workflow.
Nomad provider for HashiCorp Terraform to run jobs with HashiCorp Nomad.
Jul 26 2017|Alex Dadgar
We are pleased to announce the release of HashiCorp Nomad 0.6. Nomad is a distributed, scalable, and highly available cluster manager and scheduler designed for both microservice and batch workloads.
Nomad 0.6 includes a number of new features focused on improving job management and configuration as well as many improvements and bug fixes. Highlights include:Job deployments Job history and ability to revert to older versions Dynamic environment variables Automatic advertisement of container IP addresses with HashiCorp Consul
We are also pleased to announce that the Nomad ecosystem now includes a version of Apache Spark that natively integrates Nomad as a Spark cluster manager and scheduler. See our Running Apache Spark on Nomad blog post for additional details.
Jul 25 2017|Rob Genova
Apache Spark is a popular data processing engine/framework that has been architected to use third-party schedulers. The schedulers that are available, however, involve a level of complexity that can be undesirable for many potential Spark users. To help fill this gap, we are pleased to announce that the HashiCorp Nomad ecosystem now includes a version of Apache Spark that natively integrates Nomad as a Spark cluster manager and scheduler.
Jul 11 2017|Nic Jackson
In a previous post, we explored how HashiCorp Consul discovers other agents using cloud metadata to bootstrap a cluster. This post looks at HashiCorp Nomad's auto-joining functionality and how we can use Terraform to create an autoscaled cluster.
Feb 08 2017|Armon Dadgar
Nomad v0.5.3 introduced parameterized jobs which act as job scaffolds that can be dispatched on demand with configurable arguments. These jobs behave similar to functions, encapsulating the logic and allowing the caller to name the job and provide appropriate arguments. Nomad Dispatch treats those "function calls" like a future or promise, making it easy to build scalable processing pipelines for operations like video transcoding, image resizing, sending emails, or doing a billing rollup.
This blog post explores using the new Nomad Dispatch feature to build a video transcoding service using the popular open source tool ffmpeg. Traditional approaches to this problem often involve many different components for work queuing, scheduling, capacity planning, and failure handling. Due to its design, Nomad automatically handles these concerns, allowing for focus on a minimal job definition and the business logic of the video transcoding service.
Nov 16 2016|Alex Dadgar
We are pleased to announce the release of Nomad 0.5. Nomad is a distributed, scalable, and highly available cluster manager and scheduler designed for both microservice and batch workloads.
Nomad 0.5 includes a number of new features focused on increasing cluster security and enabling new workloads to be run on Nomad. Highlights include:Vault Integration Template Block Sticky Volumes Cluster Encryption
Jun 28 2016|Mitchell Hashimoto
We've released Nomad 0.4. Nomad is a distributed, scalable and highly available cluster manager and scheduler designed for both microservice and batch workloads.
Nomad 0.4 ships a number of new features focused on improving the operational aspects of the tool. Highlights include:Nomad Plan Live Resource Utilization Simpler Clustering
Feb 25 2016|Diptanu Choudhury
We are proud to announce the release of Nomad 0.3. Nomad is a distributed, scalable and highly available cluster manager and scheduler designed for both microservice and batch workloads.
This release introduces new features, hardens core components and improves UX across the board on the path towards ensuring Nomad is ready to run in production. Feature highlights include:Periodic Jobs Log Rotation and File System APIs Job Queues
Please see the full Nomad 0.3 CHANGELOG for more details.
Download Nomad 0.3 here or read on to learn more about the major new features and improvements in Nomad 0.3.
Nov 18 2015|Alex Dadgar
We are proud to announce the release of Nomad 0.2. Nomad is a distributed, scalable and highly available cluster manager and scheduler designed for both microservice and batch workloads.
The initial public release of Nomad was almost two months ago and we have been busy extending the system, improving user experience, and fixing bugs.
Nomad 0.2 brings many new features including service discovery, a system scheduler, restart policies, new constraint types, numerous client improvements, and much more. Please see the full Nomad 0.2 CHANGELOG for more details.
Download Nomad 0.2 here or read on to learn more about the major new features and improvements in Nomad 0.2.
Sep 28 2015|Armon Dadgar
Today we announce Nomad, a cluster manager and scheduler designed for microservices and batch workloads. Nomad is distributed, highly available, and scales to thousands of nodes spanning multiple datacenters and regions.
Nomad provides a common workflow to deploy applications across an infrastructure. Developers use a declarative job specification to define how an application should be deployed and the resources it requires (CPU, memory, disk). Nomad accepts these jobs and finds available resources to run them. The scheduling algorithm ensures all constraints are satisfied, and packs as many applications on a host as possible to optimize resource utilization. Additionally, Nomad supports virtualized, containerized, or standalone applications running on all major operating systems giving it the flexibility to support a broad range of workloads.
Nomad is now being deployed in production environments and we are proud to share it publicly. We are excited about the future of the project, and are just beginning to build on the foundation that it provides.
Read on to learn more.