Terraforming Data Analytics Environments with Databricks

One of most difficult tasks for new Data Scientists is to building their environment. Most of them do not know or care how the underlying infrastructure is built to host all the resources and/or services they require, like Databricks Workspaces, clusters, storage.

What You'll Learn

Marcelo Zambrana will build a data analytics environment using HashiCorp Terraform and the brand new Databricks resource provider. Everything will be done using GitHub Actions, Terraform Cloud, and GitHub Code Spaces so we can have all our development environment in the cloud, and we do not have to manage any of it. By the end of the demo, we should have a clean data analytics environment connected to the System Wide Information Management (SWIM) Program which will allow you to analyze flight data.

Speaker: Marcelo Zambrana