Running Databricks Overwatch in practice - A tool to spot performance gains and cost savings in Spark

Your role

As a Data Scientist & Data Engineer you want to leverage scalable computing: you want to leverage a compute cluster to run your increasing workloads faster & smoother. For this, we use Spark and often Databricks, our managed Spark platform. However, running a compute cluster can rapidly become complex and expensive: you need to size your cluster correctly, tune your data in line with your cluster & spot performance gain opportunities.
With Databricks Overwatch we get the opportunity to monitor & spot performance gains & cost savings in Spark and proactively guide Data Scientists and Data Engineers in right sizing their jobs on the right cluster.



Your profile


In this traineeship, the student will

  1. be the first in testing out Databricks Overwatch, evaluating its inner workings and its relevance
  2. pioneer and work with the element61 team on how to make it fit for our customers & typical projects

This traineeship will trigger your entrepreneurial skills and allow you to make the assessment if & how it can be broader rolled out and used.
The student will be able to work with state-of-the-art technology while using this on a real-life use case.

As a trainee, we expect you to:

  • Translate your academic knowledge into business solutions & a first hands-on experience;
  • Do data development using Python, SQL in Azure and Databricks;
  • Show your documentation and reporting skills through presentations and demo’s;
  • Show creativity and out-of-the-box thinking in this challenging use-case.

What are we looking for:

  • Character: customer-oriented, able to work in a team, keen to create something new in international teams;
  • Working Practice: analytical, structured and result-orientated;
  • Passionate about analytics, machine learning technology & applications and eager to learn;
  • Enthusiasm to be part of a growing team & industry.

Language: working level English

Interested to find out more ? Send us your profile and motivation at