Your role
As a Data Scientist & Data Engineer you want to leverage scalable computing: you want to leverage a compute cluster to run your increasing workloads faster & smoother. For this, we use Spark and often Databricks, our managed Spark platform. However, running a compute cluster can rapidly become complex and expensive: you need to size your cluster correctly, tune your data in line with your cluster & spot performance gain opportunities.
With Databricks Overwatch we get the opportunity to monitor & spot performance gains & cost savings in Spark and proactively guide Data Scientists and Data Engineers in right sizing their jobs on the right cluster.
Your profile
Goal:
In this traineeship, the student will
- be the first in testing out Databricks Overwatch, evaluating its inner workings and its relevance
- pioneer and work with the element61 team on how to make it fit for our customers & typical projects
This traineeship will trigger your entrepreneurial skills and allow you to make the assessment if & how it can be broader rolled out and used.
The student will be able to work with state-of-the-art technology while using this on a real-life use case.
As a trainee, we expect you to:
- Translate your academic knowledge into business solutions & a first hands-on experience;
- Do data development using Python, SQL in Azure and Databricks;
- Show your documentation and reporting skills through presentations and demo’s;
- Show creativity and out-of-the-box thinking in this challenging use-case.
What are we looking for:
- Character: customer-oriented, able to work in a team, keen to create something new in international teams;
- Working Practice: analytical, structured and result-orientated;
- Passionate about analytics, machine learning technology & applications and eager to learn;
- Enthusiasm to be part of a growing team & industry.
Language: working level English
Interested to find out more ? Send us your profile and motivation at jobs@element61.be