Knowledge base

Search
On June 18th 2020, Databricks announced that the Apache Spark 3.0 release is available as part of their new Databricks Runtime 7.0. Apache Spark 3.0 itself got released only 8 days prior on the 10th of June. We really love these quick innovation...
Yoshi Coppens's picture
Yoshi Coppens
It’s not easy to work with incremental data in a data lake. If you would want to transform only the data files that just entered your data lake, you would need a notification service, a message queue and/or a batch trigger all to just get the...
Ivana Pejeva's picture
Ivana Pejeva
As the official documentation is not covering this, we have built a guide on how to create an Azure Machine Learning pipeline and how to run this pipeline on an Azure Databricks compute.
Pieter Sterkens's picture
Pieter Sterkens
At element61 we love to work with your data. Our philosophy is providing you a Modern Data Platform in which you can do real-time analytics, big data batch analytics as well as apply Machine Learning and AI.
Ivana Pejeva's picture
Ivana Pejeva
element61 believes Delta features create a big opportunity for anyone starting with a Data Lake or already having a Data Lake.
Ivana Pejeva's picture
Ivana Pejeva
Azure Databricks is an Apache Spark-based analytics service that allows you to build end-to-end machine learning & real-time analytics solutions. Azure Databricks offers all of the components and capabilities of Apache Spark with a possibility...
Ivana Pejeva's picture
Ivana Pejeva