Knowledge base

TL;DR The article outlines a solution for processing complex, binary data using Delta Live Tables (DLT) and mapInPandas within the Databricks ecosystem. Traditional ETL pipelines struggled with the unique challenges of mixed-format metadata and asynchronous data streams. By leveraging DLT's declarative ETL pipelines and mapInPandas for efficient Python-native transformations, we transformed binary data into structured, analytics-ready tables.

Databricks Apps has proven to be a strong enabler-bringing together data engineering, AI, and application development into a cohesive, scalable environment. As data and Al technologies continue to advance, platforms like this will play a pivotal role in helping organisations innovate and respond quickly to change

Migrating from SAP BW is crucial to stay competitive, with modern platforms offering better scalability, AI integration, agility, and long-term sustainability.

GenAI security goes beyond data - secure your app, infra, and APIs with role-based access, MSAL/Easy Auth, and infrastructure-as-code best practices.

Explore the Microsoft Build 2025’s AI Foundry updates - boosting agent tools, security, and scalability that help clients accelerate innovation.

Discover five key takeaways from Qlik Connect. Trusted data, open lakehouse, the future of analytics in Qlik Cloud and more.

Databricks' Tech Kickoff FY26 highlighted key innovations in AI/BI dashboards, Mosaic AI, SAP Databricks and Databricks Apps, showcasing best practices in data and AI.

ESG (Environmental, Social, Governance) measures a company's sustainability and impact while CSRD is an EU directive standardizing corporate sustainability reporting.

Qlik Data Flow is a no-code/low-code tool in Qlik Cloud for visual data transformation, integration and preparation, ideal for non-technical users.