Join APJ's premier AI/BI virtual challenge to solve real-world business problems, sharpen your skills, and compete for prizes using the Databricks Data Intelligence Platform. This challenge provides a unique opportunity to work together, apply AI-dri...
- 4275 Views
- 0 replies
- 1 kudos
3 weeks ago
We’re excited to invite you to our MONTHLY Databricks Get Started Days, a half-day virtual learning experience designed to jumpstart your journey with Databricks. This global event is tailored to equip you with essential data engineering and analysi...
- 6014 Views
- 5 replies
- 0 kudos
04-03-2025
AI is transforming BI by changing the way organizations manage, analyze and get insights from their data. Everyone is rushing to democratize access to data through LLMs. But without the right foundation, you can’t get the most from AI. Our new appro...
- 4685 Views
- 0 replies
- 3 kudos
04-03-2025
Be part of a global movement! Connect with 22,000 data enthusiasts at 700+ sessions, keynotes, and hands-on training at this year’s Data + AI Summit. Whether you’re into data intelligence, governance, AI, or data warehousing, this is your chance to l...
- 11645 Views
- 2 replies
- 4 kudos
02-19-2025
Community Activity
- 0 Views
- 0 replies
- 0 kudos
How to download widget result into CSV
In the databricks Tutorial (https://docs.databricks.com/gcp/en/sql/get-started/sample-dashboards) , it says we can right click the widget and choose "Download as CSV". However, in my databricks dashboard, when I right click the widgets, there is no ...
- 0 Views
- 0 replies
- 0 kudos
- 5 Views
- 1 replies
- 0 kudos
ConcurrentDeleteDeleteException in liquid cluster table
I am doing a merge in a table in parallel via 2 jobs.The table is a liquid clustered table with the following properties:delta.enableChangeDataFeed=truedelta.enableDeletionVectors=truedelta.enableRowTracking=truedelta.feature.changeDataFeed=supported...
- 5 Views
- 1 replies
- 0 kudos
Latest Reply
- 0 kudos
Hey @flashmav , keep in mind that operations in Delta Lake often occur at the file level rather than the row level. For example, if two sessions attempt to update data in the same file (even if they’re not updating the same row), you may encounter a...
- 0 kudos
- 41 Views
- 2 replies
- 1 kudos
What are your most impactful use cases for schema evolution in Databricks?
Data Engineers, Share Your Experiences with Delta Lake Schema Evolution! We're calling on all data engineers to share their experiences with the powerful schema evolution feature in Delta Lake. This feature allows for seamless adaptation to changin...
- 41 Views
- 2 replies
- 1 kudos
Latest Reply
- 1 kudos
@LRALVA , thank you for your insightful feedback. I have a follow-on question if you don't mind? You emphasized the importance of schema governance and automated validations to prevent unintended schema drifts. Could you share how you automate these...
- 1 kudos
- 84 Views
- 1 replies
- 1 kudos
Lab for blended learning courses
I subscribed to the Blended Learning program ($1500) and enrolled in one of the courses to begin training. I understood it to be a self-paced learning experience with on-demand labs. However, I was redirected to uplimit.com, where I can only choose ...
- 84 Views
- 1 replies
- 1 kudos
Latest Reply
- 1 kudos
Hello @Troy! Please drop an email to [email protected]. They will be able to better assist you with this question.
- 1 kudos
- 13 Views
- 0 replies
- 0 kudos
Unity Catalog with automatic enablement (Part 2 - AWS)
IntroductionWhat is a Workspace Catalog?How Automatic Workspace Assignment WorksAWS infrastructure deployed during automatic enablementSystem-owned groups and permissionsMetastore-level grants for Auto-Enabled Workspace AdministratorsBest practices f...
- 13 Views
- 0 replies
- 0 kudos
- 16 Views
- 0 replies
- 0 kudos
Unity Catalog with automatic enablement (Part 1 - Azure)
IntroductionWhat is a Workspace Catalog?How Automatic Workspace Assignment WorksAzure infrastructure deployed during automatic enablementSystem-owned groups and permissionsMetastore-level grants for Auto-Enabled Workspace AdministratorsBest practices...
- 16 Views
- 0 replies
- 0 kudos
- 6514 Views
- 6 replies
- 6 kudos
Issue with Docker Image connection
Hello, I have created and pushed a docker image to Azure Container Registry . I used that image to start the cluster in Databricks. But the cluster doesn't start and as such when I try to run a Databricks' Jon using that Cluster, I get this error bel...
- 6514 Views
- 6 replies
- 6 kudos
Latest Reply
- 6 kudos
We have the same issue, right now. Which is the problem??
- 6 kudos
- 27 Views
- 0 replies
- 0 kudos
Using the Transform Pattern in PySpark for Modular and Maintainable ETL
Data engineers, scientists, and analysts working with big data often rely on PySpark to build ETL (Extract-Transform-Load) pipelines. These pipelines typically involve a series of transformations applied to raw data to clean, enrich, and prepare it f...
- 27 Views
- 0 replies
- 0 kudos
- 17 Views
- 0 replies
- 0 kudos
Exploring Code With Databricks Apps
Introduction In this article, we’ll walk through how to develop, configure, and deploy a Databricks App for understanding complex code bases. While there’s a lot of freely available, world class software to explore in open source, it’s challenging to...
- 17 Views
- 0 replies
- 0 kudos
- 15 Views
- 0 replies
- 0 kudos
Monitoring Structured Streaming in Production
Intro Databricks customers use Structured Streaming to drive critical business functions like equipment monitoring, fraud detection, and inventory management. Reliability is a key design factor for these workloads. Engineers design streaming jobs for...
- 15 Views
- 0 replies
- 0 kudos
- 16 Views
- 0 replies
- 0 kudos
[Partner Blog] Using GenAI on Databricks to Implement Master Data Management (MDM)
Summary Learn how Lakefusion modernizes MDM using GenAI on Databricks.Discover real-world use cases of AI-driven master stand the architectural synergy between Lakehouse and Lakefusion. Introduction: The Challenge of MDM in the Modern Data Landscape...
- 16 Views
- 0 replies
- 0 kudos
- 13 Views
- 0 replies
- 0 kudos
Databricks AWS permission question
Hello,I'm currently using Databricks on AWS for some basic ETL where the resulting data is stored as Hive external delta tables.Even though Unity catalog is disabled, table access control is disabled for the workspace, and the cluster is running with...
- 13 Views
- 0 replies
- 0 kudos
- 17 Views
- 2 replies
- 0 kudos
Databricks Associate Certification Batch Not Received since 6 days
Hi Team,I hope this message finds you well.I cleared for the Databricks Associate Certification exam, but I have not yet received my badge. I would appreciate it if you could help me with the status or guide me on the next steps to claim it.I have ch...
- 17 Views
- 2 replies
- 0 kudos
Latest Reply
- 0 kudos
Just received my credentials Thanks for the fast and quick solution @Cert-TeamOPS
- 0 kudos
- 6 Views
- 0 replies
- 0 kudos
LLM with the largest context window
A Generative AI Engineer is tasked with developing an application that is based on an open-source large language model (LLM). They need a foundation LLM with a large context window. Which model fits this need?DBRX,Llama2-70B,DistilBert MPT-30B.DBRX h...
- 6 Views
- 0 replies
- 0 kudos
- 27 Views
- 1 replies
- 0 kudos
Unable to scehdule databricks certification
Hi, I'm trying to schedule Databricks certification using https://www.webassessor.com/databricks link , however when I login it's taking me to Matillion Certification page and I'm not able to see any databricks certification. I tried using different ...
- 27 Views
- 1 replies
- 0 kudos
Latest Reply
- 0 kudos
Hello @AnuKurian! Please raise a ticket with the Databricks Support Team, they will be able to assist with this issue.
- 0 kudos
Announcements
Latest from our Blog
Unity Catalog with automatic enablement (Part 2 - AWS)
IntroductionWhat is a Workspace Catalog?How Automatic Workspace Assignment WorksAWS infrastructure deployed during automatic enablementSystem-owned groups and permissionsMetastore-level grants for Aut...
Unity Catalog with automatic enablement (Part 1 - Azure)
IntroductionWhat is a Workspace Catalog?How Automatic Workspace Assignment WorksAzure infrastructure deployed during automatic enablementSystem-owned groups and permissionsMetastore-level grants for A...
Using the Transform Pattern in PySpark for Modular and Maintainable ETL
Data engineers, scientists, and analysts working with big data often rely on PySpark to build ETL (Extract-Transform-Load) pipelines. These pipelines typically involve a series of transformations appl...
Exploring Code With Databricks Apps
Introduction In this article, we’ll walk through how to develop, configure, and deploy a Databricks App for understanding complex code bases. While there’s a lot of freely available, world class softw...
