Databricks Community

Introduction In this article, we’ll walk through how to develop, configure, and deploy a Databricks App for understanding complex code bases. While there’s a lot of freely available, world class software to explore in open source, it’s challenging to...

The Challenge How do you classify billions of free-text entries when there's no “golden dataset” to train on? We can use LLMs for their impressive zero-shot capabilities, but they’re resource-intensive and slow for real-time inference. In this articl...

Introduction Data and AI media will try to convince you of two terribly misguided ideas about AI’s impact on analytics. First of all, there’s the idea that prompt engineers who know just the right phrase to unlock the secret powers of generative AI w...

Introduction MLflow makes it easy to log and deploy machine learning models for use across your organization. However, the standard MLflow interfaces may not provide the necessary functionality to achieve every use case. For example, a simple scikit-...

Introduction If you’re coming from a Pandas background, moving from the simple Pandas on Spark API into the more flexible Pandas function paradigms can be very intimidating. More importantly, it’s very confusing to distinguish between what appears to...