- 22990 Views
- 13 replies
- 24 kudos
Databricks Announces the Industry’s First Generative AI Engineer Learning Pathway and Certification
Today, we are announcing the industry's first Generative AI Engineer learning pathway and certification to help ensure that data and AI practitioners have the resources to be successful with generative AI. At Databricks, we recognize that generative ...
- 22990 Views
- 13 replies
- 24 kudos
- 27 Views
- 0 replies
- 0 kudos
LLM with the largest context window
A Generative AI Engineer is tasked with developing an application that is based on an open-source large language model (LLM). They need a foundation LLM with a large context window. Which model fits this need?DBRX,Llama2-70B,DistilBert MPT-30B.DBRX h...
- 27 Views
- 0 replies
- 0 kudos
- 132 Views
- 3 replies
- 0 kudos
Are serverless endpoints possible in this Technical Blog post by qianyu?
Hi, are serverless endpoints possible for Whisper and Llama in this Technical Blog post by qianyu?https://community.databricks.com/t5/technical-blog/streamline-customer-call-center-transcripts-analytics-with/ba-p/101689Thanks!
- 132 Views
- 3 replies
- 0 kudos
- 0 kudos
https://www.databricks.com/product/pricing/foundation-model-servingWe don´t serve models on databricks, but as far as i can see you pay per input/output tokens (for foundation models).For classic models:https://www.databricks.com/product/pricing/mode...
- 0 kudos
- 32 Views
- 0 replies
- 0 kudos
Whether Databricks has any plans to Integrate Databricks Genie with Azure OpenAI?
Hi,I am checking to see if Databricks has any plans to Integrate Databricks Genie with Azure OpenAI? as I know Databricks Genie is designed to work with Databricks' data ecosystem itself. But is there any plans to enhance this capability where we can...
- 32 Views
- 0 replies
- 0 kudos
- 945 Views
- 1 replies
- 0 kudos
Langchain SQLDatabase not fetching column names from table in Unity Catalog
I am building a text-to-sql agent using Langchain API.I created a SQLDatabase using: db = SQLDatabase.from_databricks(catalog="`my-catalog-name`", schema="my_schema", host="...", api_token="...", warehouse_id="12345678")When I call db.get_table_info(...
- 945 Views
- 1 replies
- 0 kudos
- 0 kudos
Hi there,I am facing the similar issue. Were you able to fix this?
- 0 kudos
- 329 Views
- 4 replies
- 2 kudos
Resolved! MLFlow Authentication from Databricks App for GenAI Tracing
I am working on a Dash-based app that includes a call to a Databricks-hosted LLM endpoint. I am trying to track those calls with MLFlow. My code is (roughly) like this:from openai import OpenAIimport mlflowmlflow.set_tracking_uri("databricks")mlflow....
- 329 Views
- 4 replies
- 2 kudos
- 2 kudos
Thank you for the push in the right direction! I was able to solve the issue with this codeos.environ["DATABRICKS_CLIENT_ID"] = "" os.environ["DATABRICKS_CLIENT_SECRET"] = "" os.environ["DATABRICKS_TOKEN"] = os.environ.get("VAR_CONFIGURED_WITH_DATABR...
- 2 kudos
- 2953 Views
- 2 replies
- 0 kudos
AI/BI Genie API
Hi everyone,I'm currently working on a project that implements a custom front end for Genie using the Genie API: https://docs.databricks.com/api/workspace/genie. So far, I’ve successfully built a working model that can send and receive messages.Howev...
- 2953 Views
- 2 replies
- 0 kudos
- 0 kudos
Is there any possibility that workspace admin could have removed this permission to you? If you check the permissions on your side do you see yourself with at least Can View?
- 0 kudos
- 303 Views
- 1 replies
- 0 kudos
Roadmap for vector_search function
I was wondering if there was a roadmap for the development of the vector_search function: vector_search function | Databricks DocumentationSpecifically, I was wondering if / when the following limitations may be lifted:Querying DIRECT_ACCESS index ty...
- 303 Views
- 1 replies
- 0 kudos
- 0 kudos
Hello @jAAmes_bentley, DIRECT_ACCESS & filters_json are not currently supported with vector_search sql function. These are on our roadmap, but we don’t have concrete ETAs to share at the moment as we’re focusing on other high-priority tasks. Hybrid s...
- 0 kudos
- 22990 Views
- 13 replies
- 24 kudos
Databricks Announces the Industry’s First Generative AI Engineer Learning Pathway and Certification
Today, we are announcing the industry's first Generative AI Engineer learning pathway and certification to help ensure that data and AI practitioners have the resources to be successful with generative AI. At Databricks, we recognize that generative ...
- 22990 Views
- 13 replies
- 24 kudos
- 496 Views
- 1 replies
- 0 kudos
How to do NLP against PDFs in Databricks? Can be done in Snowflake very easily.
I’d love to build a quick "art of the possible" demo showing how easy it is to query unstructured PDFs using natural language. In Snowflake, I wired up a similar solution in ~2 hours just by following their tutorial guide.Does anyone know the best wa...
- 496 Views
- 1 replies
- 0 kudos
- 0 kudos
To query unstructured PDF files using natural language in Databricks, you can leverage an approach similar to the "Retrieval Augmented Generation (RAG) and DBRX" demo. Although the specific demo you referenced (https://notebooks.databricks.com/demos/...
- 0 kudos
- 477 Views
- 4 replies
- 3 kudos
LangChain Compatibility in Databricks – Painfully Inconsistent Experience
Hey all,Is anyone else experiencing major friction when using LangChain within Databricks?Even after carefully pinning versions like:%pip install \ loguru \ mlflow==2.10.1 \ langchain==0.1.5 \ langchain-google-vertexai \ databricks-vectorse...
- 477 Views
- 4 replies
- 3 kudos
- 3 kudos
I'll definitely look into installing libraries at the cluster level via init scripts makes a lot of sense for stability and reproducibility. I hadn't considered that approach, so I really appreciate you highlighting that and providing the relevant Da...
- 3 kudos
- 5477 Views
- 8 replies
- 0 kudos
Gen AI course material
Databricks updated the Generative AI course https://partner-academy.databricks.com/learn/lp/315/generative-ai-engineering-pathway but the course material is missing in the partner academy. Does anybody know where to download the course material?
- 5477 Views
- 8 replies
- 0 kudos
- 0 kudos
do you have any update on why course material is not appearing in partner acadamy course version?
- 0 kudos
- 262 Views
- 0 replies
- 0 kudos
How to use `predict_stream` in Databricks deployed ChatAgent.
Hello,We are working on a solution to have a streaming chat agent. Our agent works fine in the Playground but when we try to call it as an api under /invocations, the streaming does not work.
- 262 Views
- 0 replies
- 0 kudos
- 531 Views
- 1 replies
- 0 kudos
Getting "The given endpoint does not exist" for LLM endpoint though I've access to it
When trying out this LLM RAG notebook steps I'm getting this error:"The given endpoint does not exist, please retry after checking the specified model and version deployment exists"This notebook originally referred to databricks-meta-llama-3-1-70b-in...
- 531 Views
- 1 replies
- 0 kudos
- 0 kudos
Hey @Iris12 ,Not sure if this will fix your issue, but I’ve seen similar errors caused by permission mismatches.Make sure that the user or service principal you’re using has the correct permissions both in the Models and Serving tab.Also, double-chec...
- 0 kudos
- 385 Views
- 2 replies
- 1 kudos
Databricks Genie new space creation using API
I am exploring an option to see if Databricks Genie can be created using API or using python script?
- 385 Views
- 2 replies
- 1 kudos
- 1 kudos
Will keep an eye on updates as it will open doors for cross linking/sharing with other Open AI models.
- 1 kudos
- 580 Views
- 0 replies
- 0 kudos
Invoke Azure AI Search Endpoint through Databricks environment
Hi Team,Is there a possibility to invoke Azure AI Search Vector DB endpoint(external) in Databricks environment based on input data in Databricks table.Scenario: Client-Specific documents are already embedded in Azure AI Search Vector DB. Is there an...
- 580 Views
- 0 replies
- 0 kudos
