The LLM Mesh acts as a secure API gateway to break down hard-coded dependencies, managing and routing requests between applications and underlying services.
Dataiku partners with leading providers of large language models (LLMs), vector databases, and accelerated and containerized compute capabilities. This includes Hugging Face for serving production-grade local LLMs easily and efficiently.
SEE AVAILABLE LLM CONNECTIONS
Should you build your Generative AI-powered application on top of today’s best model? Or should you hold out just a little longer until a new one emerges that’s more accurate, powerful, or better suited for your use case?
With Dataiku, you don’t have to choose. Balance trade offs between cost, performance, privacy, security, regulatory requirements, and more with a multi-LLM strategy. The LLM Mesh is the most comprehensive and agnostic LLM gateway offering on the market, partnering with the top Generative AI players for secure access to thousands of LLMs (both as a service or self-managed).
We compared five different LLM models, something we couldn’t do without Dataiku, and found that one model continued to outperform the rest by a healthy margin for our specific use case.
We realize that no single LLM is good for every use case.
Deepthi Sanam
Group Lead of Data Engineering at Novartis
Kenan Yates
Group Product Manager at System1Analyze up-to-the-minute data on LLM usage via Cost Guard.
A fully auditable log of who is using which model or service and for what purpose allows for cost tracking and internal re-billing.
DIG DEEPER ON LLM GUARD SERVICES
When it comes to screening for private data or inappropriate content, the LLM Mesh — via Dataiku Safe Guard — can evaluate requests and responses for sensitive information. This includes detecting personally identifiable information (PII), toxic content, or forbidden terms.
The LLM Mesh then takes appropriate action: redact this sensitive information before sending the request to the LLM API, block the request entirely, and/or alert an admin.
LEARN MORE ABOUT LLM GUARD SERVICESDataiku Quality Guard provides standardized, enterprise-grade quality assurance for LLMs and Generative AI applications.
Automatically compute standard evaluation metrics like LLM-as-a-judge techniques (answer relevancy, answer correctness, context precision, etc.) as well as statistical techniques (BERT, Rouge and Bleu, etc.).
DISCOVER LLM GUARD SERVICES
Andres Buser
Chapter Lead New Modality IP at Roche
Qualifying, documenting, and framing your organization’s use of LLMs is a critical step toward regulatory readiness.
Keep model documentation up to date as well as rationalize which models should (or should not) be used for what use cases with the Dataiku LLM Registry.
MORE ABOUT AI GOVERNANCE WITH DATAIKUThe LLM Mesh monitors the round-trip performance for LLM services and providers so teams can diagnose issues and select the optimal service based on application needs and SLAs.
Additionally, caching of responses to common queries avoids the need to regenerate responses, offering both cost savings and a performance boost.
Dataiku brings not only the LLM Mesh, but all the tools required for builders across the business to bring Generative AI applications to life — fast and code free.
The Universal AI Platform provides your stakeholders with everything they need to create Generative AI applications at scale, including:
Roche harnesses Generative AI and the Dataiku LLM Mesh to automate case law analysis, boosting efficiency and reducing resource costs.
READ ROCHE'S STORY
For Novartis, the LLM Dataiku Mesh abstracted intricate model configurations — like model parameters and prompt formats — into holistic, user-friendly UI options, thereby streamlining the experimentation process with various models across multiple service providers.
READ NOVARTIS' STORY
U.S.-based regional fast food chain Whataburger — with over 1,000 restaurants across 15 states — has a high-visibility dashboard that analyzes thousands of online and internal customer reviews. See how they used LLMs in Dataiku to extract key information from the reviews and build the dashboard.
READ WHATABURGER'S STORY
"Implementing our LLM-powered chatbot as a one-stop data discovery solution addresses core challenges such as fragmented information, lack of guidance, mistrust in data quality, and time-consuming processes." — Nirali Dedaniya, Data Engineer at Akamai Technologies
READ AKAMAI'S STORY
LG Chem noticed that their employees were spending a lot of time searching for safety regulations and guidelines so, with the help of Generative AI and Dataiku, they provided an AI service that helps them find that information quickly and accurately.
READ LG CHEM'S STORY
Ørsted uses Generative AI to ensure its executive management has a more aligned understanding of market dynamics, for a 100% time savings over a manual approach.
READ ØRSTED'S STORY
Each of Heraeus’s 20 operating companies has its own lead identification and qualification process. Heraeus uses LLMs in Dataiku to support these processes, ultimately saving time and increasing sales conversion.
READ HERAEUS'S STORY
