SAN FRANCISCO, Sept. 19, 2023 (GLOBE NEWSWIRE) — Galileo, a leading machine learning (ML) company for unstructured data, today announced the general availability of Galileo LLM Studio, a platform for building trustworthy LLM applications and getting them into production faster. The platform has Prompt and Fine-Tune modules and now has a third module, Monitor, that provides a continuous feedback loop for developers and data scientists. All three modules leverage Galileo’s Guardrail Metrics Store where users can find unique evaluation metrics created by Galileo’s research team which enhance developer productivity and provide robust hallucination detection or build their own custom metrics.
Galileo will be showcasing LLM Studio at The AI Conference in San Francisco next week: https://aiconference.com/
“Enterprises face multiple challenges in operationalizing generative AI ranging from prompt engineering to managing model performance to quantify the impact of these models. Businesses seeking to translate the foundational large language models that are taking the world by storm into enterprise-ready applications need to take all of these aspects into account,” said Hyoun Park, CEO and Principal Analyst at Amalgam Insights.
Founded by former Apple, Google and Uber AI product and engineering leaders, Galileo launched in 2022 with the first ML data intelligence platform for unstructured data which is now being used by startups to the Fortune 500. The platform supports Natural Language Processing (NLP) and Computer Vision (CV) and now LLMs as part of the company’s mission to unlock the value of unstructured data (text, image, speech and more) which accounts for more than 80% of the world’s data today.
As organizations of all sizes and across industries begin to consider the potential applications of generative AI, it is more important than ever for organizations to have governance frameworks in place to minimize the risk of LLM hallucinations in a scalable and efficient manner.
“There is a strong need for an evaluation toolchain across prompting, fine-tuning and production monitoring to proactively mitigate hallucinations. Galileo’s LLM Studio offers exactly that toolchain. Highly recommend it to all LLM builders!” said Waseem Alshikh, co-founder and CTO of Writer, a leading generative AI platform company.
“We’ve spent the last year speaking with enterprises working to bring LLM-based applications to production and three things became radically clear. First, companies of all sizes now have LLM powered applications in production. Second, LLM output evaluation is painfully manual with no guardrails against hallucinations. Third, teams are looking for sophisticated metric-driven monitoring for their applications in production. This need for LLM evaluation, experimentation and observability was core to our latest release,” said Vikram Chatterji, co-founder and CEO of Galileo.
Galileo LLM Studio has three modules:
- Prompt helps teams find the ‘right’ prompt fast and lets teams collaboratively build, evaluate and experiment to find prompts that perform well and minimize hallucinations.
- Fine-Tune lets users fine-tune LLMs using the right context and their own unique data. Galileo’s evaluation metrics make it easy to identify the data that is pulling model performance down.
- Monitor powers the continuous feedback loop needed to drive constant prompt and data improvements by giving users a set of observability tools and evaluation metrics to monitor application performance in production, such as cost, latency and hallucinations.
Additional Resources:
- Read the blog on Galileo LLM Studio: https://www.rungalileo.io/blog/announcing-ll
- Join the webinar on Galileo LLM Studio on October 4: https://hopin.com/events/announcing-llm-studio
About Galileo
Galileo’s mission is to unlock the value of unstructured data for ML. With more than 80% of the world’s data being unstructured and recent model advancements massively lowering the barrier to utilizing the data for enterprise ML, there is an urgent need for the right data-focused tools to build high performing models fast. Galileo is based in San Francisco and backed by Battery Ventures, Walden Catalyst and The Factory. For more information, visit https://www.rungalileo.io or follow @rungalileo.
Media and Analyst Contact:
Amber Rowland
amber@therowlandagency.com
+1-650-814-4560
