Business Wire

Vectara Launches Factual Consistency Score Powered by Upgraded Hughes Hallucination Evaluation Model to Enhance Transparency in GenAI Responses

Share

Vectara, the trusted Generative AI product platform, announced the inclusion of a Factual Consistency Score (FCS) for all generative responses based on an evolved version of the groundbreaking Hughes Hallucination Evaluation Model (HHEM)—the #1 hallucination detection model on Hugging Face with 100,000+ downloads since its launch last November. The associated Hallucination Leaderboard is now the industry standard for how LLMs benchmark their average factual consistency. Vectara’s end-to-end Retrieval Augmented Generation-as-a-service (RAGaaS) platform is setting a new standard as an industry-first feature for GenAI response transparency by providing real-time end-to-end RAG observability. This innovative metric provides unprecedented visibility into the factual consistency of summarized responses within Vectara’s RAGaaS platform, empowering users to set personalized thresholds for response acceptance based on a detailed accuracy score.

With average hallucination rates of LLMs on the market ranging from 3% to 16.2%, the risk of unknown inaccuracies in their response remains a major concern, preventing widespread business adoption of this powerful technology. Vectara mitigates this ambiguity for enterprises by providing a Factual Consistency Score grading the likelihood that the generated response is a hallucination or not. Only with a standardized, scientifically calculated method for grading responses can businesses responsibly introduce GenAI into business critical applications. Users have the ability to set thresholds for response acceptance based on a detailed accuracy score, giving product teams the flexibility to act on this information according to their preferences.

Vectara’s Factual Consistency Score is a groundbreaking tool in GenAI, setting a new benchmark for real-time hallucination detection and offering superior performance, affordability, and speed, thus marking a significant leap forward in trust. Its efficiency and effectiveness enable businesses to deploy GenAI into critical product use cases without being worried about exposure to liabilities that might arise from hallucinated responses.

Vectara's Factual Consistency Score equips developers with the capability to refine and enhance a wide range of applications, from internal Q&A systems to the quality of interactions with end consumers. The strength of this score lies in its calibration, making it interpretable as a direct probability—for instance, a score of 0.98 indicates a 98% probability of factual consistency. This contrasts sharply with many contemporary ML classifiers that disregard calibration, thus sacrificing clarity and direct interpretability.

"Integrating Vectara's Factual Consistency Score into the Yobi app will revolutionize how we handle AI transparency and accuracy for business use cases. By providing visibility and accountability into answers provided by our platform, we can stay true to our commitment to responsible AI that enterprises can depend on,” said Ahmed Reza, Founder and CEO of the Yobi app. “As a Co-Innovate Partner with Vectara, we're thrilled to see such advanced technology directly incorporated into the Vectara platform.”

The advanced HHEM that powers the Factual Consistency Score gives greater visibility than previously released open-sourced versions, offering enhanced accuracy and extended language support. This initiative is part of Vectara's commitment to transparency and control, empowering businesses with the autonomy to manage AI responses effectively.

"Just as we were early in pioneering RAG to enhance the relevance and quality of generated content, we are once again at the forefront of responsible AI by being completely open about our efforts to mitigate hallucinations in Generative AI," said Amr Awadallah, co-founder and CEO of Vectara. "By providing our customers with real-time access to factual consistency scores, we're not just engineering trust; we're handing over the control, enabling them to make informed decisions on how to utilize the responses generated by our RAGaaS platform."

About Vectara

Vectara is an end-to-end platform for embedding powerful generative AI features into applications with extraordinary results. As an end-to-end Retrieval Augmented Generation (RAG) platform, Vectara delivers the shortest path to a correct answer/action through a safe, secure, and trusted entry point. Vectara never trains on your data, allowing businesses to embed generative AI capabilities without the risk of data or privacy violations. To learn more, visit vectara.com.

To view this piece of content from cts.businesswire.com, please give your consent at the top of this page.

Contact information

Carly Bourne
carly@bulleitgroup.com
423-443-0449

About Business Wire

For more than 50 years, Business Wire has been the global leader in press release distribution and regulatory disclosure.

Subscribe to releases from Business Wire

Subscribe to all the latest releases from Business Wire by registering your e-mail address below. You can unsubscribe at any time.

Latest releases from Business Wire

Kai Tak Sports Park Limited and ASM Global Begin Countdown to Unveiling of World’s Largest Sports Development in History17.4.2024 16:00:00 EEST | Press release

The Hong Kong Special Administrative Region Government, ASM Global and Kai Tak Sports Park Limited (KTSPL) — which is a subsidiary of New World Development — as part of a multiyear strategy, have announced a late winter testing period for Kai Tak marking the culmination of a near decade-long record $4 billion project creating the premiere sports, recreation, entertainment complex on Earth. This press release features multimedia. View the full release here: https://www.businesswire.com/news/home/20240417546819/en/ PLAY BALL – Kai Tak Sports Park, the largest and most ambitious sports-development and entertainment district in the world, is being managed by ASM Global. (Photo: Business Wire) ASM Global, as the lead operator, has been on the ground in Hong Kong working for over five years supporting the design, programming and construction of Kai Tak Sports Park, featuring many of the world’s most advanced state-of-the-art venues and is now prepping for pre-opening activities in advance of

Qualcomm Announces Quarterly Cash Dividend17.4.2024 16:00:00 EEST | Press release

Qualcomm Incorporated (NASDAQ: QCOM) today announced a quarterly cash dividend of $0.85 per common share, payable on June 20, 2024, to stockholders of record at the close of business on May 30, 2024. About Qualcomm Qualcomm relentlessly innovates to deliver intelligent computing everywhere, helping the world tackle some of its most important challenges. Our proven solutions drive transformation across major industries, and our Snapdragon® branded platforms power extraordinary consumer experiences. Building on our nearly 40-year leadership in setting industry standards and creating era-defining technology breakthroughs, we deliver leading edge AI, high-performance, low-power computing, and unrivaled connectivity. Together with our ecosystem partners, we enable next-generation digital transformation to enrich lives, improve businesses, and advance societies. At Qualcomm, we are engineering human progress. Qualcomm Incorporated includes our licensing business, QTL, and the vast majority o

Games Global Announces Filing of Registration Statement for Proposed Initial Public Offering17.4.2024 15:17:00 EEST | Press release

Games Global Limited (“Games Global”), a leading developer, distributor and marketer of innovative online casino-style gaming content and integrated business-to-business solutions to iGaming operators globally based on the size of its studio network, announced today that it has publicly filed a registration statement on Form F-1 with the U.S. Securities and Exchange Commission (“SEC”) relating to a proposed initial public offering of its ordinary shares. The timing of the offering, number of shares to be offered and the price range for the proposed offering have not yet been determined. Games Global has applied to list its ordinary shares on the New York Stock Exchange under the symbol "GGL". J.P. Morgan, Jefferies and Macquarie Capital are acting as joint book-running managers for the proposed offering. Barclays is acting as bookrunner for the proposed offering. The proposed offering will be made only by means of a prospectus. Copies of the preliminary prospectus relating to the propo

Alpega Group Recognized as a Challenger in the 2024 Gartner® Magic Quadrant™ for Transportation Management Systems17.4.2024 15:00:00 EEST | Press release

Alpega, a global leader in logistics SaaS software, announces its recognition as a Challenger in the 2024 Gartner Magic Quadrant for Transportation Management Systems (TMS). We believe this acknowledgment underscores Alpega’s unwavering commitment to delivering cutting-edge solutions tailored to meet the evolving demands of the transportation industry. The Gartner report evaluates vendors based on their completeness of vision and ability to execute. This press release features multimedia. View the full release here: https://www.businesswire.com/news/home/20240417652913/en/ (Photo: Alpega) Alpega serves global customers with deployments in all geographies, addressing diverse sectors such as automotive, retail, fast-moving consumer goods, and manufacturing, Alpega places significant emphasis on fostering collaboration with carriers, optimizing transportation procurement, and championing environmental, social, and governance (ESG) initiatives. Backed by a history of exceptional customer r

Wolters Kluwer announces two senior executive appointments17.4.2024 15:00:00 EEST | Press release

Wolters Kluwer, a global leader in information, software, and services for professionals, today announced Atul Dubey as General Manager of its Finance, Risk and Regulatory Reporting (FRR) business, part of its Corporate Performance & ESG (CP & ESG) division. Suzanne Konstance will succeed Dubey as General Manager of Wolters Kluwer Legal & Regulatory U.S, part of the company’s Legal & Regulatory division, effective May 1. Karen Abramson, CEO of Wolters Kluwer CP & ESG, commented: “Atul’s deep understanding of the financial regulatory and risk landscape will be critical strengths as he takes this global leadership role for Wolters Kluwer FRR, driving growth and relentless innovation for our clients.” Wolters Kluwer FRR’s award-winning OneSumX suite of solutions support financial institutions through innovative technology that enables and empowers clients to stay compliant with everchanging regulatory requirements, manage uncertainty through financial risk management offerings and drive e

In our pressroom you can read all our latest releases, find our press contacts, images, documents and other relevant information about us.

Visit our pressroom
HiddenA line styled icon from Orion Icon Library.Eye