Anthropic introduced a new application programming interface (api) feature on Thursday to let developers grind the responses generated by artificial intelligence (ai) models. Dubbed citations, the feature allows developers to restruct the output generation of the claude family of ai models to source documents. This is aimed at improvement the reliability and accuracy of the AI-Generated Responses. The AI Firm has alredy provided the feature to companies Notably, the feature is available without any additional cost.
Anthropic Introduces a New Grounding Feature
Generative ai models are typically prone to errors and hallucination. This Occurs trust of the massive datasets they have to look through to find responses to user queries. Adding web searches to the equation only making makes it tricker for large language models (lLMS) to avoid inaccurate information as they use related to basic retrieval-augmented generation (rag).
AI companies, which also build specialized tools, often restruct data access to the llms to improve accuracy and reliability. Some examples of such tools include Gemini in Google Docs, AI-Powered Writing Assist Tools in Samsung and Apple Smartphones, and PDF Analysis tools in Adobe Acrobat. However, creating such a layer is not possible in api as developers build a wide range of tools that have different data requirements.
To solve this problem, anthropic introduced the citations feature for its. Detailed in a newsroom postThe feature lets claude ground its responses in source documents. This means claude ai models can provide detailed references to the exact paragraph and sentences it look the information to generate the output. The AI Firm Claims this tool will make the ai-generated responses Easily verifiable and more Trustworthy.
With this, users can add source documents to the context window, and claude will automatically know the source in its output wherever it infers them from the source maternal. As a result, developers will not have to relay upon complex prompts to ask claude to include source information, which the company account and cumansisomesome methode.
Anthropic Claimed that with Citations, Developers will be able to easily build ai solutions for documents, tools tools to answer complex queries based on long documents, as well assistant Supstorms.
Notable, the company stated that citations uses anthropic's standard token-based pricing model and users will not pay for output tokens that return the quoted text. However, there might be an extra charge for additional input tokens that are used to process the source documents. Citations are currently available for the new claude 3.5 sonnet and claude 3.5 haiku models.