URL Reachability Scanner

(Output scanner)

This scanner identifies URLs in the text and checks them for accessibility, ensuring that all URLs are reachable and not broken.

Motivation

Large Language Models (LLMs) like GPT-4 have the capacity to generate a variety of content, including URLs. While these models are trained on extensive datasets to provide accurate and relevant information, there's a possibility of generating URLs that are either incorrect or no longer accessible. Ensuring the reachability of these URLs is crucial for maintaining the credibility and usefulness of the content produced by LLMs.

How it works

It scans the text for URLs and verifies each URL's accessibility. A URL is considered reachable if a request to it returns a successful HTTP status code (200 OK). If the URL is not accessible (for instance, due to a broken link or server error), the scanner flags it as unreachable.

Optimization Strategies

• Timeout Settings: Configure appropriate timeout settings in the HTTP requests to balance between thorough checking and efficiency.

URL Reachability Detection Policy for AI Chatbot

Create a new policy as same as shown in LLM Guardrails Policy, for URL Reachability detection select scanner URL Reachability (Customize - 200).

Optionally, perform a test to ensure the policy is functioning as intended. Check that URL Reachability is detected and blocked as specified.