iskerol/llm-hallucination-detector：本地检测 AI 输出虚假信息

🔍 llm-hallucination-detector - Detect false information in AI outputs

This software checks text generated by artificial intelligence for errors. It compares AI responses against reliable documents to confirm accuracy. Analysts use this tool to verify facts and maintain data integrity.

💻 System Requirements

Your computer needs to meet these basic standards to run the software.

• Operating System: Windows 10 or Windows 11.
• Processor: Intel Core i5 or equivalent.
• Memory: 8 GB RAM.
• Storage: 500 MB of free disk space.
• Internet: Stable connection required for initial setup.

📥 How to Install

1. Visit the official download page to get the latest version.
2. Locate the button labeled "Releases" on the right side of the page.
3. Click the version marked "Latest."
4. Find the file ending in ".exe" under the Assets section.
5. Click the filename to start your download.
6. Open your Downloads folder once the transfer finishes.
7. Double-click the installer file.
8. Follow the prompts on your screen to complete the setup process.

🛠️ Configuration Settings

The application stores settings in a local folder. You can change these preferences through the main interface.

1. Open the application from your Start menu.
2. Click the Settings icon in the top right corner.
3. Choose your preferred temporary data folder.
4. Adjust the accuracy threshold slider to change how strictly the system flags hallucinations.
5. Click Save to apply your changes.

🚀 Running the Detector

Follow these steps to check a document for errors.

1. Launch the application.
2. Click the "Source Documents" tab.
3. Select the folder containing your trusted reference files.
4. Paste the AI text you want to check into the "Input Text" box.
5. Press the "Run Analysis" button.
6. Wait for the progress bar to finish.
7. Review the highlighted sections in the window.

The software marks high-risk areas in red. It lists source references next to each statement. You can click these references to see where the data originated.

🛡️ Privacy and Data Security

The application processes your files locally on your computer. It does not send your documents to external servers. This design ensures that sensitive information remains under your control. You operate the software offline after the initial installation.

❓ Troubleshooting Common Issues

Check this list if the application fails to perform as expected.

• Application does not open: Ensure you installed the latest Windows updates. Restart your computer and try again.
• Slow analysis speeds: Close other open programs to free up system memory.
• File format errors: Ensure your source files meet the plain text or PDF format requirements.
• Connection issues: Verify your internet connection if you see a prompt asking for component updates.

📜 How it Works

The tool utilizes three specific technologies.

• FAISS: This handles the search across your documents to find relevant facts quickly.
• FastAPI: This manages the communication between the internal engine and the screen you see.
• Gradio: This powers the visual interface that allows you to interact with the system without typing code.

These components work together to provide a clean and fast user experience.

📁 Managing Reference Documents

The tool performs best when given clear, accurate source documents. You should group related files in specific folders. The software creates a local index of these files. Rebuild this index whenever you add new information to your source folders. Click "Clear Index" and then "Rebuild" in the Settings menu to refresh your data.

📊 Interpreting Results

The detector provides a confidence score for each sentence.

• Scores above 0.9 indicate the statement matches your provided documents.
• Scores between 0.7 and 0.9 indicate a possible mismatch.
• Scores below 0.7 indicate a likely hallucination.

Always manually review sentences tagged with low confidence scores. The detector serves as a guide for your review process rather than a final judgment.

📝 Updates and Support

The software receives periodic updates to improve performance. The application notifies you when a newer version is available. Click the notification bar to download the patch. Do not delete your local index folder before updating.

🛡️ Software License

This project adheres to open source standards. You can view the full license terms in the file named LICENSE located within the installation directory. Please follow the redistribution guidelines if you plan to share this software within your organization.