Skip to content

Latest commit

 

History

4 Commits

Folders and files

NameName
Last commit message
Last commit date
 
 
 
 

Repository files navigation

📊 perform_comparison_1c_rag_mcp - Compare performance of 1C code analysis tools

📖 Project Overview

This software helps users compare how different MCP servers perform when they analyze 1C code bases. You use this tool to measure speed and accuracy. It provides clear insights into how these automated assistants handle technical tasks.

Developers often spend time checking code logic. This tool automates the process and shows you which setup works best for your specific project needs. You reduce manual effort by letting the software run the comparison tests for you.

🖥️ System Requirements

Before you install this software, ensure your computer meets these basic standards. These settings help the tool run without errors.

  • Operating System: Windows 10 or Windows 11.
  • Processor: Intel Core i5 or equivalent.
  • Memory: 8 GB RAM minimum.
  • Storage: 500 MB of space on your hard drive.
  • Network: A stable internet connection for accessing remote MCP servers.

Check your system settings if you feel unsure about your hardware. Most modern laptops and desktops purchased in the last five years meet these requirements.

💾 Installation and Setup

Follow these steps to get the software onto your Windows computer.

  1. Visit the official download page.
  2. Locate the section labeled Releases on the right side of the page.
  3. Click the latest version link.
  4. Download the file that ends in .exe.
  5. Open your Downloads folder in File Explorer.
  6. Double-click the file to begin the setup process.
  7. Follow the prompts on your screen to complete the installation.

Once the process finishes, a shortcut appears on your desktop. Click this icon to launch the application for the first time.

⚙️ Using the Tool

The software interface remains simple. Follow this workflow to start your first performance test.

Launch the Application

Double-click the desktop icon. The main window opens. You see a dashboard that displays your current connection status to the MCP servers.

Configure Servers

Click the Settings button. Enter the addresses for the MCP servers that you wish to compare. If you already have your credentials for these servers, enter them in the provided text boxes. Click Save after you enter the details.

Select Your Code Base

Click the Select Folder button. Browse your computer to find the 1C project files that you want to analyze. The software scans the folder to ensure it contains compatible files.

Start the Comparison

Press the Run Test button. The software begins the evaluation process. A progress bar shows you how much work remains. Do not close the window while the test runs.

Review Results

Once the status bar reaches one hundred percent, the software generates a report. This document displays the response time and the logical accuracy of each server. You can export this report as a PDF by clicking the Export button.

🛠️ Troubleshooting Common Issues

Software occasionally behaves in unexpected ways. If you face a problem, use these steps to fix the issue.

  • Application does not open: Restart your computer and try to launch the program again.
  • Cannot find server: Check your internet connection. Ensure the server address you entered in the Settings menu is correct.
  • Slow performance: Close other large programs on your computer to free up memory for the comparison tool.
  • File errors: Make sure the 1C files you chose are not open in another editor or program during your test.

If the program still fails to work, uninstall the software and perform the download and installation steps again. Sometimes a clean reinstallation fixes small glitches.

📑 Understanding Your Data

The report you get at the end of the test contains specific metrics. Understanding these terms helps you make better choices for your projects.

Latency represents the delay between your request and the server response. A low latency score indicates a faster server. The tool measures this in milliseconds.

Accuracy scores denote how well the server understood the specific nature of the 1C code provided. Higher accuracy scores mean the server correctly identified patterns and syntax within your files. Use these scores to select the best server for your long-term code maintenance.

🛡️ Privacy and Security

The tool handles your code locally on your machine whenever possible. Only the necessary data travels to the MCP servers during the test. No personal 1C data stores on our remote servers. Keep your software updated to ensure you have the latest security patches. Check the download page periodically for new versions.

📬 Support

If you have questions about how to use the tool, look at the documentation provided in the main menu of the application. You can also view common user issues directly on the repository page. Keep your questions focused on the software performance and functionality. This helps the team provide better answers.

About

Benchmark performance of RAG and RLM-based MCP servers for 1C codebases using automated E2E testing to optimize AI assistant integration.

Topics

Resources

Stars

1 star

Watchers

0 watching

Forks

Releases

Packages

Contributors