[wordpress插件] Booter – Bots & Crawlers ManagerBooter –机器人与爬虫经理

wordpress 插件 文章 2020-03-09 09:40 431 0 全屏看文

AI助手支持GPT4.0

评分
100
描述

Booter – Bots & Crawlers Manager is a preventative measure (treatment in advance) and treatment of damages caused by crawlers and bots.

Booter – Bots&Crawlers Manager是一种预防措施(预先处理),用于处理由爬虫和机器人引起的损害。

The plugin uses a number of existing technologies which are known by crawlers and bots and takes them one step forward – smartly and almost completely automatically.

该插件使用了爬虫和漫游器已知的许多现有技术,使它们向前迈出了一步-智能化,几乎完全自动化。

To allow the plugin to function correctly, you must follow the instructions and manually enter some data (which must be done by a human being to avoid errors).

为了使插件正常运行,您必须按照说明操作并手动输入一些数据(必须由人工完成才能避免错误)。

At the prevention level

在预防方面

    • Booter allows you to manage and create an advanced dynamic robots.txt file.
    • Booter允许您管理和创建高级动态robots.txt文件。

    • View a 404 error log to see the most common bad links.
    • 查看404错误日志以查看最常见的错误链接。

    • Blocking bad bots that cause high server loads due to very frequent page crawls, or are used to search for security vulnerabilities.
    • 阻止由于频繁的页面爬网而导致服务器高负载的不良机器人,或者用于搜索安全漏洞。

    At the treatment level

    在治疗水平

      • Booter allows you to limit the amount of requests from crawlers and bots, if or when they exceed the specified amount of requests per minute, it will be rejected for a specified period of time.
      • Booter允许您限制来自爬网程序和漫游器的请求数量,如果每分钟超过指定的请求数量,则它们将在指定的时间段内被拒绝。

      • Rejecting links that we do not want in the fastest way, not by just blocking but by sending the appropriate HTTP status code to make search engines forget them.
      • 以最快的方式拒绝我们不想要的链接,不仅仅是阻止,而是发送适当的HTTP状态代码以使搜索引擎忘记它们。

      Instructions for use in case of damage treatment

      用于损坏处理的使用说明

        1. Activate the plugin.
        2. 激活插件。

        3. Enable the 404 error log option.
        4. 启用404错误日志选项。

        5. Set the access rate limit.
        6. 设置访问速率限制。

        7. Watch the 404 log, try to find common parts in the URLs that repeats most often.
        8. 观看404日志,尝试在URL中找到最经常重复的部分。

        9. Enter the common parts to the “reject links” page, and ensure the rejection code is 410.
        10. 在“拒绝链接”页面上输入公用部分,并确保拒绝代码为410。

        11. Clear the 404 error log.
        12. 清除404错误日志。

        13. Repeat the process once every few hours until the 404 error log remains blank.
        14. 每隔几个小时重复一次该过程,直到404错误日志保持空白。

        15. Check the status of your website’s index coverage every few days.
        16. 每隔几天检查一次您网站索引覆盖率的状态。

安装步骤

    1. Upload booter-crawlers-manager folder to the /wp-content/plugins/ directory
    2. booter-crawlers-manager 文件夹上载到 / wp-content / plugins / 目录

    3. Activate the plugin through the ‘Plugins’ menu in WordPress
    4. 通过WordPress中的“插件”菜单激活插件

    5. The plugin will start rate limiting as soon as it is activated, however it is recommended to update the settings to suit your needs, under ‘Settings’ -> ‘Booter – Crawlers Manager’ menu
    6. 该插件一被激活,便会立即开始限制速率,但是建议您在“设置”->“ Booter-抓取工具管理器”菜单下更新设置以满足您的需求

下载地址
https://downloads.wordpress.org/plugin/booter-bots-crawlers-manager.zip
-EOF-

AI助手支持GPT4.0