Skip to content

For site administrators

WovioBot, the Wovio crawler

WovioBot reads the sites of Wovio customers to propose and make SEO improvements. It only visits a site whose owner signed it up on wovio.io; it never crawls the web on its own.

How it identifies itself

Every request carries this user agent, so you can recognise it in your logs and block it if you wish:

WovioBot/1.0 (+https://wovio.io/bot)

Reads come from the same IP address that serves wovio.io.

What it reads and how much

When a site is signed up it reads the home page and up to 17 more pages. Afterwards, once a week, up to 60 pages; and each day only the pages in its plan. It reads each page's HTML and the sitemap. It does not submit forms, log in or download more than 2 MB per page.

It honours robots.txt

If your robots.txt forbids it, it stays out, and the Wovio sign-up tells the owner so. To block it entirely:

User-agent: WovioBot
Disallow: /

If your site sits behind Cloudflare

Cloudflare may ask WovioBot to solve a challenge a crawler cannot solve, and Wovio cannot read the site. To let it through, in the Cloudflare dashboard for the domain:

  1. Security → WAF → Custom rules → Create rule.
  2. Name: “WovioBot”. Field: User Agent. Operator: contains. Value: WovioBot.
  3. Action: Skip, and tick “All remaining custom rules” plus the bot challenges (Bot Fight Mode or Super Bot Fight Mode, depending on your plan).
  4. Save the rule and retry the sign-up on wovio.io.

With another firewall or security plugin (Wordfence, Sucuri, iThemes), look for where to allow a user agent and add “WovioBot”.

If something does not add up

Write to hola@wovio.io with your domain and, if you can, the log line showing WovioBot. We reply on business days.

WovioBot · The Wovio crawler