Skip to content
LegalCrawlerSmoothfunnels

SmoothfunnelsBot

The crawler behind Smoothfunnels

On this page

On this page

Who we are

SmoothfunnelsBot is the web fetcher of Smoothfunnels, an AI marketing-funnel and landing-page tool operated by Smoothware OÜ (the Netherlands). It identifies itself in every request with this User-Agent:

SmoothfunnelsBot/1.0 (+https://smoothfunnels.ai/bot)

Why it visits your website

We do not crawl the web and we do not build a search index. SmoothfunnelsBot only fetches pages when a person asks us to read a specific site:

  • a Smoothfunnels customer asks us to analyse their own website, so we can write marketing copy that fits the business;
  • a visitor uses the “try it on your site” form on our homepage, which we only run for a site on the same domain as the visitor’s email address.

Fetches happen on demand, a handful of pages at a time, not continuously.

What it fetches

  • /robots.txt, before anything else;
  • the sitemap and the specific pages that were requested, as HTML;
  • the addresses of the stylesheets those pages reference, to match their look (the stylesheets themselves are not downloaded).

It does not log in, fill in forms, run scripts or fetch pages that robots.txt forbids to it. The text of the pages is processed to build a business profile and is sent to our AI provider to do so; see our privacy policy.

How to block it

Add this to your robots.txt; it takes effect on our next visit:

User-agent: SmoothfunnelsBot
Disallow: /

You can also block only part of the site (Disallow: /private/) or use User-agent: * to address all crawlers. We honour both. The only exception: if you are a Smoothfunnels customer and have proven you own the site (DNS record or meta tag), your own User-agent: * rules are not applied to requests for your site, because you asked us to read it; rules that name SmoothfunnelsBot always apply.

You can also block the User-Agent at your web server or firewall.

Contact

Questions, complaints or a request to stop: info@smoothfunnels.ai.