KWIKLBot
KWIKLBot is the reader behind KWIK L. It identifies itself as KWIKLBot/0.1 (+https://kwikl.com/bot). It reads public pages only. It never signs in, never submits a form, and never reads behind a login.
When it visits
- When a person asks KWIK L to check a website, on kwikl.com or in the app: robots.txt, the home page, the sitemap and up to ten more pages, once, to answer them.
- For a business reading of that site: up to 25 pages, chosen by what buyers look for (services, about, contact, booking, prices).
- Once a month, the same check for the websites of KWIK L's customers who asked for a monthly re-check.
- Once a week, for the home pages of businesses on a customer's list, to see whether they still need what the customer sells.
How it behaves
- The home page of a check a person asked for, or of a customer's own monthly re-check, is fetched the way their browser would. Every other page it reads only where robots.txt allows: the sitemap and extra pages of a check, every page of a business reading, and the weekly look at businesses on a list.
- It follows RFC 9309. Rules for KWIKLBot by name come first, then the rules for all bots. If robots.txt can't be read, it reads nothing beyond that home page.
- In a business reading it reads one page a second at most, and slower when your robots.txt sets a crawl-delay (up to five seconds between pages). A check fetches its handful of pages once, one after another.
- It keeps short quotes and facts with the page they came from, never whole pages. Readings are deleted after 12 months.
How to stop it
Add these lines to your robots.txt. KWIKLBot will then read no page of your site by itself. If a person asks KWIK L to check your site, or your own KWIK L account re-checks it each month, it still fetches the home page once, the way a browser would, and no other page.
User-agent: KWIKLBot Disallow: /
To remove your business from KWIK L altogether, including any reading and any list it is on, use Remove my business or write to privacy@kwikl.com.