App-Kit
App-Kit
HomeTeamBlog
research

App-Kit research

We study technical SEO across the web and publish aggregated results. Data is collected by our crawler, AppKitResearchBot.

Who we are

App-Kit builds web tools for developers and site owners, including a 400-point SEO audit. Our studies run on the same audit engine and are published on the blog together with the method and open data.

AppKitResearchBot

The crawler identifies itself as:

User-Agent
AppKitResearchBot/1.0 (+https://app-kit.ru/research)

If you see it in your logs, your site was drawn into a random study sample.

What we collect

  • public pages only, available without logging in or bypassing protection;
  • at most 10 pages per site, crawl depth 2;
  • at most one request per second to any site;
  • robots.txt rules for our User-Agent are respected;
  • we publish only aggregates across the sample — shares of sites with a given issue. Data on individual sites is never published.

How to opt out

Add a rule for our crawler to robots.txt and it will not fetch your pages in future runs:

robots.txt
User-agent: AppKitResearchBot
Disallow: /

Or email hello@app-kit.ru and we will remove your domain from the sample.

Published studies

State of SEO on the Russian web 2026: 901 sites in the .ru and .рф zones, 20 technical SEO metrics, breakdowns by site type and size.