Category: Technical SEO

Log file analysis

Studying server logs for bot behaviour.

Log file analysis means reviewing server records to see which URLs the search bot visits and how often. It is the most reliable source of knowledge about real crawl budget usage and technical problems.

🔗 Related terms

C

Crawl budget

How many pages a bot crawls in a given time.

E

5xx error

Server errors (500, 502, 503...).

I

Indexing

Adding a page to the search engine's database.

R

robots.txt

A file controlling bot access to the site.

Back to glossary

Check your website's SEO

Run a free, comprehensive SEO analysis and see which of these elements need fixing on your website.

Start free analysis