John Müller
Webmaster Trends Analyst bei Google
“Log files are so underrated, so much good information in them.” (Twitter)
SEO Log File Analyzer Tool That Increases Googlebot Crawling Efficiency
crawlOPTIMIZER is a new SEO software tool that helps you with optimizing your crawl budget, so that you are able to navigate Googlebot in the most precise and efficient way through your own website.
(1/2) @g33konaut @methode @JohnMu The past few weeks I've been my own crawler & indexer, collecting data from all sorts of specific resources over the internet & podcasts to put together a big picture of the Google indexing process. It's of course incomplete & greatly simplified! pic.twitter.com/5NmJI26pNW
— Jan-Peter Ruhso (@JanRuhso) October 29, 2021
Log File Analysis Tool from a SEO Perspective
Do you know which content of your website is beeing crawled by Googlebot? No? Then you should take a deeper look into this tool – check it out!
crawlOPTIMIZER, a cloud-based tool, analyzes your logfiles and gives you exact information which of your website’s content is being crawled by Google.
Based on predefined analyses & evaluations, crawlOPTIMIZER shows you unmet SEO potentials for maximizing crawl-efficiency. You will be able to always feed Google index-updated content as fast as possible. Get more unpaid search engine traffic.
crawlOPTIMIZER analyzes & saves log files automatically
crawlOPTIMIZER analyzes Googlebot log files fully automated and files them on a secured server in Germany up to 5 years long. Our simply arranged crawlOPTIMIZER dashboard allows you to monitor Googlebot activities 24/7. Due to the saving of log files and our specially developed logfile explorer even retroactive analyses are possible at any given time.
Ready-to-use evaluations
Predefined analyses & evaluations help even SEO novices to easily discover crawling difficulties.
Server location Germany & 100% GDPR-compliant
Only Googlebot log files will be analyzed & filed – no user related data! All GDPR requirements are met.
About crawlOPTIMIZER
Bastian Grimm, Peak Ace AG
“Log-file analysis has become an essential part of technical search engine optimization. crawlOPTIMIZER and its multitude of predefined dashboards, tremendously eases the process of log file evaluation, especially for newcomers. Fortunately, the tool integrates seamlessly into existing workflows and is also super flexible. This makes the connection of various data sources for the delivery and evaluation of log files fairly easy.”
Bastian Grimm, CEO & Director Organic Search at Peak Ace AG
Stephan Czysch, Dept Agency
“If you have an extensive website and SEO is important to your website’s success, then regular monitoring and optimization of crawling behavior is mandatory. The crawlOPTIMIZER prepares the log files of your server flawlessly and allows you to identify areas of improvement very quickly. By adapting robots.txt following logfile analyzes, we were able to achieve significant traffic gains, especially for large online shops.”
Stephan Czysch, Author of several SEO textbooks & lecturer for SEO
Why do I need crawlOPTIMIZER?
A simple explanation of an SEO process
Without crawling there is no indexation and thus no google search engine ranking.
Your website can only be found via Google search, if it has been added to the Google-Index. Because of this Googlebot (also called Spider) crawls every available website worldwide daily searching for new and updated content.
By using various onsite optimization measures you are able to influence the crawling process and further decide which content should be added to the Google-index and needs to be crawled more frequently.
Only webserver log files provide information about which and how often Googlebot crawls content. Because of this a continuous crawling monitoring should become the standard for every online venture. For this purpose crawlOPTIMIZER was developed, true to the mantra: ‘Keep it as simple as possible’
If you want to learn more about this topic, please visit page Google’s Indexing Process
Unique Features
crawlOPTIMIZER’s core pieces are the dashboard and the log file explorer.
Simple dashboard + KPIs
In order to ease your daily routine, our dashboard contains complete evaluations and KPIs based on your log files. Time-consuming, manual log file analyses via Excel or ELK (Elasticsearch, Logstash, Kibana) will become obsolete. All imported KPIs are made graphically available and can be viewed in the dashboard. Everything is prepared in a way that even people without a SEO background are able to understand them.
• Crawl budget statistics & waste of your crawl budget
• Status codes & crawling statistics
• Crawling of business relevant pages
• Top 50 of crawled URLs & resources
• Top 10 of crawled sitemaps & products
• Crawled types of content, parameters & http(s)
• Different googlebots
• And many more
The log file explorer
Anyone that tried to do log file analyses via Excel knows the typical problems: bigger log files up to a million entries can’t be processed. Due to this issue, professionals have only been able to analyze a snapshot of the Googlebot. Our solution: crawlOPTIMIZER’s log file explorer, where unlimited amounts of data are easily processed.
Processing of nearly unlimited volumes of data
Your log files are automatically stored and archived in our high-performance servers. This allows you to have easy access from anywhere – all the time. Another benefit worth mentioning is that long-term & retroactive analyses won’t be a problem any longer.
Easy and nearly endless filtering options + export features
Our log file explorer offers you various filter options to personalize your individual analyses & evaluations. Just a few clicks are needed to access needed data & information and can be exported as XLSX- or CSV file.
Google Search Console API
You can connect your project(s) to Google Search Console in just one click. This enriches your log data with search data (Clicks, Impressions, CTR, etc.). Yeah!
Google Indexing API
You can connect your project(s) to the Google Indexing API and push/delete URL’s from/to the Google index in seconds.
Data mining thanks to GSC API
Prices & packages
You need more than 500,000 requests per day or would you like to use the tool for your agency?
Then request an individual offer. Get in contact now!
Then request an individual offer. Get in contact now!
MATT
*Trial period of 7 days. Cancel any time before, free of charge
€ 199
monthly + VAT
Properties / websites:
1
1
Max. of Googlebot requests per day
75,000 / day
75,000 / day
Log data saving
24 months
24 months
Minimum contract duration:
6 months
6 months
✔ Analysis dashboard
✔ Secure German server location
✔ Log file explorer
✔ Google Search Console API
✔ Google INDEXING API
✔ CSV / XLSX Export
✔ Personal setup support
Premium service WhatsApp support
MARTIN
*Trial period of 7 days. Cancel any time before, free of charge
€ 269
monthly + VAT
Properties / websites:
1
1
Max. of Googlebot requests per day
150,000 / day
150,000 / day
Log data saving
24 months
24 months
Minimum contract duration:
3 months
3 months
✔ Analysis dashboard
✔ Secure German server location
✔ Log file explorer
✔ Google Search Console API
✔ Google INDEXING API
✔ CSV / XLSX Export
✔ Personal setup support
Premium service WhatsApp support
JOHN
*Trial period of 7 days. Cancel any time before, free of charge
€ 339
monthly + VAT
Properties / websites:
1
1
Max. of Googlebot requests per day
225,000 / day
225,000 / day
Log data saving
24 months
24 months
Minimum contract duration:
3 months
3 months
✔ Analysis dashboard
✔ Secure German server location
✔ Log file explorer
✔ Google Search Console API
✔ Google INDEXING API
✔ CSV / XLSX Export
✔ Personal setup support
Premium service WhatsApp support
GARY
*Trial period of 7 days. Cancel any time before, free of charge
€ 459
monthly + VAT
Properties / websites:
1
1
Max. of Googlebot requests per day
300,000 / day
300,000 / day
Log data saving
24 months
24 months
Minimum contract duration:
3 months
3 months
✔ Analysis dashboard
✔ Secure German server location
✔ Log file explorer
✔ Google Search Console API
✔ Google INDEXING API
✔ CSV / XLSX Export
✔ Personal setup support
✔ Premium service WhatsApp support
LARRY
*Trial period of 7 days. Cancel any time before, free of charge
€ 649
monthly + VAT
Properties / websites:
1
1
Max. of Googlebot requests per day
500,000 / day
500,000 / day
Log data saving
24 months
24 months
Minimum contract duration:
3 months
3 months
✔ Analysis dashboard
✔ Secure German server location
✔ Log file explorer
✔ Google Search Console API
✔ Google INDEXING API
✔ CSV / XLSX Export
✔ Personal setup support
✔ Premium service WhatsApp support
* No risk – 7 days free test trial
After the conclusion of your contract and once we have set up your personal account, you can try the crawlOPTIMIZER 7 days for free. During this trial period, we will import and analyze 35% of your logfiles. We will inform you once your trial period starts. Within these 7 days you can cancel the contract at any time – no commitments. How to cancel? A short e-mail to info@crawloptimizer.com with the reason for your cancellation is sufficient. You won’t be charged for these 7 days of testing. Your contract will be terminated once you agree to cancel your current test-version. Assuming that our tool’s features will satisfy you, and you won’t cancel within these 7 days, the previously concluded contract becomes binding from the 8th day, and we will start importing 100% of your logs. Let’s rock!
Specials
ZOE (very small business)
*Trial period of 7 days. Cancel any time before, free of charge
€ 79
monthly + VAT
Instead of € 99 monthly + VAT
save now € 20
Properties / websites:
1
1
Max. of Googlebot requests per day
25,000 / day
25,000 / day
Log data saving
24 months
24 months
Minimum contract duration:
6 months
6 months
✔ Analysis dashboard
✔ Secure German server location
✔ Log file explorer
✔ Google Search Console API
✔ CSV / XLSX Export
✔ Personal setup support
BUSINESS SUITE AGENCY
individual pricing
monthly + VAT
Properties / websites:
starting from 1
starting from 1
Max. of Googlebot requests per day
starting from 500,000 / day
starting from 500,000 / day
Log data saving
starting from 24 months
starting from 24 months
Minimum contract duration:
individual
individual
✔ Analysis dashboard
✔ Secure German server location
✔ Log file explorer
✔ Google Search Console API
✔ CSV / XLSX Export
✔ Personal setup support
✔ SEO Consulting:
-20% discount
-20% discount
✔ Premium service WhatsApp support
We only sell to entrepreneurs/companies
Above mentioned prices do not include VAT.
For further information feel free to contact us via email or phone +43 (1) 577 35 49.
Note: The limited Black Week offer is only valid until 15/12/22. The reduced price applies to the entire contract period.
Above mentioned prices do not include VAT.
For further information feel free to contact us via email or phone +43 (1) 577 35 49.
Note: The limited Black Week offer is only valid until 15/12/22. The reduced price applies to the entire contract period.
Contact us
Need support or got questions? Get in touch!
Further ways to get in touch
Skype Chat
WhatsApp Chat