SEO: Crawling and Robots
Google selects canonical URLs based on your site and user preference
If a different URL is chosen, it doesn’t negatively affect your...
You can’t opt into or out of mobile-first indexing
Google's John Mueller reminds us that one day, there will only be mobile-first...
Google’s indexing issues are resolved
Google has just confirmed the indexing issues from yesterday are fully...
Yes, Googlebot can detect JavaScript redirects
JavaScript redirects are followed similarly to server-side redirects, Google...
Google testing tools now support evergreen Googlebot
After three months, the Google testing tools are now using the latest version of...
Video: Catalyst’s Paul Shapiro on going beyond technical SEO
Natural language processing, SEO testing, technical SEO audits and more were all discussed in this...
Google notifying webmasters to remove noindex from robots.txt files
Google is now sending reminders that you need to stop depending on your noindex in your robots.txt...
Google adds JavaScript SEO basics to its Search developer’s guide
The new section aims to provide beginners with an overview of how Googlebot processes...
SMX replay: SEO that Google tries to correct for you
Patrick Stox explains the processes to pay attention to and the ones to leave to...
Google to stop supporting noindex directive in robots.txt
Changes are coming to how Google understands some of the unsupported directives in your robots.txt...
Google posts draft to formalize Robots Exclusion Protocol Specification
Google open sources its robots.txt parser as part of this...
Yoast, Google devs propose XML Sitemaps for WordPress Core
The proposal also includes an API for further...
I/O announcements have some applauding and others shaking their fists
Marketers continue to accuse Google of stealing their...
Google’s web crawler Googlebot now runs on the latest version of Chromium: Why that’s a good thing
Googlebot has been upgraded and should now be able to crawl more modern web sites with less of an...
The technical SEO hierarchy of needs
What makes a site become the best site it can be? Healthy, functional sites that have reached their full SEO potential have been optimized based...
Managing Sitemap XML with Google Search Console
What to look for in Search Console indexing reports, plus learn why and how to create a dynamic Sitemap...
Robots.txt tip from Bing: Include all relevant directives if you have a Bingbot section
Pay close attention to the directives you give to Bingbot and other search engines in your robots.txt...
Technical SEO in the wild: Real-world issues and fixes
A website has a lot of moving parts that affect one another and sometimes a tiny little change can cause a huge...
Why the SaaS model is right for programmatic
By charging a simple subscription fee for the programmatic buying platform, cost-efficient buying and scale spending efficiencies...
Bing crawling, indexing and rendering: A step-by-step on how it works
Crawlers are technical but understandable thanks to Microsoft's Senior Program Manager Frédéric Dubut's presentation at SMX...