![Google is going to stop supporting crawl-delay, nofollow, and noindex in robots.txt | by Umair Hashmi | Medium Google is going to stop supporting crawl-delay, nofollow, and noindex in robots.txt | by Umair Hashmi | Medium](https://miro.medium.com/max/2560/0*FEaPt7XtY2Q7S-_Z.png)
Google is going to stop supporting crawl-delay, nofollow, and noindex in robots.txt | by Umair Hashmi | Medium
![🍌 John 🍌 on Twitter: "We never supported crawl-delay in robots.txt -- the numbers given there tend to be unrealistic for the most part.… https://t.co/nPYTj5XNZh" 🍌 John 🍌 on Twitter: "We never supported crawl-delay in robots.txt -- the numbers given there tend to be unrealistic for the most part.… https://t.co/nPYTj5XNZh"](https://pbs.twimg.com/media/ELnIVQQXkAIBwkz.png)
🍌 John 🍌 on Twitter: "We never supported crawl-delay in robots.txt -- the numbers given there tend to be unrealistic for the most part.… https://t.co/nPYTj5XNZh"
![WordPress Robots.txt optimization (+ XML Sitemap) – Website traffic, SEO & ranking Booster – Plugin for that WordPress Robots.txt optimization (+ XML Sitemap) – Website traffic, SEO & ranking Booster – Plugin for that](https://www.pluginforthat.com/wp-content/uploads/2019/10/better-robots-txt-3.jpg)