![Andrew Reed on X: "Nike's robots.txt starts with “just crawl it.” which i find wonderful https://t.co/7I5AJ9HpZM" / X Andrew Reed on X: "Nike's robots.txt starts with “just crawl it.” which i find wonderful https://t.co/7I5AJ9HpZM" / X](https://pbs.twimg.com/media/F2-mSoebsAAAQpz.jpg)
Andrew Reed on X: "Nike's robots.txt starts with “just crawl it.” which i find wonderful https://t.co/7I5AJ9HpZM" / X
Ramneek Khurana on LinkedIn: who will look under the hood ?! nike's robots. txt begins with "just crawl…
Roastbrief - The SEO nerds working on the Nike website are killing it with their robots.txt file, which, in addition to the swanky addition of their logo, also includes instructions at the
![Kristina Azarenko on X: "Haha love it! @Nike robots.txt - just crawl it! https://t.co/smSwooKl9P" / X Kristina Azarenko on X: "Haha love it! @Nike robots.txt - just crawl it! https://t.co/smSwooKl9P" / X](https://pbs.twimg.com/media/EI97sZnW4AA73zj.png)