![Glenn Gabe on Twitter: "Quick reminder that your robots.txt directives require a user-agent to be specified. If you quickly add a disallow directive w/out it having a user-agent, those urls will not Glenn Gabe on Twitter: "Quick reminder that your robots.txt directives require a user-agent to be specified. If you quickly add a disallow directive w/out it having a user-agent, those urls will not](https://pbs.twimg.com/media/FAIwN72X0AA5sQz.jpg)
Glenn Gabe on Twitter: "Quick reminder that your robots.txt directives require a user-agent to be specified. If you quickly add a disallow directive w/out it having a user-agent, those urls will not
![Submitted URL blocked by robots.txt" BUT robots.txt Tester says it is allowed. - Google Search Central Community Submitted URL blocked by robots.txt" BUT robots.txt Tester says it is allowed. - Google Search Central Community](https://storage.googleapis.com/support-forums-api/attachment/thread-3757701-8115154441659473713.jpg)
Submitted URL blocked by robots.txt" BUT robots.txt Tester says it is allowed. - Google Search Central Community
![How to Properly Use Robots.txt tester in Google Search Console? - BloggerSpice: SEO Training and Money Making Strategies How to Properly Use Robots.txt tester in Google Search Console? - BloggerSpice: SEO Training and Money Making Strategies](https://3.bp.blogspot.com/-qoKL95Yi9uE/VyiBMus-qYI/AAAAAAAAO8M/4bt0Iwj08K45Dr2X9dCAE-dpmCkrY3q9gCLcB/s1600/robots.txt%2Btester%2Ballowed.png)