Robots.txt Analyzer

Analyze the contents of the robots.txt file. By default the file is at the root of the site, so no need to specify it.

example: https://www.example.com OR https://wwww.example.com/robots.txt OR https://example.com OR https://example.com/robots.txt