Subject: AhrefsBot can't crawl boostlyx.shop – "Crawling this address / port is not supported"
Waqas Mughal
Hi Ahrefs Support,
AhrefsBot is unable to crawl my website boostlyx.shop. When I check the status on your AhrefsBot / AhrefsSiteAudit status page, all four robots.txt URLs show the error "Crawling this address / port is not supported":
- https://boostlyx.shop/robots.txt
- http://boostlyx.shop/robots.txt
- https://www.boostlyx.shop/robots.txt
- http://www.boostlyx.shop/robots.txt
Last checked: 01 Oct, 7:47 PM. I have attached a screenshot.
On my side, everything appears to be working correctly:
- The website loads normally in the browser over standard ports (80/443)
- DNS is resolving to a public IP: [SERVER IP]
- robots.txt does not block AhrefsBot
- No firewall or security plugin is blocking your crawler
Could you please check whether this IP or domain is restricted on your side, or whether you have an outdated DNS record cached? I would appreciate it if you could allow AhrefsBot to crawl the site again.
Thank you for your help.
Best regards,