Robots Welcome

easy 75 pts web 0 zgjidhje

Every well-behaved site has a file that tells crawlers where they may and may not go. See what this server is politely asking Google to avoid.

robots.txt

Këshillë #1 -10 pts