Ir al contenido
TodayWW

Today WorldWide

TodayWWBot

TodayWWBot is the crawler that reads public news feeds for TodayWW.

How it behaves

User agent: TodayWWBot/1.0 (+https://todayww.com/bot). It reads RSS/Atom feeds and news sitemaps, obeys robots.txt (including rules addressed to "TodayWWBot"), sends at most a few requests per minute per site, and does not fetch article pages unless a publisher allows it.

To block it, add "User-agent: TodayWWBot" / "Disallow: /" to your robots.txt. For anything else, write to [email protected].