newsflo-bot

newsflo-bot is the program that collects headlines from other Nepali news sites for the feed on newsflo. It identifies itself as newsflo-bot/1.0 (+https://www.newsflo.app/bot).

What it reads

Only what a site already publishes for this purpose: its RSS or Atom feeds and sitemaps, and the headline, summary, date, section and picture named in a story page's metadata (its Open Graph and structured-data tags). It never reads or keeps a story's text or its authors' names.

What readers see

A card with the headline, the site's own summary, its picture (a copy we store, resized) and the outlet's name. Opening it takes the reader to the story on the outlet's own site: newsflo shows no page of its own for it, and the link tells the outlet the visit came from newsflo. When several outlets cover the same news, the card lists each one and the reader chooses.

How politely it behaves

• It obeys robots.txt, and leaves a site alone if its robots.txt can't be read.
• It makes one request at a time to a site, at least a second apart, and only a few times an hour.
• It connects only to public internet addresses and gives up on slow or oversized responses.
• It deletes stories, and our copies of their pictures, after 90 days.

For publishers

To have your site removed, or to ask us to fetch differently, email publishers@newsflo.app with the site's address. We remove the site's stories and pictures from the feed and stop collecting from it. Adding a Disallow rule for newsflo-bot to your robots.txt also stops it on the next run.