PriceDeltaBot
PriceDeltaBot is the crawler behind PriceDelta. It reads a short list of public pricing pages a few times a day to notice when they change.
How it behaves
It identifies itself as PriceDeltaBot, follows robots.txt, does not log in, submit forms or run JavaScript, and skips pages that ask for payment with HTTP 402. Each page is fetched at most a few times a day.
What we keep
We store text snapshots to find differences and the prices printed on the page. Customers receive changed lines, extracted prices and a link to your page, never a full copy of it.
How to stop it
Add this to your robots.txt. We stop visiting at the next check.
User-agent: PriceDeltaBot Disallow: /