SourceBullionBot

The crawler behind sourcebullion.com. This page explains what it does and how to stop it.

Identification

SourceBullionBot/0.1 (+https://sourcebullion.com/bot; contact@sourcebullion.com)

What it collects

Publicly listed product names, prices and stock status from bullion dealers' public catalogue pages — the same information any visitor sees without signing in.

How often

One pass per dealer every six hours, with at least 1.5 seconds between requests to the same host.

What it respects

• robots.txt, fetched fresh at the start of every run. A group addressed to SourceBullionBot by name takes precedence over the * group.
• A site that will not serve a robots.txt is treated as disallowing everything.
• Redirects are followed only over HTTPS, at most three deep.

What it never does

Create accounts, sign in, add to cart, purchase, submit forms, accept terms of service, or attempt to bypass bot protection of any kind.

Opting out

Add this to your robots.txt. It takes effect on the next run:

User-agent: SourceBullionBot
Disallow: /

Or write to contact@sourcebullion.com and we will stop collecting from your site.