Claimful crawler
User-Agent: Claimful/1.0 (opportunity-aggregator; +https://claimful.app/bot)
What it does
Our crawler aggregates publicly listed money opportunities — class-action settlements, bank sign-up bonuses, and credit-card welcome offers. When it finds a new opportunity it extracts the key facts (title, description, payout, deadline) and links back to the page it was found on. We never republish personal information from these sources.
How it behaves
Respects robots.txt
Every fetch checks the origin's /robots.txt for our product token and skips paths that are disallowed.
Per-domain rate limit
Conservative spacing per host (defaults to ≤ 10 requests/minute; lower on government portals). Honors Crawl-delay and Retry-After.
Only public pages
We never scrape content behind a login wall, form gate, or paywall. Only pages any anonymous visitor can reach.
Honest identification
The User-Agent above is never spoofed as a browser. Block it in robots.txt and we go away.
Opting out
To block Claimful from your site, add the following to your robots.txt:
User-agent: Claimful
Disallow: /You can also email bot@claimful.app and we'll remove your domain from our source list. We reply within one business day.
For general support, product questions, or press, use our