EveryReaderBot
EveryReaderBot is the web crawler that EveryReader, a service of Purely Works, uses to find and check documents on public websites.
What it does
- Reads public pages on government, school and other public-entity websites, and the documents linked from them (PDF, Word, PowerPoint, Excel).
- Checks each document for basic accessibility facts: tags, real text, title, language, fonts and contrast.
- Stays on the organization's own domains and the document-hosting services they link to.
- Never logs in, submits forms, or reads anything behind a password.
How it behaves
- Honors
robots.txt, includingCrawl-delay. - Makes at most one request per second to any host, and caps the number of pages it reads per site.
- Identifies itself with the user agent
EveryReaderBot/1.0 (+https://everyreader.purelyworks.com/bot; farid@purelyworks.com).
Controlling it
To keep EveryReaderBot out of all or part of your site, add rules to your robots.txt:
User-agent: EveryReaderBot
Disallow: /Questions or problems: email farid@purelyworks.com.