OpemBot
OpemBot reads web pages that an Opem customer has added to their knowledge base, usually their own documentation, so their support assistant can answer from it.
How to recognise it
It sends this user agent with every request:
OpemBot/1.0 (+https://opem.app/bot)
What it fetches
Only the pages and sitemaps a customer added, over https, and the pages those sitemaps list: when they are added or the customer asks, then once a week while they are switched on, two pages at a time. It reads the page's main content, never runs its scripts, and stops at the number of pages the customer's plan allows.
How to allow or refuse it
It reads your robots.txt once per crawl and follows the rules for OpemBot, or for * when there are none for it. To keep it out of your whole site:
User-agent: OpemBot
Disallow: /A page with <meta name="robots" content="noindex"> is skipped too.
If OpemBot is reading pages it should not, tell us with the address it fetched.