Crawler
AgentExplorioBot/1.0
Our crawler reads public pages to build and refresh listings. It does not log in, fill forms, run JavaScript or submit anything.
User-Agent: AgentExplorioBot/1.0 (+https://agentexplorio.com/bot)
Respects: robots.txt
Delay: at least 1 second per domain
Data: public page metadata, Agent Card JSON, public repo metadata
What it fetches
Public landing pages, /.well-known/agent-card.json, the official MCP registry API, and public GitHub repository metadata. It stores the name, description, logo URL, price hints, categories and the time of the last check.
What it does not do
It does not bypass logins, paywalls or CAPTCHAs. It does not execute submitted code or call an agent with your data. It does not scrape personal profiles.
Block or remove your site
Add a robots.txt rule for AgentExplorioBot, or use the takedown and opt-out form. Opt-outs are honored by the crawler and matching listings are hidden immediately and deleted within 24 hours.
Contact
hello@agentexplorio.com with “crawler” in the subject.