Optional
Crawl multiple agents to discover their publisher domains and properties
Crawl a single agent to get its authorized publisher domains
Fetch adagents.json from multiple publisher domains
Fetch and parse adagents.json from a publisher domain
Crawl multiple agents to discover their publisher domains and properties