Apify Website Content Crawler
Run by Apify
How to detect Apify Website Content Crawler
Apify Website Content Crawler signs its requests, so you detect it by verifying the cryptographic signature on each request. A valid signature proves the request came from Apify; a copied user agent without the signature does not.
- Detection method
- SignedThe agent signs its requests, so its identity is verified cryptographically.
- Signals that identify it
- CryptographicA signed request verified cryptographically
- BehavioralAutomated clicks, typing and page flow instead of a person's
Every signal Verisoul checks for Apify Website Content Crawler
Apify Website Content Crawler signs its requests, so we verify who it is cryptographically, then check the rest of the session.
- Used
Cryptographic
A signed request verified cryptographically
- Not used
Network
Not needed to identify it
- Not used
Device
Not needed to identify it
- Used
Behavioral
Automated clicks, typing and page flow instead of a person's
How often you'll see it
Very uncommon
Rare, brand new, or not seen on Verisoul traffic yet
Questions about Apify Website Content Crawler
How do you detect Apify Website Content Crawler?
Apify Website Content Crawler signs its requests, so you detect it by verifying the cryptographic signature on each request. A valid signature proves the request came from Apify; a copied user agent without the signature does not.
What is Apify Website Content Crawler?
Apify Website Content Crawler is an AI agent from Apify that works in a browser and signs its requests.
Does Apify Website Content Crawler identify itself?
Yes. Apify Website Content Crawler signs its requests cryptographically, which is the strongest way an agent can identify itself.
Can a bot pretend to be Apify Website Content Crawler?
Not convincingly. A bot can copy Apify Website Content Crawler's user agent, but without Apify signing keys its requests fail verification and it is not labeled Apify Website Content Crawler.
How common is Apify Website Content Crawler?
Very uncommon. Rare, brand new, or not seen on Verisoul traffic yet.
What does the Verisoul API return for Apify Website Content Crawler?
Every session Verisoul identifies as Apify Website Content Crawler carries an agent block with id "apify_website_content_crawler", name, provider, type "ai_agent", detection_method "signed" and the detection_signals used (cryptographic, behavioral). Build rules on the id, type and detection method.