GET /zones/{zone_id}/ai-audit/robots
Fetches and parses the robots.txt file for a zone or a specific subdomain within the zone. Returns parsed user-agent rules, content signals, and sitemaps.
Servers
- https://api.cloudflare.com/client/v4
Path parameters
| Name | Type | Required | Description |
|---|---|---|---|
zone_id |
String | Yes |
Identifier of the zone. |
Query parameters
| Name | Type | Required | Description |
|---|---|---|---|
subdomain |
String | No |
Optional subdomain to fetch robots.txt for. If omitted, fetches robots.txt for the zone apex domain. |
How to start integrating
- Add HTTP Task to your workflow definition.
- Search for the API you want to integrate with and click on the name.
- This loads the API reference documentation and prepares the Http request settings.
- Click Test request to test run your request to the API and see the API's response.