Crawler Results shows all data gathered by crawl scans across your assets. It is accessible from Results > Crawler Results in the left sidebar and has two sub-sections: Overview and List View.
Overview
The Overview page provides a high-level summary of all crawling activity.
Summary Metrics
| Metric | Description |
|---|---|
| Total Crawler Started | Number of crawlers initiated since beginning. |
| Total URL | Total number of URLs discovered across all assets, with percentage change from last month. |
| Total Unique Requests | Number of unique requests made during crawling, with percentage change from last month. |
| Enrichments | Total enrichment records found across crawler scans. |
Latest Crawler
A table showing the most recent crawler executions:
| Column | Description |
|---|---|
| Asset | The crawled asset. |
| Scanner IP | IP address of the scanner that performed the crawl. |
| Port | Port that was crawled. |
| Latest Crawler | How recently the crawler ran (e.g., "About 3 hours ago"). |
Estimated Next Crawler
A table showing upcoming scheduled crawler executions:
| Column | Description |
|---|---|
| Asset | The asset to be crawled. |
| Estimated Start Time | When the next crawl is expected (e.g., "About to start", "in about 4 hours", "in 1 day"). |
Crawler History
A paginated table showing the crawl history per asset and port. Each row summarizes how a specific asset has been crawled over time:
| Column | Description |
|---|---|
| Asset | The crawled asset. |
| Scanner IP | IP address of the scanner. |
| Port | Port that was crawled. |
| Count | Total number of crawls performed on this asset/port. |
| Last Crawl — URL | Number of URLs discovered in the most recent crawl. |
| Last Crawl — Unique Requests | Number of unique requests made in the most recent crawl. |
| Change Since Last Crawl — URL | Difference in URL count compared to the previous crawl. |
| Change Since Last Crawl — Unique Requests | Difference in unique requests compared to the previous crawl. |
Click any row to view the full crawl history for that asset and port.
HTTP Methods Statistics
A breakdown of discovered HTTP methods (GET, POST, PUT, DELETE, PATCH) across all crawled URLs. Each method shows a total request count. Click a method to open the Total URL list filtered by that method.
Vulnerable URL List
A list of URLs where scan findings were detected during crawling.
| Column | Description |
|---|---|
| URL | The discovered URL where the issue was found. |
| Name | The scan that detected the finding. |
| Severity | Severity level of the finding. |
| Last Detected | When the finding was last seen. |
Click any row to open the full scan report for that finding.
List View (Total URL List)
The List View shows all discovered URLs with two tabs: URLs and Enrichments.
URLs Tab
A detailed list of all discovered URLs:
| Column | Description |
|---|---|
| Asset | The asset the URL belongs to. |
| Port | Port number. |
| Endpoint | The discovered URL path. |
| Status Code | HTTP response status code (e.g., 400, 404, 522). |
| Method | HTTP method (e.g., GET, POST). |
| Enrichment Report | Associated enrichment data (if available). |
| Last Detected | Date and time when the URL was last detected. |
| Actions | Context menu for additional actions. |
Enrichments Tab
Shows enrichment data gathered during crawling scans.
Filters
Use the filter bar to narrow the URL list:
- Search -- Free text search.
- Search Ports -- Filter by port number.
- Asset -- Filter by asset.
- Tags -- Filter by asset tags.
- Status Code -- Filter by HTTP status code.
- Method -- Filter by HTTP method.
- Date -- Filter by detection date.