URL Scanning

Osano’s continuous scanning, powered by the osano.js script, actively monitors your website 24/7 for updates and changes detectable through DOM modifications and document updates. However, some types of content, such as HTTP-only and server-side cookies, cannot be detected by osano.js alone. To address these limitations, Osano provides an alternative scanning method: URL Scanning.

 

What is URL Scanning?

URL scanning acts as a site scraper, a process that visits specific, named URLs to extract and analyze content. The scraper identifies scripts, cookies, and iframes on these URLs that may not be discoverable by the continuous scanner. By doing this, it provides additional visibility into the scripts and trackers used on your site.

 

Setting Up a URL Scan

Cookie Consent - URL Scans.png

To set up a URL scan follow the below steps:

  1. Navigate to Cookie Consent within Osano.
  2. Select the configuration you want to associate with the scan.
  3. Click on URL Scans.
  4. Click the + button to add a new scan.
  5. Enter the full URL you want to scan.
  6. Allow the scan to complete.

If the site is blocked by a firewall or other security tools, these scans may fail. Ensure the necessary permissions are in place for the scanner to access the URLs.


Cookie Consent - URL Scans - URL.png

 

 

Overview of Scanning Features

Besides continuous scanning via osano.js, Osano offers two additional scanning methods:

  • URL Scanning: This feature periodically (currently monthly) visits a customer-provided URL and scans the cookies, scripts, and iframes on the page.
  • Sitemap Scanning: For customers with many web application URLs, Osano allows you to input a sitemap.xml file. The system will periodically visit these sitemap URLs and update the scan roster accordingly - Note: Osano limits the number of pages (URLs) that can be scanned to 500 for customers with a premier package. If sitemaps are larger than this, any scans over that 500 will fail. 

These scanning features give a more complete picture of the cookies and trackers on your web properties.

 

Possible Scanning Failures

URL scans may fail if:

  • A firewall is blocking access to the site.
  • Security tools prevent automated scraping.
  • The URL entered is incorrect or incomplete.

Ensure that the target URL is accessible, and the necessary permissions are in place for Osano’s scanning technology to function correctly.

Related to