Screaming Frog adds Google’s URL Inspection API

Screaming Frog wasted no time integrating Google’s new URL Inspection API that provides access to current index data. The new API allows Screaming Frog to include seven new filters that identify website issues that require attention.

In addition to the extended usefulness of Screaming Frog, the new update, codenamed Romeo, also fixes a log4j vulnerability issue, adds new hotkeys, and fixes a few bugs to make it more stable.

Seven More Ways to Fix Websites

Google’s new URL Inspection API allows software tools like Screaming Frog to access Google Search Console and import data into the tool.

API stands for Application Programming Interface. It’s like a bridge between two software that allows everyone to connect to share data and achieve a certain level of integration between the two programs.

Screaming Frog’s integration of the URL Inspection API enables the popular site audit program to provide the following brand new troubleshooting filters.

Seven new audit filters:

  1. The URL is not on Google
    The URL is not indexed by Google and will not appear in search results. This filter can include non-indexable URLs (such as those that are “noindex”) as well as indexable URLs that can be indexed. It’s a catch-all filter for anything not on Google according to the API.
  2. Unindexed indexable URL
    Indexable URLs found in crawl that are not indexed by Google and will not appear in search results. This can include URLs unknown to Google, or those that have been discovered but not indexed, and more.
  3. The URL is on Google, but has problems
    The URL has been indexed and may appear in Google search results, but there are mobile usability, AMP, or rich results issues that could mean it doesn’t appear optimally.
  4. Canonical declared by user not selected
    Google has chosen to index a different URL than the one declared by the user in the HTML.
  5. The page is not mobile friendly
    The page has issues on mobile devices.
  6. AMP URL is invalid
    The AMP has an error that will prevent it from being indexed.
  7. Invalid rich result
    The URL contains an error with one or more rich result enhancements that will prevent the rich result from displaying in Google search results. »

The value of the URL Inspection Tool API integration is that you can now overlay Search Console indexing data over Screaming Frog’s crawl data, allowing you to see all data points on the page retrieved by Screaming Frog juxtaposed with indexing status.

Screaming Frog now benefits from a rich results inspection tool that allows bulk export of data from the Bulk Export tab in the top menu.

Additional Updates

Other updates, in addition to the aforementioned log4j vulnerability fix, are the addition of keyboard shortcuts (ctrl+W to close mining projects), they made the Word Cloud Visualization tool language sensitive so improved word filtering, fixed Page Speed ​​Insights bug, issue with JavaScript crawls that would cause a stall, fixed CSS path extraction to support leading slashes and ending and various other fixes that make Screaming Frog run smoother.

Screaming Frog URL Inspection API Integration Part 1?

The update announcement offered a statement that there is still some integration work to be done to make it even better.

Due to practical limitations in how data can be fed into the Screaming Frog interface, not all URL inspection data can be fed into it. But they promised to listen to user feedback to include additional data if users feel it’s important.

The Screaming Frog announcement read:

“With usage and user feedback, the way we integrate data to gain additional insights will also improve.

If you run into any issues or would like to view additional data or reports from the URL Inspection API, let us know through support.

We have already planned a few things, but we wanted to get the basic functionality, including the most important things, so that users can enjoy it quickly. »

So it looks like Screaming Frog has even more good things in store for us.


Read the official Screaming Frog announcement

Screaming Frog SEO Spider Update – Version 16.6

Comments are closed.