Screaming Frog is one of the most popular SEO tools available. But did you know it offers seamless integration with ChatGPT?

This integration takes your analysis to a whole different level.

Just picture this: Screaming Frog visits your pages and automatically calls ChatGPT to evaluate your content across multiple criteria.

Below is a sample output:

Everything is easy to set up, even for beginners.

We’ll first explore practical examples, then I’ll guide you through configuring these analyses in Screaming Frog.

Here is just a sample of what you can achieve by combining ChatGPT and Screaming Frog:

1. Auditing content quality 

Google published a list of 20 questions they recommend asking when reviewing your content after a Core Update. 

I’ve found this approach incredibly helpful for spotting low-quality content on your site, regardless of whether you were hit by a Google core update. 

You can use ChatGPT + Screaming Frog integration to automatically judge the content quality at scale. 

Here’s a sample output:

Think about it this way: if ChatGPT can identify issues with your content quality, Google’s algorithms can definitely do the same. This integration helps you quickly pinpoint which pages need improvement.

2. AI content detection

Sure, we’ve seen multiple cases when Google is fine with AI content if it’s good quality. 

But here’s the thing, in my AI Survival for SEO guide, I showed some pretty solid evidence that Google can actually spot AI-written content. 

And let’s be real – it’s not just about Google. If your readers think your content sounds like a robot wrote it, they’ll probably bounce right off your page. 

That’s why I think it’s super helpful to use this tool to check how “AI-like” your content seems, so you can find those stiff sections and make them sound more like a real person wrote them.

Here’s a sample output:

3. Generating meta description based on content copy

Tired of writing meta descriptions by hand? One practical use of the Screaming Frog + ChatGPT connection is generating meta descriptions. A good meta description gets more people clicking on your links and increases traffic to your site.

Here’s a sample prompt you can use if you want to try this feature. 

4. Checking if articles contain a clear call to action 

If you’re a marketer looking to verify whether your content has effective calls to action, this prompt might come in handy.

Here’s a sample output: 

And yes, I see the irony – this section doesn’t have a strong CTA itself. Try it out if you think it would be helpful for your workflow!

5. Judge the article summary

Here’s a prompt to help you analyze your article summaries.

The prompt checks your summaries against 7 different criteria. For example, it verifies that your summary doesn’t introduce new information – because who wants to see new concepts appear right at the end of an article? 

Screaming Frog with ChatGPT integration will give you a clear, concise review of your summaries:

It also makes sure your summary doesn’t just repeat your introduction. Nobody likes reading the same ideas twice – it’s a quick way to lose your reader’s interest.

6. Detecting NSFW content 

Having NSFW (Not Safe For Work) content on your site can hurt your visibility in search results because of Google’s SafeSearch feature, which filters out inappropriate content. 

Many site owners don’t realize that SafeSearch issues aren’t limited to sites that intentionally publish adult content. 

As I noted in my SEO Playbook, even user-generated NSFW content in comments can trigger SafeSearch filters – this is actually a problem that Vimeo struggles with compared to YouTube. 

Setting up a basic NSFW content checker with Screaming Frog and ChatGPT is pretty straightforward. 

You can use this simple prompt:Find instances of NSFW content in the following text: {text}

7.  Find grammar and logical errors 

Another handy way to use the ChatGPT + Screaming Frog combo is to spot grammar mistakes and logical inconsistencies in your content. This is especially useful for long guides where errors can easily slip through.

Here’s a prompt to help you catch these issues.

Below you will find a sample output: 

Using my ScreamingFrog presets

To make things super easy, I’ve created a Screaming Frog preset just for folks who bought my ebook, AI Survival for SEO.

If you’re just looking to connect Screaming Frog with ChatGPT without using my preset, scroll a bit to Step 1: Setting up the ChatGPT integration.

If you bought my ebook, just open the Screaming Frog config file (you’ll find it in your purchase goodies), paste in your URLs, and hit start. New to Screaming Frog? No worries! Check out the “Automating Content Audit using Screaming Frog + ChatGPT” section in your ebook materials – it walks you through everything step by step.

If you’re just looking to connect Screaming Frog with ChatGPT without using my preset, here’s how to get started:

Step 1: Setting up the ChatGPT integration

1. Open ScreamingFrog and click on Configuration -> API Access -> AI -> OpenAI.

2. Enter your OpenAI API key (OpenAI is the company behind ChatGPT). If you don’t have an API key, you can obtain it at the OpenAI website https://platform.openai.com/api-keys  

Then click on the Prompt configuration tab.

Here you can:

• Add new prompts
• Edit which ChatGPT model is used for each analysis type
• Select different models for different tasks (GPT-4o mini is the cheapest one)

Step 2: Check your URLs

It’s time to add the URLs you want to check:

1. On the main Screaming Frog panel, click “Upload”
2. Choose how to enter URLs:

• Enter manually
• Paste a list
• Download from sitemap

For our example, click “Paste” and add these URLs:

https://pixelfy.me/blog/preparing-shipment/
https://pixelfy.me/blog/pixelfy-bloggers/
https://pixelfy.me/blog/upc-guide/

Step 3: View your results

Now it’s time to see what Screaming Frog + ChatGPT collected. 

Obviously the generated data will depend on which prompts you entered in the first step. 

1. In Screaming Frog, scroll down the side panel
2. Select “AI” reports specifically

Here’s a sample output: 

For better readability, you can rearrange columns using drag and drop.

Then you can view results directly in Screaming Frog or click “Export” to save them and open in Excel / Google Spreadsheet. 

More ideas for expanding Screaming Frog 

• Mark Williams-Cook shared an interesting approach with AI Survival for SEO readers (see page 61). He built a process combining Screaming Frog’s JavaScript execution capability (introduced in v20) with both the ChatGPT and AlsoAsked APIs. This setup helps identify questions that aren’t currently answered in each article.

While Screaming Frog can technically connect with any API to extend its functionality, those advanced integrations are beyond what we can cover in this guide.

• For another expert perspective, check out Gus Pelogia’s article on mapping related pages at scale. 

Wrapping Up

With this integration, you now have a powerful tool to evaluate content at scale. What used to take days can be accomplished in minutes, giving you deeper insights and more time to act on them.

Start with a small batch of URLs, explore the results, and discover how this approach can transform your content strategy.

P.S. From what I’ve researched, Screaming Frog and Horseman appear to be the only SEO crawlers currently offering custom prompt setup for enhanced content analysis.

Know of another SEO tool with similar functionality? Drop me a line at he***@to******.com – I’d love to hear about it and update this guide accordingly!

P.S. If you enjoyed this article, and interested in learning AI, I have a perfect solution for you – my recently published ebook: AI Survival for SEO.

Using the coupon code “TomekSEO” you can get it for just $39!