Smart Spreadsheets

Product details

Q: Scrape Google SERP using pagination

I’d like to create an automation that scrapes Google’s Search Engine Results Page (SERP’s).

What I want is that I simply paste in my list of keywords and hit run, and the bot will scrape all the info I need and paste it into a Google Spreadsheet.

Here is an example workflow:

1) Go to Google.com
2) Search for this keyword: air conditioner frustrated OR frustration site.com after:2024-01-01
3) Scrape this data for Page 1, 2, 3, and 4:
• Subreddit
• Title
• URL
• Comments #
• Description
• Keyword
4) Paste to Google Sheet

There are 72 keywords total. Can this be done with Smart Spreadsheets?

trevor806Mar 22, 2025
Founder Team
Sohails

Sohails

Mar 22, 2025

A: I think our SERP scraper sheet does almost what you require. But please check this video to understand the flow of our sheet : https://youtu.be/2axwTkyOf4o

Share
Helpful?
Log in to join the conversation
Posted: Mar 22, 2025

Hi, thanks for the video. Although it was helpful, I'm still unclear if I can select my own variables that I want to personally scrape from the SERP. When I Google search "air conditioner frustration reddit.com" I specifically want to extract:

• Subreddit
• Title
• URL
• Comments #
• Description
• Keyword

Does your software allow us to select what we want to scrape from the SERP's?

Founder
Posted: Mar 22, 2025

The Web Scraper Pro script currently doesn't have built-in functionality to scrape SERP data with the custom variables you're looking for.

The tool supports four scraping templates:

Email Addresses
Page Content
Image URLs
Video URLs

It doesn't have a specific feature for scraping Reddit search results or customizing what data points to extract from search results pages

Related questions
View product details