Q: Scrape Google SERP using pagination
I’d like to create an automation that scrapes Google’s Search Engine Results Page (SERP’s).
What I want is that I simply paste in my list of keywords and hit run, and the bot will scrape all the info I need and paste it into a Google Spreadsheet.
Here is an example workflow:
1) Go to Google.com
2) Search for this keyword: air conditioner frustrated OR frustration site.com after:2024-01-01
3) Scrape this data for Page 1, 2, 3, and 4:
• Subreddit
• Title
• URL
• Comments #
• Description
• Keyword
4) Paste to Google Sheet
There are 72 keywords total. Can this be done with Smart Spreadsheets?

Sohails
Mar 22, 2025A: I think our SERP scraper sheet does almost what you require. But please check this video to understand the flow of our sheet : https://youtu.be/2axwTkyOf4o
Hi, thanks for the video. Although it was helpful, I'm still unclear if I can select my own variables that I want to personally scrape from the SERP. When I Google search "air conditioner frustration reddit.com" I specifically want to extract:
• Subreddit
• Title
• URL
• Comments #
• Description
• Keyword
Does your software allow us to select what we want to scrape from the SERP's?
The Web Scraper Pro script currently doesn't have built-in functionality to scrape SERP data with the custom variables you're looking for.
The tool supports four scraping templates:
Email Addresses
Page Content
Image URLs
Video URLs
It doesn't have a specific feature for scraping Reddit search results or customizing what data points to extract from search results pages