A flexible scraper that collects structured data from Google search result pages. It helps you capture organic results, ads, AI summaries, related questions, and more—all in a clean, machine-readable format. Ideal for anyone who needs reliable SERP data for research, automation, or SEO tracking.
Created by Bitbash, built to showcase our approach to Scraping and Automation!
If you are looking for Google Search Results Scraper you've just found your team — Let's Chat. 👆👆
This scraper automates the process of gathering detailed information from Google Search. It pulls everything from organic search listings to AI overview summaries, allowing users to analyze search visibility, ad landscapes, and competitive signals. It’s built for marketers, analysts, data engineers, and anyone who needs consistent access to Google SERP metrics.
- Lets you monitor keyword performance across countries and devices.
- Helps reveal ad placements, competitor visibility, and shifting SERP layouts.
- Unlocks AI overviews that influence modern search behavior.
- Enables deeper research with structured, exportable data fields.
- Supports automation through APIs or integration workflows.
| Feature | Description |
|---|---|
| Organic result extraction | Captures titles, URLs, descriptions, positions, and structured snippets. |
| Paid ads detection | Identifies and extracts paid search ads and product ads. |
| AI overview scraping | Collects Google’s AI-generated summaries and referenced sources. |
| Related queries | Extracts "People Also Ask" and related search suggestions. |
| Country & language targeting | Fetch localized SERPs for global keyword monitoring. |
| Device-based scraping | Switch between mobile and desktop views. |
| Multi-page crawling | Scrape multiple SERP pages using pagination controls. |
| Flexible export formats | Output to JSON, CSV, XLSX, XML, or HTML. |
| Field Name | Field Description |
|---|---|
| searchQuery | Includes term, URL, device type, page number, domain, and location details. |
| organicResults | List of organic search results with title, URL, snippet, position, and metadata. |
| paidResults | Extracted ads, including ad position and landing URLs. |
| paidProducts | Product listing ads with product info when present. |
| relatedQueries | Queries suggested by Google, including PAA and related searches. |
| peopleAlsoAsk | Extracted Q&A-style results. |
| aiModeResult | AI overview text and source links. |
| resultsTotal | Total results count when available. |
| kvsHtmlUrl | Link to the stored HTML snapshot for a SERP. |
| url | The SERP URL that was scraped. |
[
{
"searchQuery": {
"term": "Hotels in Seattle",
"url": "http://www.google.com/search?q=Hotels+in+Seattle&num=5",
"device": "DESKTOP",
"page": 1,
"type": "SEARCH",
"domain": "google.com",
"countryCode": "US",
"languageCode": null,
"locationUule": null,
"resultsPerPage": "5"
},
"resultsTotal": null,
"relatedQueries": [
{
"title": "Airbnb",
"url": "https://www.google.com/search?..."
}
],
"organicResults": [
{
"title": "Downtown Seattle Hotel | Luxury Waterfront Hotel Rooms",
"url": "https://www.edgewaterhotel.com/",
"displayedUrl": "https://www.edgewaterhotel.com",
"description": "The Edgewater Hotel is laden with a rich musical past...",
"emphasizedKeywords": ["The Edgewater Hotel"],
"type": "organic",
"position": 1
}
],
"aiModeResult": {
"text": "You can find many hotel options in Seattle...",
"sources": [
{
"title": "Where To Stay In Seattle",
"url": "https://wheatlesswanderlust.com/where-to-stay-in-seattle/"
}
]
},
"url": "http://www.google.com/search?q=Hotels+in+Seattle&num=5"
}
]
Google Search Results Scraper/
├── src/
│ ├── index.js
│ ├── runners/
│ │ └── serp_runner.js
│ ├── extractors/
│ │ ├── organic_parser.js
│ │ ├── paid_ads_parser.js
│ │ ├── ai_overview_parser.js
│ │ └── utils_dom.js
│ ├── outputs/
│ │ └── formatters.js
│ └── config/
│ └── settings.example.json
├── data/
│ ├── inputs.sample.json
│ └── sample_output.json
├── package.json
├── requirements.txt
└── README.md
- SEO teams monitor keyword rankings to refine strategy and track visibility across regions.
- Digital advertisers analyze competing ads so they can adjust campaigns and bidding approaches.
- Market researchers gather SERP insights to understand industry trends and search intent shifts.
- Product teams extract AI overviews to measure emerging search behaviors and brand coverage.
- Analysts build large datasets for modeling search trends, competitive gaps, or keyword clusters.
Does this scraper support multiple countries and languages? Yes—it can target any Google domain and language combination, making it useful for global research.
Can it capture more than 10 results per page? Google limits organic results to 10 per page. To collect more, increase the max pages setting to crawl deeper.
How stable is the scraper with Google’s UI changes? It adapts to layout variations and automatically handles most structural shifts in search pages.
Can I scrape by keyword or by URL? Either works. You can input raw Google URLs or simple keyword terms.
Primary Metric: Processes an average SERP in under 1.5 seconds, even with AI overview extraction enabled.
Reliability Metric: Maintains a 98%+ successful fetch rate across varied regions, devices, and query types.
Efficiency Metric: Handles multi-page keyword batches with low memory overhead, making it suitable for large-scale runs.
Quality Metric: Consistently captures over 95% of visible SERP components, including newer AI-based elements.
"Bitbash is a top-tier automation partner, innovative, reliable, and dedicated to delivering real results every time." Nathan Pennington
|
"Bitbash delivers outstanding quality, speed, and professionalism, truly a team you can rely on." Eliza
|
"Exceptional results, clear communication, and flawless delivery. Bitbash nailed it." Syed
|