Google News Scraper

News & Research

Operated by Sourcelane✓ verified

A Google News scraping connector that collects structured article metadata from Google News feeds (keyword queries, topic feeds, or top headlines) and resolves redirect links to publisher pages; it extracts article titles, publisher URLs, source names and websites, publish timestamps in ISO 8601, plain-text snippets, related-coverage items (titles and sources), and the originating query or topic, with deduplication by URL and configurable country and language edition selection. The connector supports Google-style search operators and site-specific queries, topic feeds (WORLD, BUSINESS, TECHNOLOGY, etc.), and produces ready-to-ingest news records for monitoring, trend analysis, and downstream NLP/LLM pipelines such as retrieval-augmented generation and vector store ingestion.

Verified Sep 28, 3:55 AM

$0.0008

per article

Up to 100 per call. Only pay for results returned; failed calls are refunded.

What people use it for

News monitoring and breaking-coverage tracking for keywords, companies, or individuals
Brand mention tracking across outlets with source names and timestamps
Trend detection via scheduled topic feeds (technology, business, science, etc.)
Ingesting fresh, structured news for AI/RAG pipelines and vector databases
Competitive intelligence using site-specific queries and keyword monitoring

Trust & reliability

7d uptime trend

Window	Uptime	Success rate	p50	p95
24h	—	—	—	—
7d	—	—	—	—
30d	—	—	—	—

Calling contract

Call it through Sourcelane's gateway or MCP server. We run the connector, apply your agent's spend guardrails, and bill only the results returned.

Call it via Sourcelane

curl -X POST https://api.usesourcelane.com/v1/call \
  -H "Authorization: Bearer sl_live_your_agent_key" \
  -H "Content-Type: application/json" \
  -d '{"listing":"google-news-scraper","params":{"queries":["artificial intelligence"],"maxItems":5},"maxResults":10}'

Request params

Field	Type	Required	Description
`queries`	array	optional	Keyword searches to run against Google News. Supports Google search operators like site:reuters.com, quoted phrases, and when:7d (articles from the last 7 days). Leave empty (along with Topics) to scrape top headlines.
`topics`	array	optional	Google News topic sections to scrape. Allowed values: WORLD, NATION, BUSINESS, TECHNOLOGY, ENTERTAINMENT, SCIENCE, SPORTS, HEALTH. If both Queries and Topics are empty, the connector scrapes top headlines.
`language`	string	optional	Language code for results (Google News 'hl' parameter), e.g. en, en-GB, de, fr, es, pt-BR, ja.
`country`	string	optional	Country code for the news edition (Google News 'gl' parameter), e.g. US, GB, AU, DE, IN, BR.
`maxItems`	integer	optional	Maximum number of articles to return across all queries and topics. Set 0 to return everything available (each feed returns up to ~100 articles). Capped at 100 per call.
`resolveUrls`	boolean	optional	Google News feeds link to news.google.com redirect URLs. When enabled, the connector resolves each link to the publisher's real article URL. Disable for faster runs that keep the Google redirect URLs.

Each result contains

Field	Type	Description
`query`	string	Query
`title`	string	Title
`url`	string	Url
`urlResolved`	boolean	Url Resolved
`sourceName`	string	Source Name
`sourceUrl`	string	Source Url
`publishedAt`	string	Published At
`snippet`	string	Snippet
`relatedArticles`	array	—

Use Google News Scraper from Claude, ChatGPT or Cursor

Pick your tool and connect in under a minute. Then just ask — for example: “What has been reported about solid-state batteries in the last week? Cite sources.”

Connect Claude

Web, desktop and mobile. Paste one URL.

1Copy your personal connector URL
2In Claude open Settings → Connectors → Add custom connector
3Paste the URL and click Add — done

Manual setup (config files, REST, Python) +

Claude Code

Adds the Sourcelane MCP server with your key as a header.

terminal

claude mcp add --transport http sourcelane https://api.usesourcelane.com/mcp \
  --header "Authorization: Bearer sl_live_your_agent_key"

Claude Desktop (config file)

Alternative to the connector URL: add to claude_desktop_config.json, then restart Claude.

claude_desktop_config.json

{
  "mcpServers": {
    "sourcelane": {
      "command": "npx",
      "args": [
        "-y",
        "mcp-remote",
        "https://api.usesourcelane.com/mcp",
        "--header",
        "Authorization:${AUTH_HEADER}"
      ],
      "env": {
        "AUTH_HEADER": "Bearer sl_live_your_agent_key"
      }
    }
  }
}

Cursor & Windsurf

Add to ~/.cursor/mcp.json (or Windsurf's mcp_config.json).

mcp.json

{
  "mcpServers": {
    "sourcelane": {
      "url": "https://api.usesourcelane.com/mcp",
      "headers": {
        "Authorization": "Bearer sl_live_your_agent_key"
      }
    }
  }
}

VS Code

Save as .vscode/mcp.json. VS Code prompts for your key once.

.vscode/mcp.json

{
  "servers": {
    "sourcelane": {
      "type": "http",
      "url": "https://api.usesourcelane.com/mcp",
      "headers": {
        "Authorization": "Bearer ${input:sourcelane-key}"
      }
    }
  },
  "inputs": [
    {
      "type": "promptString",
      "id": "sourcelane-key",
      "description": "Sourcelane agent key",
      "password": true
    }
  ]
}

ChatGPT Custom GPT (Actions)

Create a GPT → Actions → Import from URL, then Authentication: API Key, Bearer.

OpenAPI schema URL

https://usesourcelane.com/openapi.json

REST

One POST. Pass maxResults to cap cost.

curl

curl -X POST https://api.usesourcelane.com/v1/call \
  -H "Authorization: Bearer sl_live_your_agent_key" \
  -H "Content-Type: application/json" \
  -d '{"listing":"google-news-scraper","params":{"queries":["artificial intelligence"],"maxItems":5},"maxResults":10}'

Python, LangChain, CrewAI, OpenAI Agents SDK…

Wrap the REST call as a tool, or point an MCP client at the endpoint.

python

import requests

res = requests.post(
    "https://api.usesourcelane.com/v1/call",
    headers={"Authorization": "Bearer sl_live_your_agent_key"},
    json={
        "listing": "google-news-scraper",
        "params": {"queries":["artificial intelligence"],"maxItems":5},
        "maxResults": 10,
    },
    timeout=300,
)
body = res.json()
print(body["receipt"]["chargedMicros"], "micro-USD for", body["receipt"]["results"], "results")
print(body["data"])

Reviews

—

0 reviews

Leave a review

Loading reviews…