Sourcelane

Woolworths Scraper

E-commerce & Marketplaces

Operated by Sourcelane✓ verified

A web scraping connector that searches Woolworths Australia (woolworths.com.au) and extracts product-level grocery data for every matching item, producing one record per product. Outputs comprehensive retail data including current and previous pricing, savings and promotion flags (including multibuy and membership pricing), unit pricing and package measurements, stock and availability details, product identity (SKU/stockcode, barcode/GTIN/EAN, brand, product name, URL, images, description), category taxonomy and departmental hierarchy, full nutrition and dietary information (ingredients, allergens, free‑from and dietary claims, health star rating, serving size, nutrition per 100g and per serve), and additional metadata such as country of origin, storage instructions, marketplace/sponsorship indicators, and ratings/review counts. The connector performs query-driven search and paginated crawling to collect price, promotion, unit price, availability, category, nutrition and image assets at scale for grocery analytics, cataloguing, and comparison workflows.

Verified Sep 28, 3:55 AM

$0.0012

per product

Up to 100 per call. Only pay for results returned; failed calls are refunded.

What people use it for

Trust & reliability

7d uptime trend
WindowUptimeSuccess ratep50p95Calls
24h————0
7d————0
30d————0

Calling contract

Call it through Sourcelane's gateway or MCP server. We run the connector, apply your agent's spend guardrails, and bill only the results returned.

Call it via Sourcelane

curl -X POST https://api.usesourcelane.com/v1/call \
  -H "Authorization: Bearer sl_live_your_agent_key" \
  -H "Content-Type: application/json" \
  -d '{"listing":"woolworths-scraper","params":{"searchTerms":["milk"]},"maxResults":10}'

Request params

FieldTypeRequiredDescription
searchTermsarrayrequiredProduct searches to run on woolworths.com.au, one per line (e.g. 'milk', 'coffee beans', 'nappies'). Each term is searched separately.
sortBystringoptionalOrder of results within each search.
specialsOnlybooleanoptionalOnly return products currently on special (discounted, half price, member price).
inStockOnlybooleanoptionalSkip products that are currently out of stock online.
maxResultsPerTermintegeroptionalCap on products returned for each search term. Set 0 for all matching products (the connector pages through the full result set).

Each result contains

FieldTypeDescription
searchTermstringSearch Term
stockcodestringStockcode
barcodestringBarcode
namestringName
displayNamestringDisplay Name
brandstringBrand
urlstringUrl
imageUrlstringImage Url
imagesarrayImages
descriptionstringDescription
pricenumberPrice
wasPricenumberWas Price
savingsinteger—
onSaleboolean—
isHalfPriceboolean—
promotionTypenull—
promotionLabelnull—
multibuyQuantitynull—
multibuyPricenull—
isMemberPriceboolean—
packageSizestring—
unitstring—
cupPricenumber—
cupMeasurestring—
unitPriceLabelstring—
inStockboolean—
isAvailableboolean—
isPurchasableboolean—
isNewboolean—
isOnlineOnlyboolean—
isSponsoredboolean—
isMarketplaceItemboolean—
marketplaceSellernull—
purchaseLimitinteger—
stockRemaininginteger—
departmentsarray—
categorystring—
subcategorystring—
subcategoriesarray—
ingredientsstring—

Use Woolworths Scraper from Claude, ChatGPT or Cursor

Pick your tool and connect in under a minute. Then just ask — for example: “Track the price of these 20 grocery items at Woolworths and Coles every week.”

Connect Claude

Web, desktop and mobile. Paste one URL.

  1. 1Copy your personal connector URL
  2. 2In Claude open Settings → Connectors → Add custom connector
  3. 3Paste the URL and click Add — done
Manual setup (config files, REST, Python) +

Claude Code

Adds the Sourcelane MCP server with your key as a header.

terminal
claude mcp add --transport http sourcelane https://api.usesourcelane.com/mcp \
  --header "Authorization: Bearer sl_live_your_agent_key"

Claude Desktop (config file)

Alternative to the connector URL: add to claude_desktop_config.json, then restart Claude.

claude_desktop_config.json
{
  "mcpServers": {
    "sourcelane": {
      "command": "npx",
      "args": [
        "-y",
        "mcp-remote",
        "https://api.usesourcelane.com/mcp",
        "--header",
        "Authorization:${AUTH_HEADER}"
      ],
      "env": {
        "AUTH_HEADER": "Bearer sl_live_your_agent_key"
      }
    }
  }
}

Cursor & Windsurf

Add to ~/.cursor/mcp.json (or Windsurf's mcp_config.json).

mcp.json
{
  "mcpServers": {
    "sourcelane": {
      "url": "https://api.usesourcelane.com/mcp",
      "headers": {
        "Authorization": "Bearer sl_live_your_agent_key"
      }
    }
  }
}

VS Code

Save as .vscode/mcp.json. VS Code prompts for your key once.

.vscode/mcp.json
{
  "servers": {
    "sourcelane": {
      "type": "http",
      "url": "https://api.usesourcelane.com/mcp",
      "headers": {
        "Authorization": "Bearer ${input:sourcelane-key}"
      }
    }
  },
  "inputs": [
    {
      "type": "promptString",
      "id": "sourcelane-key",
      "description": "Sourcelane agent key",
      "password": true
    }
  ]
}

ChatGPT Custom GPT (Actions)

Create a GPT → Actions → Import from URL, then Authentication: API Key, Bearer.

OpenAPI schema URL
https://usesourcelane.com/openapi.json

REST

One POST. Pass maxResults to cap cost.

curl
curl -X POST https://api.usesourcelane.com/v1/call \
  -H "Authorization: Bearer sl_live_your_agent_key" \
  -H "Content-Type: application/json" \
  -d '{"listing":"woolworths-scraper","params":{"searchTerms":["milk"]},"maxResults":10}'

Python, LangChain, CrewAI, OpenAI Agents SDK…

Wrap the REST call as a tool, or point an MCP client at the endpoint.

python
import requests

res = requests.post(
    "https://api.usesourcelane.com/v1/call",
    headers={"Authorization": "Bearer sl_live_your_agent_key"},
    json={
        "listing": "woolworths-scraper",
        "params": {"searchTerms":["milk"]},
        "maxResults": 10,
    },
    timeout=300,
)
body = res.json()
print(body["receipt"]["chargedMicros"], "micro-USD for", body["receipt"]["results"], "results")
print(body["data"])

Reviews

—

0 reviews

5
0
4
0
3
0
2
0
1
0

Leave a review

Loading reviews…