# Website Crawler (POST)

## Overview

| Property | Value |
|----------|-------|
| **Status** | active |
| **Method** | `POST` |
| **Endpoint** | `/v1/website/crawler` |
| **Base URL** | `https://api.browsersolver.com` |
| **Credit Cost** | 1 credit per call |
| **Documentation** | https://www.browsersolver.com/library/website-crawler-website-crawler-post |

## Description

Relay a JSON POST to a public page or API endpoint and return whatever the upstream server replies. No JS execution and no unlock layer.

## Authentication

- **Key Name:** `x-api-key`
- **Location:** HTTP Header
- **Get an API key:** https://app.browsersolver.com/register

## Example Request

```bash
curl --location --request POST 'https://api.browsersolver.com/v1/website/crawler' \
  --header 'Content-Type: application/json' \
  --header 'x-api-key: YOUR_API_KEY'
```

## Example Response

### POST catalog search JSON

```json
{
  "meta": {
    "page": 1,
    "per_page": 25,
    "total_items": 318
  },
  "items": [
    {
      "sku": "SKU-88421",
      "href": "https://httpbin.org/p/wireless-earbuds",
      "name": "Wireless earbuds",
      "amount": 79.99,
      "currency": "EUR",
      "availability": "in_stock"
    },
    {
      "sku": "SKU-99102",
      "href": "https://httpbin.org/p/usb-c-hub",
      "name": "USB-C hub 7-in-1",
      "amount": 49.5,
      "currency": "EUR",
      "availability": "limited"
    }
  ]
}
```

## Documentation

## Purpose

[Website Crawler (POST)](/v1/website/crawler) forwards an HTTP **POST** to a public page or JSON API and returns the upstream response (HTML or JSON). BrowserSolver relays your JSON body to the target URL without running JavaScript or an unlock layer.

Use this card when the upstream endpoint expects a POST payload and is **not** behind an enterprise bot manager. If anti-bot blocks the call on a whitelisted domain, switch to [Website WebUnlocker (POST)](/v1/website/webunlocker).

For read-only page fetches, use [Website Crawler](/v1/website/crawler) (GET).

**Pricing:** 1 credit per successful response.

## Quickstart

Recommended pattern: `query` in the URL, JSON payload in the body.

```
POST https://api.browsersolver.com/v1/website/crawler?query=https://httpbin.org/post
Content-Type: application/json

{"page":1,"size":25,"category":"electronics"}
```

## Parameters
| Parameter | Type | Required | Description |
|---|---|---|---|
| `query` | string | yes | Target URL with `http://` or `https://` |

This library card exposes **POST only**. GET page retrieval lives on the main Website Crawler card.

## Response
The body mirrors whatever the upstream server returns (JSON object or HTML string).

## Companion endpoints
| Situation | Endpoint |
|---|---|
| GET a public HTML page | [Website Crawler](/v1/website/crawler) |
| POST blocked on whitelisted domain | [Website WebUnlocker (POST)](/v1/website/webunlocker) |
| Identify bot vendor first | [Website Antibot](/v1/website/antibot) |

## Common workflows
- Call catalog or search APIs that only accept POST bodies
- Replay reverse-engineered XHR endpoints without hosting your own proxy
- Feed enrichment pipelines with JSON from open endpoints
- Prototype integrations before moving blocked targets to WebUnlocker