Add HTTP headers to request

You can add your custom headers to a request. To do so, pass them as JSON in headersparameter. Remember to encode this parameter like in the example below.

Example

In the example below we add two headers:

• Accept-Language: en-US,en;q=0.9,en;q=0.8,
• X-Custom-Header: value.

These headers will be forwared to the requested page.

curl

curl -G \
--data-urlencode 'url=https://example.com' \
--data-urlencode 'headers={"accept-language": "en-US,en;q=0.9,en;q=0.8", "x-custom-header": "value"}' \
'https://scraping.narf.ai/api/v1/?api_key=[your api key]'

Python

import requests
import json
from urllib.parse import quote_plus

url = quote_plus("https://example.com")
api_key = "[your api key]"
headers = quote_plus(
    json.dumps({
        "accept-language": "en-US,en;q=0.9,en;q=0.8",
        "x-custom-header": "value"
        })
)

print(requests.get(f"https://scraping.narf.ai/api/v1/?api_key={api_key}&url={url}&headers={headers}").content)

Javascript

import axios from "axios";

const url = encodeURIComponent("https://example.com");
const apiKey = "[your api key]";
const headers = encodeURIComponent(
  JSON.Stringify({
    "accept-language": "en-US,en;q=0.9,en;q=0.8",
    "x-custom-header": "value",
  })
);

const response = await axios.get(
  `https://scraping.narf.ai/api/v1/?api_key=${apiKey}&url=${url}&headers=${headers}`
);
console.log(response.data);