Trawl

Describe the data. Get JSON that matches.

Give Trawl a sentence, a JSON Schema and, if you know it, the page to start from. A browser agent reads the web for you and returns JSON that fits, on a signed webhook.

Describe it, get JSON that fits.

You send a sentence and the JSON Schema you want back. The result is checked against your schema before it reaches you, so your code gets the shape it expects.

Read the guide

No scraper to maintain.

A browser agent reads the page the way a person would. When the site is redesigned, there are no selectors to fix, because there never were any.

Read the guide

Results on a signed webhook.

Trawl posts each finished job to your endpoint, signed so you know it came from us. Send test and replay are one click away.

Read the guide

Nothing is lost if your endpoint is down.

Every result stays on its job. If a delivery fails, fetch the result whenever you like, and reading a job is free.

Read the guide

How it works

Your first extraction in three steps.

  1. Turn on Trawl for your workspace and create an API key.
  2. Send a sentence and the JSON Schema you want back.
  3. Get the result on your webhook, or read it from the job.
server.ts
import { Trawl } from "@productcraft/trawl";

const trawl = new Trawl();

// A sentence and the JSON Schema you want back. The page is optional:
// leave suggested_urls out and the agent searches for one.
const job = await trawl.jobs.createAndPoll({
  description: "The five most recent releases: package name and version.",
  json_schema: {
    type: "object",
    properties: {
      releases: {
        type: "array",
        maxItems: 5,
        items: {
          type: "object",
          properties: { package: { type: "string" }, version: { type: "string" } },
          required: ["package", "version"],
        },
      },
    },
    required: ["releases"],
  },
  suggested_urls: ["https://github.com/clauderanelagh/productcraft-node/releases"],
});

console.log(job.status, job.result); // the result is checked against your schema

The job above, as it ran: what went in, and the JSON that came back.

  1. Describe it The schema and the sentence you send.

    The five most recent releases: package name and version.

    {
      "type": "object",
      "properties": {
        "releases": {
          "type": "array",
          "maxItems": 5,
          "items": {
            "type": "object",
            "properties": {
              "package": {"type": "string"},
              "version": {"type": "string"}
            },
            "required": ["package", "version"]
          }
        }
      },
      "required": ["releases"]
    }
  2. Get JSON The data the agent returned, checked against your schema.

    {
      "releases": [
        {
          "package": "productcraft",
          "version": "0.3.1"
        },
        {"package": "@productcraft/social", "version": "1.0.0"},
        {"package": "productcraft", "version": "0.3.0"},
        {"package": "@productcraft/waitlist", "version": "0.2.0"},
        {"package": "@productcraft/trawl", "version": "0.2.0"}
      ]
    }
package maps to productcraftversion maps to 0.3.1

More in the box

Everything else Trawl does.

For your AI agents

MCP tools to start a job, read its result and manage webhooks, behind the policies you set on each key, so an agent can gather data from the web and get it back as JSON. Read about MCP

Your first extraction, end to end.

Send a sentence and a schema, then read the JSON from the job or your webhook.