---
title: "WebCrawlerAPI integration for LuumenAI"
url: "https://www.luumen.ai/integrations/webcrawlerapi/"
entity: SoftwareIntegration
category: "Databases & data platforms"
audience: "SRE, DevOps, platform engineering, IT operations"
---

# WebCrawlerAPI integration for LuumenAI

Crawl sites, scrape pages, and watch vendor docs for changes from the terminal

## What LuumenAI can do with WebCrawlerAPI

LuumenAI connects to WebCrawlerAPI with an API token and exposes 10 tools (6 read-only · 3 write · 1 destructive). For connected tools, admins configure which actions may run automatically and which require approval, within the access granted to the user.

## Key facts

- Authentication: API token
- Tools available: 10 tools (6 read-only · 3 write · 1 destructive)
- Deployment: scoped as part of your Pilot, Platform, or Managed rollout
- Category: Databases & data platforms

## About WebCrawlerAPI with LuumenAI

Connect WebCrawlerAPI and Luumen can pull public web content into your operational work. Scrape a single page for a synchronous answer, check a crawl job's per-page results and observed costs, or review which monitored feeds detected changes overnight. Starting crawls, creating feeds, and changing feed state are previewed and approved first.

## Example tools

Read-only (6 in total):

- `WEBCRAWLERAPI_GET_CRAWL_JOB` — Get a crawl job's status, configuration, per-page results, content URLs, errors, and observed costs.
- `WEBCRAWLERAPI_GET_FEED` — Get one feed's configuration, lifecycle status, and recent run history, including per-run crawl counts and cost.
- `WEBCRAWLERAPI_GET_ORGANIZATION_COSTS` — Return current spendable balance plus request count and USD usage for a date range.
- `WEBCRAWLERAPI_LIST_FEED_CHANGES` — Return one page of detected feed changes as structured JSON, with an opaque continuation cursor for older pages.
- `WEBCRAWLERAPI_LIST_FEEDS` — List active and paused feeds for the connected organization, newest first.
- `WEBCRAWLERAPI_SCRAPE_PAGE` — Scrape one web page synchronously and return requested content or structured extraction.

Write and destructive (4 in total, subject to configured approval policy):

- `WEBCRAWLERAPI_CREATE_CRAWL` — Start a metered asynchronous crawl over a site and return its job ID.
- `WEBCRAWLERAPI_CREATE_FEED` — Create a recurring website-change feed.
- `WEBCRAWLERAPI_DELETE_FEED` — Permanently cancel a feed so it cannot be resumed.
- `WEBCRAWLERAPI_SET_FEED_STATE` — Pause an active feed's future scheduled runs or resume a paused feed.

## Frequently asked questions

### How does LuumenAI connect to WebCrawlerAPI?

Authorize once with API token. Luumen lists the scopes each action needs before you approve the connection, and credentials never appear in the chat.

### Can LuumenAI change things in WebCrawlerAPI on its own?

For connected tools, admins configure which actions may run automatically and which require approval, within the access granted to the user.

### Is there an audit trail?

Every call to WebCrawlerAPI — read or write, approved or declined — is recorded with the actor, the input, and the result.

Full page: https://www.luumen.ai/integrations/webcrawlerapi/