---
title: "Scrapfly integration for LuumenAI"
url: "https://www.luumen.ai/integrations/scrapfly/"
entity: SoftwareIntegration
category: "Databases & data platforms"
audience: "SRE, DevOps, platform engineering, IT operations"
---

# Scrapfly integration for LuumenAI

Scrape pages, pull structured data, and run crawls from the terminal

## What LuumenAI can do with Scrapfly

LuumenAI connects to Scrapfly with an API token and exposes 12 tools (11 read-only · 1 write). For connected tools, admins configure which actions may run automatically and which require approval, within the access granted to the user.

## Key facts

- Authentication: API token
- Tools available: 12 tools (11 read-only · 1 write)
- Deployment: scoped as part of your Pilot, Platform, or Managed rollout
- Category: Databases & data platforms

## About Scrapfly with LuumenAI

Connect Scrapfly and Luumen can fetch pages, render JavaScript, and pull structured fields out of the HTML while you stay in the terminal. Useful for checking a vendor status page, capturing what a customer-facing page actually renders, or collecting reference data during an incident. Starting a crawl is a held step you approve first.

## Example tools

Read-only (11 in total):

- `SCRAPFLY_CAPTURE_SCREENSHOT` — Capture a full-page or viewport screenshot of a website.
- `SCRAPFLY_CAPTURE_SCREENSHOT_HEAD` — Capture screenshot metadata without downloading the image body.
- `SCRAPFLY_EXTRACT_DATA` — Extract structured data from HTML or other content using AI models, LLM prompts, or custom templates.
- `SCRAPFLY_GET_ACCOUNT_INFO` — Retrieve Scrapfly account information.
- `SCRAPFLY_GET_CRAWLER_ARTIFACT` — Download crawler artifact files in WARC or HAR format.
- `SCRAPFLY_GET_CRAWLER_CONTENTS` — Retrieve extracted content from crawled pages.
- `SCRAPFLY_GET_CRAWLER_STATUS` — Get the current status of a crawler including progress, pages crawled, and completion state.
- `SCRAPFLY_GET_CRAWLER_URLS` — Retrieve the list of discovered and crawled URLs from a crawler.

Write and destructive (1 in total, subject to configured approval policy):

- `SCRAPFLY_CREATE_CRAWLER` — Create a new web crawler to recursively crawl an entire website.

## Frequently asked questions

### How does LuumenAI connect to Scrapfly?

Authorize once with API token. Luumen lists the scopes each action needs before you approve the connection, and credentials never appear in the chat.

### Can LuumenAI change things in Scrapfly on its own?

For connected tools, admins configure which actions may run automatically and which require approval, within the access granted to the user.

### Is there an audit trail?

Every call to Scrapfly — read or write, approved or declined — is recorded with the actor, the input, and the result.

Full page: https://www.luumen.ai/integrations/scrapfly/