Why are there separate scrape actions for POST and PUT?

Some targets are API endpoints rather than pages and reject a plain fetch. Scrapfly Scrape covers the standard request, while Scrapfly Scrape POST and Scrape With PUT send a payload in the request body, so Lyro can reach endpoints that only answer to a specific method.

How does Lyro track a crawl that runs for a while?

Create Scrapfly Crawler returns a crawler UUID. Get Crawler Status reports progress, pages crawled, and completion state for polling, Get Crawler URLs lists everything discovered, and Get Crawler Contents returns the pages once the crawl has finished.

Why would Lyro request screenshot metadata instead of the image?

Capture Screenshot Metadata performs a HEAD request that returns the screenshot's URL and status without downloading the image body. That is what makes an async screenshot workflow possible: request the capture, check the metadata, and fetch the file only once it is ready.

How do we keep an eye on Scrapfly credits?

Get Scrapfly Account Information returns the API credit balance and usage statistics for the connected key, so Lyro can report where the budget stands before launching a crawl across a large site rather than after the credits are gone.

Scrapfly MCP integration

Scrapes pages that block ordinary requests, crawls whole sites, captures screenshots, and returns extracted fields instead of raw HTML.

Connect Scrapfly See all integrations

12actions available

Three actions you can hand over today

Every action runs live through MCP. Nothing to build, nothing to maintain.

Scrapfly scrape
Lyro scrapes webpages to extract product details, pricing, reviews, or content customers ask about. You get current information instantly to answer questions accurately.
Extract structured data
Lyro extracts structured data from websites using AI to identify prices, specs, and key information. Your team pulls organized data from unstructured pages for analysis.
Capture website screenshot
Lyro captures full-page screenshots of websites to document competitor pages or design changes. Your team tracks what competitors are doing without manual screenshots.

See all 12 actions

How businesses use Scrapfly + Lyro

Each card is one request a support team gets, and the Scrapfly actions Lyro runs to close it.

Fetch a page that blocks ordinary requests
Lyro scrapes the URL with JavaScript rendering and proxies configured, and switches to a POST or PUT request when the target expects a body rather than a plain fetch.
Scrapfly ScrapeScrapfly Scrape POSTScrape With PUT
Crawl a whole site and collect what it finds
Lyro starts a recursive crawl, polls its progress and page count, and returns the crawled content as markdown, text, HTML, or JSON, or as a WARC or HAR archive.
Create Scrapfly CrawlerGet Crawler StatusGet Crawler ContentsGet Crawler Artifact
Capture how a page actually renders
Lyro takes a full-page or viewport screenshot with JavaScript rendered, or requests only the metadata when the image itself is fetched later in an async workflow.
Capture Website ScreenshotCapture Screenshot Metadata
Turn a fetched page into structured fields
Lyro passes scraped HTML through an AI model, an LLM prompt, or a custom template, so a page comes back as the fields you asked for instead of markup someone still has to parse.
Extract Structured DataScrapfly ScrapeGet Crawler Contents

How it works

Get started in 3 steps

Connect once, then just ask. There is no workflow builder to learn and nothing to maintain — Lyro reads the Scrapfly actions it has and picks the ones a request needs.

01
Connect Scrapfly
Authorize the Scrapfly account your team already uses — one consent screen, no API keys, no mapping tables. Lyro can only do what you granted that account, and you can disconnect it at any time.
02
Tell your agent what you need
Describe the job the way you would hand it to a teammate. Lyro maps it to the Scrapfly actions that close it and chains as many as the request needs.
03
Watch it work
The agent runs the actions inside the conversation the customer is already in, so nobody copies data between tabs and your team can take over at any point.
Get started free

Scrapfly · Lyro

Everything else about Scrapfly

Setup, permissions, and the limits of what Lyro can do inside Scrapfly.

Some targets are API endpoints rather than pages and reject a plain fetch. Scrapfly Scrape covers the standard request, while Scrapfly Scrape POST and Scrape With PUT send a payload in the request body, so Lyro can reach endpoints that only answer to a specific method.

Every action available in Scrapfly

All 12 actions your agent can call on Scrapfly, straight from the live MCP connection.

Capture website screenshot
Capture a full-page or viewport screenshot of a website.
Capture screenshot metadata (head)
Capture screenshot metadata without downloading the image body.
Create scrapfly crawler
Create a new web crawler to recursively crawl an entire website.
Extract structured data
Extract structured data from HTML or other content using AI models, LLM prompts, or custom templates.
Get scrapfly account information
Retrieve Scrapfly account information.
Get crawler artifact
Download crawler artifact files in WARC or HAR format.
Get crawler contents
Retrieve extracted content from crawled pages.
Get crawler status
Get the current status of a crawler including progress, pages crawled, and completion state.
Get crawler urls
Retrieve the list of discovered and crawled URLs from a crawler.
Scrapfly scrape
Perform a web scraping request.
Scrapfly scrape post
Scrape web pages using POST method to send data in the request body.
Scrape with put
Scrape web pages using PUT method with body payload.