ScrapingBee is a web scraping API that handles headless browsers and proxy rotation, allowing developers to extract HTML from any website in a single API call.
ScrapingBee is a web scraping API that handles headless browsers and proxy rotation, allowing developers to extract HTML from any website in a single API call. On Nagent, Scrapingbee is exposed as a fully-configurable ai web scraping integration that any agent can call — 5 actions, and API key authentication. No code is required to wire Scrapingbee into your workflow — connect it once via the External Integrations panel and reuse it across every agent you build.
Agent builders use Scrapingbee to automate the kinds of tasks ai web scraping teams previously handled manually. Concrete examples — each one is a single agent step in Nagent — include:
Every action and trigger is paired with a structured input/output schema (visible in the sections below), so when you wire Scrapingbee into Helix — our agentic agent builder — the editor knows exactly what each step expects and produces. Configure once, deploy anywhere across your Nagent agents.
Every operation an agent can call against Scrapingbee, with input parameters and output schema. Drop these into any step of an agent built in Helix.
SCRAPINGBEE_DATA_EXTRACTIONTool to extract structured data from a webpage using CSS or XPath selectors. Use ScrapingBee's extract_rules feature.
Input parameters
The webpage URL to extract data from.
Seconds to wait before extraction (for dynamic content).
Emulate device type (desktop or mobile).
Your ScrapingBee API key.
JSON object defining fields to extract and their CSS/XPath selectors. For nested selectors, use object with 'selector' and optional 'type' keys. Misaligned or invalid selectors silently drop fields with no error — verify each selector matches the target DOM before large-scale use.
Whether to render JavaScript before extraction.
Two-letter country code for proxy geolocation (e.g., 'us', 'de').
Use premium proxy for higher reliability.
Block images, CSS, and resources to speed up extraction.
Custom HTTP headers to forward to the target website. Provide as a dict, e.g., {'Accept-Language': 'en-US'}. Headers will be prefixed with 'Spb-' and forwarded to the target.
Output
Data from the action execution
Error if any occurred during the execution of the action
Whether or not the action execution was successful or not
SCRAPINGBEE_HTML_FETCHTool to fetch HTML or screenshot via ScrapingBee HTML API. Use when you need page markup or image after optional JS rendering and resource controls. For anti-bot or CAPTCHA-protected sites (e.g., Cloudflare), combine render_js=true with premium_proxy=true or stealth_proxy=true to avoid blocks.
Input parameters
The URL to scrape.
Milliseconds to wait before returning content.
Number of retries on request failure.
Device type to emulate ('desktop' or 'mobile').
Cookies to send in requests (HTTP header string).
CSS selector to wait for before returning content.
Block ads and tracking scripts.
Render JavaScript before returning HTML. Required for client-side rendered pages where dynamic data is absent in raw HTML.
JavaScript snippet to execute before returning content.
Return screenshot as base64-encoded PNG.
JSON scenario for custom headless browser actions.
Two-letter country code for geolocation (e.g., 'us').
Extraction rules (CSS selector or JSONPath).
Use premium proxy for scraping.
Use stealth (undetectable) proxy mode.
Block images and CSS resources on the page to speed up scraping.
CSS selector of element to screenshot.
Capture full-page screenshot instead of only viewport.
Output
Data from the action execution
Error if any occurred during the execution of the action
Whether or not the action execution was successful or not
SCRAPINGBEE_SCRAPING_BEE_PROXY_MODETool to fetch web content via ScrapingBee's Proxy Mode. Use when you need to route requests through ScrapingBee proxies with optional JS rendering and resource blocking.
Input parameters
The target URL to scrape through ScrapingBee Proxy Mode.
Cookies to send with the request as a key-value mapping.
Additional HTTP headers to forward to the target site. Each header will be prefixed with 'Spb-' and forwarded when forward_headers is enabled.
Request timeout in milliseconds.
Block ads and tracking scripts to speed up scraping.
Enable JavaScript rendering before returning content.
Session identifier (integer) to keep the same IP for multiple requests. Use the same number to maintain consistent IP across requests.
Custom JavaScript scenario name for advanced interactions.
Two-letter country code for geolocated proxy (e.g., 'us', 'fr').
Use premium proxies for higher reliability.
Use stealth proxy mode for extra undetectability.
Block images and CSS resources to speed up scraping. Only relevant when render_js is enabled.
Forward original request headers to the target site.
Output
Data from the action execution
Error if any occurred during the execution of the action
Whether or not the action execution was successful or not
SCRAPINGBEE_STEALTH_PROXYTool to perform stealth scraping via ScrapingBee's Stealth Proxy mode. Use when you encounter anti-bot measures requiring undetectable requests.
Input parameters
The URL of the webpage to retrieve using stealth proxy.
Wait time in milliseconds before returning the response.
Device type to emulate during rendering. Options: 'desktop' or 'mobile'.
Custom cookies in semicolon-separated format: 'name1=value1;name2=value2'.
Render JavaScript on the page before returning the response.
Two-letter country code for proxy geolocation (e.g., 'us', 'de').
Extraction rules in JSON string for structured data.
Use premium proxies for higher reliability.
Enable stealth proxy mode. Use when the target site blocks bots.
Block images, styles, and fonts for faster loads.
Forward original request headers from the browser.
Return the raw page source instead of text.
Output
Data from the action execution
Error if any occurred during the execution of the action
Whether or not the action execution was successful or not
SCRAPINGBEE_USAGE_STATSTool to retrieve usage statistics for your ScrapingBee account. Use when you need to monitor remaining credits and request count.
Output
Data from the action execution
Error if any occurred during the execution of the action
Whether or not the action execution was successful or not
No publicly available marketplace agent is found using this tool yet. There are 35 agents privately built on Nagent that already use Scrapingbee.
Build on Nagent
Connect Scrapingbee to any Nagent agent in minutes — no API key management, no boilerplate. Just configure and deploy.
The five questions agent builders ask before adopting a new integration.
Open the External Integrations panel inside Nagent (app.nagent.ai/externalIntegration), find Scrapingbee, and click "Connect Now." You'll authenticate with an API key — Nagent handles credential storage and refresh automatically. Once connected, Scrapingbee is available to any agent in your workspace.
No. Nagent provides no-code integration for every tool. Once Scrapingbee is connected, you configure its 5 actions directly in the agent builder UI — no API calls, no boilerplate, no schema management.
Helix — Nagent's agentic agent builder — lets you drop Scrapingbee steps into any workflow visually. Pick an action (e.g., one of those listed above), fill in the inputs (Helix knows the required vs. optional schema for each parameter), and connect it to upstream/downstream steps. Triggers run as the entry point of an agent, so when a Scrapingbee event fires, the agent kicks off automatically.
Every Scrapingbee action and trigger ships with a fully-typed schema — input parameters with name, type, required flag, and description, plus the output payload shape. The schemas are documented in the sections above. Helix uses these schemas to validate your configuration at build time and to type-check the data flowing between steps.
Yes. While Scrapingbee ships with 5 pre-built ai web scraping actions, you can layer custom logic around them inside Helix — pre/post-processing steps, conditional branches, retries, or stitching Scrapingbee together with other connected tools. For deeper customization, talk to our team about Nagent's Agentic AI Lab — forward-deployed engineers who build Scrapingbee-based workflows tailored to your business.