ai-web-scraping · developer-tools · 0 triggers · 10 actions
WebCrawlerAPI provides crawling, page scraping, AI web agents, and monitored website feeds through a unified API. Add WebCrawlerAPI to your Stream Deck workflows with guided setup for the connection details it needs.
Add WebCrawlerAPI to a workflow and pair it with a Stream Deck button to run it in one press — handy for ai-web-scraping tasks. Combine it with OBS, your Elgato tools, or any other app you connect to build a routine that fits how you work.
Browse all templatesSteps your workflow can perform in WebCrawlerAPI.
Start a metered asynchronous crawl over a site and return its job ID. The crawl may visit and charge for up to items_limit pages; use GET_CRAWL_JOB to monitor it.
Create a recurring website-change feed. Creation immediately schedules an initial crawl that may consume metered credits, and future scheduled runs may also consume credits; delete the feed when it is no longer needed.
Permanently cancel a feed so it cannot be resumed. The feed is removed from feed listings, but retained history may remain directly readable for 30 days.
Get a crawl job's status, configuration, per-page results, content URLs, errors, and observed costs. Respect recommended_pull_delay_ms when polling.
Get one feed's configuration, lifecycle status, and recent run history, including per-run crawl counts and cost. Canceled feeds remain directly readable while retained by the provider.
Return current spendable balance plus request count and USD usage for a date range. The connected API key is used for both organization routes.
Return one page of detected feed changes as structured JSON, with an opaque continuation cursor for older pages.
List active and paused feeds for the connected organization, newest first. Logically canceled feeds are omitted.
WebCrawlerAPI provides crawling, page scraping, AI web agents, and monitored website feeds through a unified API.
Create your Conductor Deck account: no credit card required.
Follow the setup prompts for WebCrawlerAPI. Conductor Deck handles the app authorization or required connection details inside the workflow builder.
Add a WebCrawlerAPI action to your visual workflow canvas. Configure the options you need, then connect it to other steps.
Sync your workflow to any Stream Deck button. Press once to trigger the entire sequence.
Sign up for free and start building WebCrawlerAPI workflows in minutes.