Check Crawl Status
BRIGHTDATA_GET_SNAPSHOT_STATUSMonitor the progress of your web crawl job to determine when your collected data is ready for download and analysis.
Bright Data
10 actions for Bright Data workflows.
Operations are the actions a workflow can take in Bright Data, grouped by category. Each lists its method, parameters, and a template you can drop it into.
Monitor the progress and completion status of ongoing web crawling jobs. Use these operations when you need to track whether a crawl is still running, has finished successfully, or encountered errors during execution.
Check Crawl Status
BRIGHTDATA_GET_SNAPSHOT_STATUSMonitor the progress of your web crawl job to determine when your collected data is ready for download and analysis.
Apply filters and refine results from your collected datasets based on specific criteria or parameters. This is essential when you want to narrow down large datasets to only the information relevant to your workflow.
Filter Dataset
BRIGHTDATA_FILTER_DATASETRefine marketplace datasets by applying custom filters to isolate specific data segments that match your business criteria. This helps you work with smaller, more relevant datasets tailored to your exact needs.
Retrieve lists of available geographic locations and cities supported by Bright Data's services. Leverage these operations to determine which countries and cities you can target for data collection in your automation workflows.
Get Available Cities
BRIGHTDATA_GET_LIST_OF_AVAILABLE_CITIESRetrieve the list of available cities in a specific country for configuring static proxy endpoints. This helps you select the right geographic location for your proxy network based on your target market or data collection needs.
Get Available Countries
BRIGHTDATA_GET_LIST_OF_AVAILABLE_COUNTRIESRetrieves a list of all available countries and their ISO codes that you can target for proxy configurations and data collection campaigns.
Retrieve and export the collected data from completed crawling or scraping operations. Use this to access your results in downloadable formats and integrate them into downstream processes or storage systems.
Download Scraped Data
BRIGHTDATA_GET_SNAPSHOT_RESULTSRetrieves the complete dataset collected from a web scraping job, allowing you to access and download all the data gathered from your crawl for analysis and use.
Explore and identify pre-built scrapers available for different websites and use cases. Browse this catalog to find ready-made solutions that match your data collection needs before creating custom crawling tasks.
Browse Available Scrapers
BRIGHTDATA_DATASET_LISTDiscover and browse all available pre-made data scrapers from Bright Data's marketplace to find structured data sources for your specific business needs.
Query search engine results and SERP data at scale from multiple locations and search parameters. This operation is valuable when you need to monitor search rankings, competitive intelligence, or gather search-based market research data.
SERP Search
BRIGHTDATA_SERP_SEARCHRetrieve search engine results and competitive intelligence data from major search engines to monitor trends and analyze competitor online visibility. This asynchronous tool returns trackable results for monitoring and reporting.
Enable unrestricted access to websites that may have geographic restrictions, IP blocks, or anti-scraping measures. These operations help you bypass access barriers and manage proxy zones to ensure reliable data collection.
List Unlocker Zones
BRIGHTDATA_LIST_WEB_UNLOCKER_ZONESRetrieve and view all your configured Web Unlocker zones to understand which proxy endpoints are available for web scraping and accessing restricted content.
Web Unlocker
BRIGHTDATA_WEB_UNLOCKERBypass anti-scraping protections and bot detection to extract content from websites that block automated access, enabling reliable data collection from protected sources.
Launch and initialize web crawling jobs to systematically extract data from websites. Use this operation to start your data collection processes and specify target URLs, depth, and collection parameters for your automation.
Trigger Site Crawl
BRIGHTDATA_CRAWL_APIStarts a site crawl job to automatically extract content from multiple pages or entire domains, returning a snapshot ID to track and retrieve results. Use this when you need to gather structured data from websites at scale without manual work.
Drop a trigger and an action into a template; approve from your phone; the workflow runs.