AptlyStar

Bright Data

Scrape websites, search engines, and extract structured data

使用方法

Integrate Bright Data into the workflow. Scrape any URL with Web Unlocker, search Google and other engines with SERP API, discover web content ranked by intent, or trigger pre-built scrapers for structured data extraction.

ツール

brightdata_scrape_url

Fetch content from any URL using Bright Data Web Unlocker. Bypasses anti-bot protections, CAPTCHAs, and IP blocks automatically.

入力

パラメータ型必須説明
apiKeystringはいBright Data API token
zonestringはいWeb Unlocker zone name from your Bright Data dashboard (e.g., "web_unlocker1")
urlstringはいThe URL to scrape (e.g., "https://example.com/page"\)
formatstringいいえResponse format: "raw" for HTML or "json" for parsed content. Defaults to "raw"
countrystringいいえTwo-letter country code for geo-targeting (e.g., "us", "gb")

出力

パラメータ型説明
contentstringThe scraped page content (HTML or JSON depending on format)
urlstringThe URL that was scraped
statusCodenumberHTTP status code of the response

Search Google, Bing, DuckDuckGo, or Yandex and get structured search results using Bright Data SERP API.

入力

パラメータ型必須説明
apiKeystringはいBright Data API token
zonestringはいSERP API zone name from your Bright Data dashboard (e.g., "serp_api1")
querystringはいThe search query (e.g., "best project management tools")
searchEnginestringいいえSearch engine to use: "google", "bing", "duckduckgo", or "yandex". Defaults to "google"
countrystringいいえTwo-letter country code for localized results (e.g., "us", "gb")
languagestringいいえTwo-letter language code (e.g., "en", "es")
numResultsnumberいいえNumber of results to return (e.g., 10, 20). Defaults to 10

出力

パラメータ型説明
resultsarrayArray of search results
↳ titlestringTitle of the search result
↳ urlstringURL of the search result
↳ descriptionstringSnippet or description of the result
↳ ranknumberPosition in search results
querystringThe search query that was executed
searchEnginestringThe search engine that was used

brightdata_discover

AI-powered web discovery that finds and ranks results by intent. Returns up to 1,000 results with optional cleaned page content for RAG and verification.

入力

パラメータ型必須説明
apiKeystringはいBright Data API token
querystringはいThe search query (e.g., "competitor pricing changes enterprise plan")
numResultsnumberいいえNumber of results to return, up to 1000. Defaults to 10
intentstringいいえDescribes what the agent is trying to accomplish, used to rank results by relevance (e.g., "find official pricing pages and change notes")
includeContentbooleanいいえWhether to include cleaned page content in results
formatstringいいえResponse format: "json" or "markdown". Defaults to "json"
languagestringいいえSearch language code (e.g., "en", "es", "fr"). Defaults to "en"
countrystringいいえTwo-letter ISO country code for localized results (e.g., "us", "gb")

出力

パラメータ型説明
resultsarrayArray of discovered web results ranked by intent relevance
↳ urlstringURL of the discovered page
↳ titlestringPage title
↳ descriptionstringPage description or snippet
↳ relevanceScorenumberAI-calculated relevance score for intent-based ranking
↳ contentstringCleaned page content in the requested format (when includeContent is true)
querystringThe search query that was executed
totalResultsnumberTotal number of results returned

brightdata_sync_scrape

Scrape URLs synchronously using a Bright Data pre-built scraper and get structured results directly. Supports up to 20 URLs with a 1-minute timeout.

入力

パラメータ型必須説明
apiKeystringはいBright Data API token
datasetIdstringはいDataset scraper ID from your Bright Data dashboard (e.g., "gd_l1viktl72bvl7bjuj0")
urlsstringはいJSON array of URL objects to scrape, up to 20 (e.g., [{"url": "https://example.com/product"\}\]\)
formatstringいいえOutput format: "json", "ndjson", or "csv". Defaults to "json"
includeErrorsbooleanいいえWhether to include error reports in results

出力

パラメータ型説明
dataarrayArray of scraped result objects with fields specific to the dataset scraper used
snapshotIdstringSnapshot ID returned if the request exceeded the 1-minute timeout and switched to async processing
isAsyncbooleanWhether the request fell back to async mode (true means use snapshot ID to retrieve results)

brightdata_scrape_dataset

Trigger a Bright Data pre-built scraper to extract structured data from URLs. Supports 660+ scrapers for platforms like Amazon, LinkedIn, Instagram, and more.

入力

パラメータ型必須説明
apiKeystringはいBright Data API token
datasetIdstringはいDataset scraper ID from your Bright Data dashboard (e.g., "gd_l1viktl72bvl7bjuj0")
urlsstringはいJSON array of URL objects to scrape (e.g., [{"url": "https://example.com/product"\}\]\)
formatstringいいえOutput format: "json" or "csv". Defaults to "json"

出力

パラメータ型説明
snapshotIdstringThe snapshot ID to retrieve results later
statusstringStatus of the scraping job (e.g., "triggered", "running")

brightdata_snapshot_status

Check the progress of an async Bright Data scraping job. Returns status: starting, running, ready, or failed.

入力

パラメータ型必須説明
apiKeystringはいBright Data API token
snapshotIdstringはいThe snapshot ID returned when the collection was triggered (e.g., "s_m4x7enmven8djfqak")

出力

パラメータ型説明
snapshotIdstringThe snapshot ID that was queried
datasetIdstringThe dataset ID associated with this snapshot
statusstringCurrent status of the snapshot: "starting", "running", "ready", or "failed"

brightdata_download_snapshot

Download the results of a completed Bright Data scraping job using its snapshot ID. The snapshot must have ready status.

入力

パラメータ型必須説明
apiKeystringはいBright Data API token
snapshotIdstringはいThe snapshot ID returned when the collection was triggered (e.g., "s_m4x7enmven8djfqak")
formatstringいいえOutput format: "json", "ndjson", "jsonl", or "csv". Defaults to "json"
compressbooleanいいえWhether to compress the results

出力

パラメータ型説明
dataarrayArray of scraped result records
formatstringThe content type of the downloaded data
snapshotIdstringThe snapshot ID that was downloaded

brightdata_cancel_snapshot

Cancel an active Bright Data scraping job using its snapshot ID. Terminates data collection in progress.

入力

パラメータ型必須説明
apiKeystringはいBright Data API token
snapshotIdstringはいThe snapshot ID of the collection to cancel (e.g., "s_m4x7enmven8djfqak")

出力

パラメータ型説明
snapshotIdstringThe snapshot ID that was cancelled
cancelledbooleanWhether the cancellation was successful

On this page