outscraper

Outscraper

Outscraper provides data scraping APIs for search engines, social media, and e-commerce websites. Developers and data scientists use it to extract large-scale public data for market research, lead generation, and competitive analysis. It helps automate data collection from the web.

Official docs: https://outscraper.com/documentation

Outscraper Overview

• Google Search Results
• SERP Data
• Google Maps Results
• Place Details
• Reviews
• Google Play Results
• App Details
• Reviews
• App Store Results
• App Details
• Reviews
• Amazon Product Results
• Product Details
• Reviews
• Amazon Best Sellers Results
• Amazon Search Suggestions
• YouTube Results
• Video Details
• Comments
• Twitter Results
• Tweet Details
• LinkedIn Results
• Profile Details
• Instagram Results
• Profile Details
• TikTok Results
• Video Details
• Walmart Results
• Product Details
• Whois Results
• Proxy
• Realtime Location
• Email Verification
• Phone Number Verification
• Scrape Website Data
• Scrape Text Data
• Parse Website Data
• Parse Text Data
• Summarize Text
• Translate Text
• Extract Contact Details
• Extract Emails From URL
• Extract Phone Numbers From URL
• Extract Social Media From URL
• Extract Locations From URL
• Extract Data From PDF
• Convert HTML to Markdown
• Check Website Status
• Find Similar Websites
• Find Alternative Websites
• Find Websites Using Technology
• Find Websites Using Keywords
• Find People By Skills
• Find People By Email
• Find People By Name
• Find Company By Name
• Find Company By Domain
• Find Company By LinkedIn URL
• Find Company By Facebook URL
• Find Company By Twitter URL
• Find Company By Instagram URL
• Find Company By Crunchbase URL
• Find Company By Location
• Find Company By Industry
• Find Company By Keywords
• Find Company By Funding
• Find Company Employee Count
• Find Company Revenue
• Find Company Founded Year
• Find Company Headquarters
• Find Company Description
• Find Company Website
• Find Company Email Address
• Find Company Phone Number
• Find Company Social Media Links
• Find Company Similar Companies
• Find Company Alternative Companies
• Find Company Technologies Used
• Find Company Job Openings
• Find Company News
• Find Company Events
• Find Company Blog
• Find Company Leadership
• Find Company Investors
• Find Company Acquisitions
• Find Company Exits
• Find Company Patents
• Find Company Trademarks
• Find Company Awards
• Find Company Associations
• Find Company Memberships
• Find Company Customers
• Find Company Suppliers
• Find Company Partners
• Find Company Competitors
• Find Company Financials
• Find Company Filings
• Find Company Legal Disputes
• Find Company Compliance
• Find Company Risk Assessment
• Find Company Sustainability
• Find Company Diversity
• Find Company Ethics
• Find Company Social Responsibility
• Find Company Governance
• Find Company Innovation
• Find Company Research and Development
• Find Company Product Development
• Find Company Marketing
• Find Company Sales
• Find Company Customer Service
• Find Company Operations
• Find Company Human Resources
• Find Company Information Technology
• Find Company Finance
• Find Company Legal
• Find Company Real Estate
• Find Company Supply Chain
• Find Company Manufacturing
• Find Company Distribution
• Find Company Logistics
• Find Company Quality Control
• Find Company Security
• Find Company Health and Safety
• Find Company Environmental Management
• Find Company Crisis Management
• Find Company Business Continuity
• Find Company Disaster Recovery
• Find Company Data Protection
• Find Company Privacy
• Find Company Intellectual Property
• Find Company Licensing
• Find Company Franchising
• Find Company Mergers and Acquisitions
• Find Company Joint Ventures
• Find Company Strategic Alliances
• Find Company Partnerships
• Find Company Investments
• Find Company Divestitures
• Find Company Restructuring
• Find Company Bankruptcy
• Find Company Liquidation
• Find Company Dissolution

Use action names and parameters as needed.

Working with Outscraper

This skill uses the Membrane CLI to interact with Outscraper. Membrane handles authentication and credentials refresh automatically — so you can focus on the integration logic rather than auth plumbing.

Install the CLI

Install the Membrane CLI so you can run membrane from the terminal:

npm install -g @membranehq/cli@latest

Authentication

membrane login --tenant --clientName=<agentType>

This will either open a browser for authentication or print an authorization URL to the console, depending on whether interactive mode is available.

Headless environments: The command will print an authorization URL. Ask the user to open it in a browser. When they see a code after completing login, finish with:

membrane login complete <code>

Add --json to any command for machine-readable JSON output.

Agent Types : claude, openclaw, codex, warp, windsurf, etc. Those will be used to adjust tooling to be used best with your harness

Connecting to Outscraper

Use membrane connection ensure to find or create a connection by app URL or domain:

membrane connection ensure "https://outscraper.com/" --json

The user completes authentication in the browser. The output contains the new connection id.

This is the fastest way to get a connection. The URL is normalized to a domain and matched against known apps. If no app is found, one is created and a connector is built automatically.

If the returned connection has state: "READY", skip to Step 2.

1b. Wait for the connection to be ready

If the connection is in BUILDING state, poll until it's ready:

npx @membranehq/cli connection get <id> --wait --json

The --wait flag long-polls (up to --timeout seconds, default 30) until the state changes. Keep polling until state is no longer BUILDING.

The resulting state tells you what to do next:

• READY — connection is fully set up. Skip to Step 2.
• CLIENT_ACTION_REQUIRED — the user or agent needs to do something. The clientAction object describes the required action:
• clientAction.type — the kind of action needed:
• "connect" — user needs to authenticate (OAuth, API key, etc.). This covers initial authentication and re-authentication for disconnected connections.
• "provide-input" — more information is needed (e.g. which app to connect to).
• clientAction.description — human-readable explanation of what's needed.
• clientAction.uiUrl (optional) — URL to a pre-built UI where the user can complete the action. Show this to the user when present.
• clientAction.agentInstructions (optional) — instructions for the AI agent on how to proceed programmatically.

After the user completes the action (e.g. authenticates in the browser), poll again with membrane connection get <id> --json to check if the state moved to READY.

• CONFIGURATION_ERROR or SETUP_FAILED — something went wrong. Check the error field for details.

Searching for actions

Search using a natural language description of what you want to do:

membrane action list --connectionId=CONNECTION_ID --intent "QUERY" --limit 10 --json

You should always search for actions in the context of a specific connection.

Each result includes id, name, description, inputSchema