bash
$


Our story

Having built many web scraper WordPress plugins, we repeatedly went through the tiresome process of finding proxies, setting up headless browsers, and handling user agents. That’s why we decided to start HeadlessBrowserAPI, it handles all of this for you so you can scrape any page with a simple API call.

What is HeadlessBrowserAPI?

It is a new Proxy API for Web Scraping that can be used for getting HTML content from webpages with JavaScript rendered content.

We handle headless browsers (and proxies, if you use the Tor endpoint), so you can get the HTML from any web page with a simple API call! And when we say “any web page” – we mean it! The Tor endpoint will be able to scrape web sites from the Dark Web (.onion links)!

You will get control over a web-browser hosted as a service, using Chrome (via Puppeteer, Tor or PhantomJs) to render your JavaScript heavy webpages as HTML, PDF or JPG.

Check a detailed example on how this API can help you, on this page: Details about how this API can help you, with a real life example.

What will this API offer?

  • Get accurate and fresh content scraped from any website with the most powerful web scraper ever created!
  • Built-in Rotating Proxy System – Using a proxy allows you to control the IP Address that your browser requests use. Use a different proxy IP for each request you make, using a 200,000+ Proxies Pool, available without extra charge. Never get blocked again!
    While you can use a custom proxy, we also have a built in rotating proxy to handle common needs. By default, the API will use a random IP Address from around the world, for each request it makes.
  • Generate full page screenshots for any web site.
  • Automatically solve CAPTCHAs.
  • Automatically block Ads.
  • A Headless Browser Software-as-a-Service (SaaS) that’s free for light use, and cheap for heavy use.
  • 200% faster than traditional scrapers
  • Content that is as much as 150% more accurate, due to our superfast, adaptive technology, using headless JS scraper API. Get the most powerful scraper in the world today!

Are there any WordPress plugins make use of this API?

Sure, check the list of WordPress plugins that support this API:

Functionality Demo Video

Fully Customizable

HeadlessBrowserAPI is not only easy to start with, it’s also easy to customize. HeadlessBrowserAPI allows you to customize used user agent, cookies, HTTP user and password, used proxies and more. Easily render JavaScript with the selected headless browser by the endpoint used. See our documentation for more details.

Fast and Reliable

We guarantee unlimited bandwidth with speeds up to 100Mb/s, perfect for writing speedy web crawlers. We offer unparalleled speed and reliability so you can easily build scalable web scrapers. Contact our friendly customer support if you run into any trouble!

API key based authentication is required for each request you make. API keys can be generated here.