Puppeteer is a popular tool for web scraping and parsing. The installation process couldn't be simpler, which means you can get started quickly even if this isn’t something that's been done before! As an example, we've shown the set-up process for the IP authorisation method:
In Puppeteer, under the ‘proxy-server’, update the proxy server IP and port number (i.e. 23.109.55.108:10000).
For example:
const puppeteer = require('puppeteer');
(async () => {
const browser = await puppeteer.launch({
headless: false,
args: ['--proxy-server=23.109.55.108:10000']
});
const page = await browser.newPage();
await page.authenticate();
await page.goto('https://soax.com/');
await page.screenshot({path: 'example.png'});
await browser.close();
})();
For more detailed information - you can check out the official Puppeteer documentation, which should answer any queries you might have.