Expert Internet Marketing Advice for Small Businesses
Heres a quick walkthrough on how to configure Simple SERP Scraper, which can be downloaded for free here.
This is the time the tool will wait between each scrape.В This setting is very important if you are not using proxies.
These are the recommended settings, to make sure Google doesnt block or ban your IP address:
Note: The random setting makes the searches look as natural as possible, delaying each scrape anywhere between 30 to 90 seconds. This does mean the tool will take a little longer to run, but at least you wont trigger any captchas. That being said, if you intend to do aВ large number of search queries using the site: and info: operators, captchas will beВ inevitable!
For most standard prospecting jobs, proxies areВ not necessary, if the scrape delay is set to Random we designed the tool to run without them.В But if you intend to do bulk prospecting (more than 100 search queries),В wed recommended using them.
TIP: Only ever use anonymous proxies and ideally you should use private ones.В If you want to use public proxies, bear in mind that they are slow. And you'll need a lot of them, as Google is very quick at blocking them.
This is where you set up the link metrics you want to retrieve, and add the necessary keys to fetch the data.
Fetches toolbar PageRank for each URL and the domain. The tool uses a third party service called PageRank.My-Addr.com toВ retrieve this data. We could have got the data without this service, but it means using proxies. The service is really cheap: $1 for 100,000 checks, which works out to beВ 0.001В cents per check!
To fetch this data, first sign up for an account and then add your API key into the field. Your API key is the long number found on this page.
Dont use this key, its just an example! >В http://pagerank.my-addr.com/external_api/A5621F56440D928546234EB196609A50/[url]
2. Majestic SEO
To fetch Majestic data youll need a paidВ accountВ silver or above. Click on theВ В Get Access Token to authorise the app and retrieve your OpenApps unique access token. Enter the access token into the field.
Mozscape data is available to anyone with a Moz account: free, pro or paid. Although, there are some major speed differences between them:
Click on the Get Credentials link to retrieve your Access ID and Secret Key.
NOTE:В Using a free API account willВ add considerable time to large prospecting jobs.
Once youre all set up and youre ready to go click the Scrape button. The speed depends on various factors: your connection, proxies (if used) and the speed of link metric data providers.