Proxies for scraping jobs

A scraper fires a lot of requests at one site in a short time. The ProxyWorld unlimited plan spreads those requests over many home connection IPs and charges only for the days, no matter how much data you download.

Why requests get blocked

Most sites count requests per IP. Once an IP passes their limit, they slow it down on purpose or show a verification screen. A few thousand requests from one server IP reach that limit quickly.

Through the gateway (the entry address for the proxy), your requests leave from a large pool of residential IPs. A residential IP is an address on an ordinary home internet line. The total you send stays the same, but each IP sends about as much as a regular visitor.

Price comes from period and tier

On the 200 connection, 100 Mbps tier, Layover (1 day) is $4.35. Tour (7 days) is $4.09 a day for $28.63 total, Stay (30 days) is $3.70 a day for $111.00 total, and Residence (90 days) is $3.31 a day for $297.90 total.

Data volume does not matter. If a job pulls more than roughly 11~14 GB a day, unlimited is cheaper than residential by the GB. Collecting photo heavy store pages gets you past that easily.

Choosing a connection tier

Count how many requests are open at any one moment. If you run 150 workers (collection jobs running at the same time), the 200 tier is enough and leaves room to retry failed requests.

With several collection servers, add up all their workers. Around 400 in total fits the 500 tier (200 Mbps). It is $7.12 on Layover, or $6.05 a day on Stay. You can choose a different tier the next time you buy a plan.

What you may collect

Pages anyone can open without logging in: public product data, news articles, business listings and the like. Before you start, check that site's terms of use and the law in the country where you do business.

Accounts are suspended for login attempts with leaked credentials, spam, DDoS or access to government sites. Leaving a gap between requests per domain eases the load on the other server and lets you keep collecting from it for a long time.

How to set up ProxyWorld for Web scraping

1
Sign up with an email and password, or with the token shown on the sign-up page. Then top up your USD balance in crypto in the payment window.
2
Under unlimited residential, choose a period (Layover, Tour, Stay, Residence or a custom 1~365 days) and a connection tier, then pay.
3
Add -zone-unl to the end of your proxy username. If you need data by country, add a country code as well, such as -cc-fr.
4
Enter gate.proxyworld.shop in the scraper's proxy settings. The port is 6100 for HTTP and 6200 for SOCKS5.

Frequent questions

Does the IP change with every request?

Yes. Without a -sid option in the username, each request is assigned a new residential IP.

After logging in, I need the same IP for a few pages.

Add -sid- and a session name to the username, for example -sid-shop01. Requests with the same session name leave from the same IP, and -ttl- sets how long it holds, up to 60 minutes.

Are there limits other than data?

You get the concurrent connections and speed of the tier you bought. Data is not counted.

My order status says Activating.

Payment is done and the plan is being prepared. An order that cannot be activated is canceled, and the full amount you paid goes back to your balance.