Navigation X
ALERT
Click here to register with a few steps and explore all our cool stuff we have to offer!



   678

How proxy scrapper work? How they get proxy?

by mi2 - 01 February, 2020 - 09:12 PM
This post is by a banned member (mi2) - Unhide
mi2  
Supreme
86
Posts
27
Threads
5 Years of service
#1
Hi all, as the title say I am very curious about this, for example, a site like https://proxyscrape.com/ provides a free proxy list but how they collect them?  can anyone please tell me what is the backend mechanism?
This post is by a banned member (hits) - Unhide
hits  
Registered
89
Posts
7
Threads
5 Years of service
#2
You have to get the api.

Example: https://api.proxyscrape.com/?request=get...nymity=all
hey you, yes you, gimme some of that virtual monies:
1hits8nUKUNdnk76a5Sy1ZAfdPBj2n9rX
This post is by a banned member (Yooko) - Unhide
Yooko  
Retired Staff
1.077
Posts
116
Threads
#3
https://proxyscrape.com/api-documentation


Its all API based. Or you can manually download em.
This post is by a banned member (mi2) - Unhide
mi2  
Supreme
86
Posts
27
Threads
5 Years of service
#4
(This post was last modified: 01 February, 2020 - 09:29 PM by mi2.)
(01 February, 2020 - 09:14 PM)hits Wrote: Show More
 
(01 February, 2020 - 09:14 PM)Yooko Wrote: Show More
https://proxyscrape.com/api-documentation


Its all API based. Or you can manually download em.


I think you both misunderstood or maybe I do not explain it properly. Actually I want to know how they collecting proxy ip:port, not how providing. I want to learn how they scrap.
This post is by a banned member (Yooko) - Unhide
Yooko  
Retired Staff
1.077
Posts
116
Threads
#5
(01 February, 2020 - 09:27 PM)mi2 Wrote: Show More
(01 February, 2020 - 09:14 PM)hits Wrote: Show More
 
(01 February, 2020 - 09:14 PM)Yooko Wrote: Show More
https://proxyscrape.com/api-documentation


Its all API based. Or you can manually download em.


I think you both misunderstood or maybe I do not explain it properly. Actually I want to know how they collecting proxy ip:port, not how providing. I want to learn how they scrap.

If you're asking how Proxyscrape themselves get the proxies. Likely answer is botnets
This post is by a banned member (mi2) - Unhide
mi2  
Supreme
86
Posts
27
Threads
5 Years of service
#6
(01 February, 2020 - 09:30 PM)Yooko Wrote: Show More
(01 February, 2020 - 09:27 PM)mi2 Wrote: Show More
(01 February, 2020 - 09:14 PM)hits Wrote: Show More
 
(01 February, 2020 - 09:14 PM)Yooko Wrote: Show More
https://proxyscrape.com/api-documentation


Its all API based. Or you can manually download em.


I think you both misunderstood or maybe I do not explain it properly. Actually I want to know how they collecting proxy ip:port, not how providing. I want to learn how they scrap.

If you're asking how Proxyscrape themselves get the proxies. Likely answer is botnets


Exactly, I want to learn how Proxyscrape get the proxies, I have small knowledge on botnet (I used smoke loader before), if you dont mind can you please give me details on this in pm?

Thank you.
This post is by a banned member (YassineFRL) - Unhide

Create an account or sign in to comment
You need to be a member in order to leave a comment
Create an account
Sign up for a new account in our community. It's easy!
or
Sign in
Already have an account? Sign in here.


Forum Jump:


Users browsing this thread: 1 Guest(s)