Differences

This shows you the differences between two versions of the page.

Link to this comparison view

Both sides previous revision Previous revision
Next revision		 Previous revision
proxy_scraper:faq [2020-01-20 09:20] – svenproxy_scraper:faq [2022-12-20 07:16] (current) – [What's the difference between private and public proxies?] sven
Line 1: Line 1:
 ====== FAQ ====== ====== FAQ ======
 +
 +
 +===== Whats the difference between this stand alone product and the one included in other GSA products? =====
 +
 +GSA Proxy Scraper as stand alone product can find you a lot more proxies in a shorter time than the basic scraper included in other products. In detail...
 +  * It also has the ability to monitor the found proxies in a better way to separate the good from the bad/unstable proxies. 
 +  * It was a lot more sources to scrape from where the basic scraper is unable to find the proxies.
 +  * It has it's own internal proxy server that can be used as an rotating proxy server.
 +  * It comes with a proxy/port scanner to find proxies listed nowhere else.
 +  * It comes with a [[:pr_emulator|PR-Emulation]] module included.
 +  * It has a many other tools like the [[proxy_scraper:url_metrics|URL Metric Scanner]] or [[proxy_scraper:search_engine_parser|Search Engine Parser]].
 +  * It can test the proxies against many different sites and also test against SMTP usage (used for email verification).
 +Please try the [[https://www.gsa-online.de/download/proxy_scraper.exe|demo version of GSA Proxy Scraper]] and see for yourself.
  
 ===== Why am I getting totally different results when testing the found proxy with another tool? ===== ===== Why am I getting totally different results when testing the found proxy with another tool? =====
Line 74: Line 87:
 This may sound more complicated as it really is. There are nice programs like [[https://www.sockscap64.com/homepage/|sockscap]] that can hook up on any executable and add proxy support for it. This may sound more complicated as it really is. There are nice programs like [[https://www.sockscap64.com/homepage/|sockscap]] that can hook up on any executable and add proxy support for it.
 Together with GSA Proxy Scraper, you can easily have rotating proxies for any application. Together with GSA Proxy Scraper, you can easily have rotating proxies for any application.
 +
 +===== Why did I get a complain from my ISP/VPS provider after using this?  =====
 +
 +The product scans for proxies (IP with a port behind) on all kinds of different websites. Scraping for proxies is usually not a problem, but later the testing counld turn to one.
 +Some really stupid VPS or even ISP providers think that this testing is some kind of a port / net scan. This is of course not the case and the program tries to randomize this testing as best as possible. 
 +However it can happen and if you get into such situation, you might need to use a proxy for testing and maybe also for scraping.  That can be turned on with two options as seen below:
 +
 +{{:proxy_scraper:ps_proxyusage.png}}
 +
 +===== What's the difference between private and public proxies?  =====
 +
 +A **public proxy** is one that is listed on free accessible websites where everyone can see and use that proxy. That is also the reason why public proxies are usually slow and unstable as you don't know how many people are using it and if it. Also keep in mind that a public proxy is often banned on certain websites where proxies would help to get data faster (e.g. google or other search engines).
 +
 +A **private proxy** however is the total opposite to a public proxy. It's usually accessible only to the person who bought this proxy and is also protected by a login/password. If it's not protected, then you usually have to define an IP-Range from where you plant to use it on the proxy providers web interface. Due to the nature that only you can access this proxy, it is considered to be very fast and not blocked on search engines.
 +
 +There are many other proxy types among private proxies such as:
 +
 +  * **Residential Proxies** use real peoples IPs (their computers, mobile phones, and other devices on WiFi). They are also called **peer-to-peer proxies**. Using such proxies makes them much harder to detect than any other proxies. They usually offer more locations and more precise targeting options. Residential proxies are often shared and have to rotate after a while.
 +  * **Rotating Proxies** automatically give you new IP after a certain time without you having to care about this. You get access to one or more backconnect gateway server that connects you to a provider’s IP pool.
 +  * **Shared Proxies** have IPs that multiple people use at the same time. Though this is not as mush are pure public proxies and they are still fast and stable. They are the cheapest option among private proxies. An IP costs 2-3 times less compared to dedicated proxies. When priced by traffic, you’ll pay 5-20 times less compared to residential addresses.
 +  * **Dedicated Proxy** is the complete opposite to //public proxies// and also to //private, shared proxies//. It is a specific IP address used only by a single user that are not used by multiple users. Since no one else shares the same IP address, you have full control over each it's activity.
 +===== Can I scrape private proxies with this product? =====
 +
 +No, all proxies found with GSA Proxy Scraper are considered to be public proxies as everyone can see them on the webpages where it is scraping from. However, there is a way to get proxies not listed anywhere and thats by using the included Proxy Scanner. With that tool you can find open proxy servers from a given IP- and Port-Range by scanning, probing and testing.