Differences

This shows you the differences between two versions of the page.

Link to this comparison view

Both sides previous revision Previous revision
Next revision		 Previous revision
search_engine_ranker:proxy_options [2022-11-09 08:15] – [Test Proxy] svensearch_engine_ranker:proxy_options [2022-11-09 08:52] (current) – [Options] sven
Line 3: Line 3:
 The same dialog appears in many GSA tools. It might differ in it's design/skin, but the functions and options are all the same. The same dialog appears in many GSA tools. It might differ in it's design/skin, but the functions and options are all the same.
  
-====== Proxy Listing ======+====== List ======
  
 {{:search_engine_ranker:proxy_options-list.png}} {{:search_engine_ranker:proxy_options-list.png}}
Line 67: Line 67:
  
 The proxy scraper comes with many pre-defined sources from where it can extract proxies. You can select different sources here. The proxy scraper comes with many pre-defined sources from where it can extract proxies. You can select different sources here.
 +
 **Attention, it's not recommended to select all of them as that would take ages to extract and test them. You better keep it to like 10 to 20 different providers.** **Attention, it's not recommended to select all of them as that would take ages to extract and test them. You better keep it to like 10 to 20 different providers.**
 +
 You can also define your own sources here (URL or local file). You can also define your own sources here (URL or local file).
 +
 +====== Options ======
 +
 +{{:search_engine_ranker:proxy_options-options.png}}
 +
 +At the top of this dialog you can switch to proxy options which will let you define how to handle the proxies and how to update the listing.
 +
 +===== Search for new proxies every XY minutes =====
 +
 +If you want to use the internal proxy scraper or only want to regularly test the proxies (have all sources unchecked for testing only), enable this option and use a good interval. A good interval is e.g. every 30 minutes.
 +
 +===== Search only on less than =====
 +
 +You can limit this search if you still have enough proxies left by this option. You should use the option to test the proxies as well and then also test the good/working proxies, else you might end up with only dead proxies in the list, all enabled without testing and not finding new proxies as the limit is still not reached. So please handle this option with care!
 +
 +===== Test proxies =====
 +
 +You have several options here on what to test and how. You can click on the label next to the checkbox to switch between different test scenarios:
 +
 +  * **All (good only)** - This is the best option in combination with **Re-test previously working proxies**
 +  * **Only newly added** - This is not recommended as it will not test present proxies who might no longer work.
 +  * **All (good/bad)** - This will test everything in the list. It's also not recommended as it might retest all proxies, even all the previously tested ones that failed and never worked. That's usually a big waste of resources.
 +  * **Public/Private** - This is another switch to only perform tests on one or the other proxy type.
 +
 +**Test to perform** - Here you can define how to test a proxy. You can choose different Tests on the box.
 +
 +  * **Google (Search)** - A real test with a common search query on google. Unlike with other proxy testers, it is not only testing against the root-URL, but with a real search and might react differently.
 +  * **Google (PR)** - A test against the discontinued google PR service. Don't use this unless you know what you are doing.
 +  * **Google (Translate)** - A test against google translation service with a real translation job.
 +  * **Bing** - A test against bing.com with a real search query.
 +  * **WhatIsMyipAddress.com** - A test against this website (usually very slow).
 +  * **ProxyJudge URL** - A test against one of the listed ProxyJudge URLs. This is the only test to tell if a proxy is anonymous or not. Thats the test you should choose in most cases. When you use this test, you can also define **Remove none anonymous proxies** which is something you should consider.
 +  * **Custom Test** - A test where you define an URL and what to expect on that site as a text to call a proxy test passed.
 +
 +**Remove BAD when older than** - This will remove none working proxies after a certain time. It is recommended to use a much higher interval as the search one. Keeping bad proxies in the list for a longer time avoids the risk of finding the same proxy again on a further search and retesting it.
 +
 +===== Automatically disable proxies if detected as being down =====
 +
 +When the software performs it's work via a proxy, it can sometimes detect if the site is down or the proxy. This is not always accurate and it can happen that a good proxy is turned off when it should not. So please keep this unchecked and better turn on the testing of proxies.
 +
 +===== Automatically export working proxies to file ===== 
 +
 +As the option suggests, it will export the found and working proxies to a file. You can then use them in other programs and share the resources.
 +
 +===== Other Options ===== 
 +
 +**Threads** - When scraping or testing proxies it can do many tasks at ones if you increase the amount here. This will speed things up but also put a lot load on your network and CPU. So please handle this with case and not go over 100 threads unless you know what you are doing.
 +
 +**Timeout** - If a connection to a proxy is taking longer than this defined setting, it will be rejected. The default 5 second is already very high and if you want fast proxies, you might even lower this to 1.
 +
 +**Randomize list before testing/avoid false positive portscans** - Often when proxies are found they are from the same IP-Region or network. When this is then tested, it might flag you as a evil port-scanner and you might get into problems with your ISP or VPS hoster. You should really turn this option on to avoid this by randomizing the proxies it tests.
 +
 +**Proxies should resolve domain to IP** - to be 100% anonymous, you can enable this option. It would test proxies and later also use the proxies with the domain of the website it should connect to. Without this option on, the domain would locally resolved to the IP and given to the proxy which is not really anonymous as the DNS-server of your VPS/ISP would see which websites you are going to connect to. This however is usually not a problem and when you turn this option off, it means you can get more proxies who would work with IPs only.
 +
 +**Try using Proxy keep-alive (faster if proxy supports it)** - With this option of, it will try to re-use a previously established proxy connection for a new request instead of a RECONNECT. Not all proxies will allow this though.
 +
 +**Accept Proxy types**
 +
 +You can define what proxies should be accepted/tested here. In the screenshot you see that I prefer not to use any WEB proxy as they often do not work for HTTPS websites. You can follow my suggestion if you use public proxies (private proxies usually use CONNECT or SOCKS4/5).