| Both sides previous revision Previous revision Next revision | Previous revision Next revisionBoth sides next revision |
| search_engine_ranker:script_manual [2020-11-05 09:12] – [Variables usable in SETUP and STEP Section] sven | search_engine_ranker:script_manual [2021-06-02 07:52] – [The STEP Section] sven |
|---|
| * [[http://forum.gsa-online.de/discussion/18031/some-snippets-to-accelerate-ini-writing|Some snippets to accelerate .ini writing]] | * [[http://forum.gsa-online.de/discussion/18031/some-snippets-to-accelerate-ini-writing|Some snippets to accelerate .ini writing]] |
| * [[https://github.com/seospace/gsapi|gsapi - Simple HTTP server for GSA Search Engine Ranker]] | * [[https://github.com/seospace/gsapi|gsapi - Simple HTTP server for GSA Search Engine Ranker]] |
| | * [[https://forum.gsa-online.de/discussion/28159/serengines-command-list/p1|Additional Commands for SerENGINE Scrip Language]] |
| ===== The Structure ===== | ===== The Structure ===== |
| |
| |page must have|This parameter is used to check whenever the webpage is usable for this engine or not. The content of this variable has to be present in the webpage (either pure text or html source). The variable can have multiple values separated by a %%|%% where just one has to match**.**\\ \\ //Example: //\\ //page must have1=Powered by XYZ%%|%%XYZ Powered//\\ //page must have2=!not allowed to access this page//\\ //page must have3=Webpage%%|%%Homepage//\\ \\ In the above example you see 3 variables and each of them has to match before a engine is used for that website. The ! parameter in "page must have2" means that the following should not appear on the page.| | |page must have|This parameter is used to check whenever the webpage is usable for this engine or not. The content of this variable has to be present in the webpage (either pure text or html source). The variable can have multiple values separated by a %%|%% where just one has to match**.**\\ \\ //Example: //\\ //page must have1=Powered by XYZ%%|%%XYZ Powered//\\ //page must have2=!not allowed to access this page//\\ //page must have3=Webpage%%|%%Homepage//\\ \\ In the above example you see 3 variables and each of them has to match before a engine is used for that website. The ! parameter in "page must have2" means that the following should not appear on the page.| |
| |url must have|This parameter is used the same way as "page must have" but for the URL string itself and not for the website content. \\ \\ //Example: url must have1=/wiki///\\ // url must have2=!wikipedia.com//\\ \\ In the above example we will not use this engine for URLs that contain //wikipedia//.com or do not have "/wiki/" in there URL.| | |url must have|This parameter is used the same way as "page must have" but for the URL string itself and not for the website content. \\ \\ //Example: url must have1=/wiki///\\ // url must have2=!wikipedia.com//\\ \\ In the above example we will not use this engine for URLs that contain //wikipedia//.com or do not have "/wiki/" in there URL.| |
| |fixed url|If no "//search term//" is used, you have to use this tag to indicate that the submission is just happening on one fixed site (usualy some kind of web 2.0 site with blog creation). \\ \\ //Example: fixed url=//[[https://my.opera.com/|https://my.opera.com]]\\ \\ This is than adding the URL to the target URLs of the project and starts a submission to it. | | |fixed url|If no "//search term//" is used, you have to use this tag to indicate that the submission is just happening on one fixed site (usualy some kind of web 2.0 site with blog creation). \\ \\ //Example: fixed url=//%%https://my.opera.com/%%\\ \\ This is than adding the URL to the target URLs of the project and starts a submission to it. | |
| |search term|This is used to search for new targets on the internet with the help of search engines like google.\\ \\ //Example: //\\ //search term="Powered by XYZ"%%|%%"Powered by XYZ"//\\ \\ The example above uses two possible search queries. You can use also encoded the search term already if you want with "%90%AF%24". This is useful for queries in some strange language. The program will pick one of the queries randomly so the order is not important.| | |search term|This is used to search for new targets on the internet with the help of search engines like google.\\ \\ //Example: //\\ //search term="Powered by XYZ"%%|%%"Powered by XYZ"//\\ \\ The example above uses two possible search queries. You can use also encoded the search term already if you want with "%90%AF%24". This is useful for queries in some strange language. The program will pick one of the queries randomly so the order is not important.| |
| |add keyword to search|1 = Add a keyword from the project to the search query\\ 0 = Never add a keyword to the search query\\ 2 = Add just sometimes a keyword to it if it seems to be useful (default)| | |add keyword to search|1 = Add a keyword from the project to the search query\\ 0 = Never add a keyword to the search query\\ 2 = Add just sometimes a keyword to it if it seems to be useful (default)| |
| |encode post data|1 = encode the data in a proper way as used in POST protocol\\ 2 = encode it using multipart \\ 0 = take the data as it is without encoding anything\\ 3 = encode it using json syntax| | |encode post data|1 = encode the data in a proper way as used in POST protocol\\ 2 = encode it using multipart \\ 0 = take the data as it is without encoding anything\\ 3 = encode it using json syntax| |
| |variable must be used|A form is only submitted if certain variables have been used in that form.\\ \\ //Example: variable must be used=url,login%%|%%email//\\ \\ The above example requires a form to use the variable "url" or "login" and "email".\\| | |variable must be used|A form is only submitted if certain variables have been used in that form.\\ \\ //Example: variable must be used=url,login%%|%%email//\\ \\ The above example requires a form to use the variable "url" or "login" and "email".\\| |
| |add fixed data add fixed data condition\\ \\ \\ \\ //remove fixed data//\\ \\ //remove fixed data condition//|This will add a form field if the thing in "add fixed data condition" is found on the webpage. This works only if both variables are defined. Don't worry about this to much as you will probably never use this. It is only required if some sites add data to forms by javascript to prevent automated submissions. You can use "remove fixed data" to just remove that from the posting.\\ \\ //Example: //\\ //add fixed data=code=%captcha%;hidden=0//\\ //add fixed data condition=code_sign;hidden_data//\\ \\ If the webpage has anywhere the word "code_sign" in it we add a new form field called code that will be filled with a captcha. And if the word "hidden_data" is found we also add a new form field called "hidden" with the content "0".| | |add fixed data\\ add fixed data condition\\ \\ \\ \\ //remove fixed data//\\ \\ //remove fixed data condition//|This will add a form field if the thing in "add fixed data condition" is found on the webpage. This works only if both variables are defined. Don't worry about this to much as you will probably never use this. It is only required if some sites add data to forms by javascript to prevent automated submissions. You can use "remove fixed data" to just remove that from the posting.\\ \\ //Example: //\\ //add fixed data=code=%captcha%;hidden=0//\\ //add fixed data condition=code_sign;hidden_data//\\ \\ If the webpage has anywhere the word "code_sign" in it we add a new form field called code that will be filled with a captcha. And if the word "hidden_data" is found we also add a new form field called "hidden" with the content "0".| |
| |set unknown variable\\ \\ set unknown variable condition|If a form field is unknown as we didn't define how to fill it in our engine, we could still fill it by something you define here. The submission aborts if this is not defined and something is unable to get filled. The "set unknown variable condition" doesn't have to be used but if it is, the string on that variable must be present to use this.\\ \\ //Example: set unknown variable=%question%//\\ \\ If a filed is found called "blahantispam193802378" we can still define how to fill this and it gets filled by the value %question% which is handled by a popup asking you how to fill it. Also often used it "set unknown variable=%leave%" which will simply leave the value as it is.| | |set unknown variable\\ \\ set unknown variable condition|If a form field is unknown as we didn't define how to fill it in our engine, we could still fill it by something you define here. The submission aborts if this is not defined and something is unable to get filled. The "set unknown variable condition" doesn't have to be used but if it is, the string on that variable must be present to use this.\\ \\ //Example: set unknown variable=%question%//\\ \\ If a filed is found called "blahantispam193802378" we can still define how to fill this and it gets filled by the value %question% which is handled by a popup asking you how to fill it. Also often used it "set unknown variable=%leave%" which will simply leave the value as it is.| |
| |match by option label|1 = A form with a select or radio field is filled by checking the variable content against the option labels (the one you see on the browser).\\ 0 = We will not check for a matching label\\ \\ //Example: match by option label=1//| | |match by option label|1 = A form with a select or radio field is filled by checking the variable content against the option labels (the one you see on the browser).\\ 0 = We will not check for a matching label\\ \\ //Example: match by option label=1//| |
| |html to markdown|1 = Convert html code to markdown code\\ 0 = Do not convert it\\ <text> = Convert it if the text is appearing on the website.\\ Also note that "//allow html=1//" has to be set.| | |html to markdown|1 = Convert html code to markdown code\\ 0 = Do not convert it\\ <text> = Convert it if the text is appearing on the website.\\ Also note that "//allow html=1//" has to be set.| |
| |html to custom link format\\ custom link format|1 = convert html code to a custom format\\ 0 = Do not convert it.\\ <text> = Convert it if the text is appearing on the website.\\ \\ //Example://\\ //html to custom link format=1//\\ //custom link format=[%url% %anchor_text%]//\\ \\ This would be used for Wiki engines where a link is encoded in a special way.\\ Also note that "//allow html=1//" has to be set.| | |html to custom link format\\ custom link format|1 = convert html code to a custom format\\ 0 = Do not convert it.\\ <text> = Convert it if the text is appearing on the website.\\ \\ //Example://\\ //html to custom link format=1//\\ //custom link format=[%url% %anchor_text%]//\\ \\ This would be used for Wiki engines where a link is encoded in a special way.\\ Also note that "//allow html=1//" has to be set.| |
| | |basic html only|1 = keep just basic html tags (default if custom link format is used)\\ 0 = keep html as it is| |
| |html line break\\ \\ html line break format|Converts a normal line break to some html line break (default <br>). You can specify the line break format in "html line break format" if it is some special line break as seen in some wiki engines.\\ \\ //Example://\\ //html line break=1//\\ //html line break format=<<BR>>//| | |html line break\\ \\ html line break format|Converts a normal line break to some html line break (default <br>). You can specify the line break format in "html line break format" if it is some special line break as seen in some wiki engines.\\ \\ //Example://\\ //html line break=1//\\ //html line break format=<<BR>>//| |
| |custom img format|If set, it will try to locate the html syntax for images and replace it with that new syntax.\\ \\ //Example://\\ //custom img format=[img=%url%]//| | |custom img format|If set, it will try to locate the html syntax for images and replace it with that new syntax.\\ \\ //Example://\\ //custom img format=[img=%url%]//| |
| |
| |%captcha% *image.php?*|tries to find the captcha that has image.php? in the URL path| | |%captcha% *image.php?*|tries to find the captcha that has image.php? in the URL path| |
| |%captcha% fixed:http://some-url-with-captcha.com/image.php?rnd=123|is not searching for a captcha but using that fixed URL| | |%captcha% fixed:%%http://some-url-with-captcha.com/image.php?rnd=123%%|is not searching for a captcha but using that fixed URL| |
| |%captcha% overlay:*image.php?*|is searching for more than one captcha and combines them to one file| | |%captcha% overlay:*image.php?*|is searching for more than one captcha and combines them to one file| |
| |