 |
|
 |
 |
|
 |
IT Security and Insecurity Portal |
|
 |
Google Search |
 |
 Posted: Wed May 23, 2007 3:26 pm |
 |
|
| zer0-c00l |
| Advanced user |
 |
|
| Joined: Jun 25, 2004 |
| Posts: 72 |
| Location: BRAZIL! |
|
|
 |
|
 |
|
Does anyone know a program that i type a string, and it searches google, and exports the search results to a .txt file? (only the URLs).
example:
i type "allinurl:modules.php"
and the program searches this string in google, and save all the returned websites into a .txt file.
thanks in advance 
sorry my bad grammar |
|
|
|
|
|
|
|
|
| Posted: Thu May 24, 2007 11:23 am |
|
|
| waraxe |
| Site admin |
 |
|
| Joined: May 11, 2004 |
| Posts: 2407 |
| Location: Estonia, Tartu |
|
|
|
|
|
|
Why not to write your own script in php or perl? But there is one serious problem, I have encountered. It appears, that Google is aware of worms and viruses and other malware, using search engines, so that if you make some specific searches in small timeframe, then you will get ugly error messages. Similar behaviour is implemented in Yahoo too, I have seen that allready.
Solutions? One solution is to use alternate search engines. I wrote just yesterday php script for digging out some data from web and was using Altavista for that. And - guess what - altavista seems to not have any limits against searches. |
|
|
|
|
| Posted: Thu May 24, 2007 4:09 pm |
|
|
| zer0-c00l |
| Advanced user |
|
|
| Joined: Jun 25, 2004 |
| Posts: 72 |
| Location: BRAZIL! |
|
|
|
|
|
|
waraxe, nice!
The only problem is that Altavista don't have dome google's functions, like "inurl" and "allinurl"...  Or i can't find them. |
|
|
|
|
| Posted: Thu May 24, 2007 5:11 pm |
|
|
| waraxe |
| Site admin |
|
|
| Joined: May 11, 2004 |
| Posts: 2407 |
| Location: Estonia, Tartu |
|
|
|
|
|
|
There is url: title: domain: and some other:
http://www.altavista.com/help/search/syntax
By the way, I have right now testing php script, which is using google as source, and it works without limitations. Maybe they are cookie based? More logical will be IP-based limits ...
Anyway - most sucking limit in Google and other SE-s is that 1000 answers limit. So if you will get 800 000 answers, then you can see only 1000 first. Therefore I am using some tricks to pull out more data from SE-s |
|
|
|
|
| Posted: Sat May 26, 2007 4:56 pm |
|
|
| zer0-c00l |
| Advanced user |
|
|
| Joined: Jun 25, 2004 |
| Posts: 72 |
| Location: BRAZIL! |
|
|
|
|
|
|
Don't you wanna share this google script? ehehehheehhhehe
 |
|
|
|
|
| Posted: Mon May 28, 2007 8:09 pm |
|
|
| waraxe |
| Site admin |
|
|
| Joined: May 11, 2004 |
| Posts: 2407 |
| Location: Estonia, Tartu |
|
|
|
|
|
|
| zer0-c00l wrote: | Don't you wanna share this google script? ehehehheehhhehe
|
It is programmed for private use, therefore it has bad programmig style and basically it's only test-like code. But still, it can do the work, when needed. So - if you are interested, then let me know and I will share it by email. It's too raw for forum posting |
|
|
|
|
www.waraxe.us Forum Index -> General discussion
You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot vote in polls in this forum
|
All times are GMT
Page 1 of 1
|
|
|
|
Powered by phpBB © 2001-2008 phpBB Group
|
|
|
|
|
Discussions
Tools
Content
Info
Membership:
Latest: 
New Today: 0
New Yesterday: 0
Overall: 9144
People Online:
Visitors: 151
Members: 0
Total: 151
