RE: HACKING SITES THrough robots.txt files 12-18-2012, 08:55 PM
#11
it may help in giving some info about website but it's not so helping. Every site contains robots.txt and it's open.
The stories and information posted here are artistic works of fiction and falsehood. Only a fool would take anything posted here as fact.
| HACKING SITES THrough robots.txt files filter_list | |
![[+]](https://sinister.li/images/modern/collapse_collapsed.png)
RE: HACKING SITES THrough robots.txt files 01-21-2013, 05:34 AM
#14
You can do a lot of thing with robots.txt, Discover hidden directories, admin panel, search for vulnerable plugins if any are installed on the server, and if the server has a symbolic link to the directories you can view files and folders through your web browser to hidden DIR's just like a shell. Robots.txt is very useful for those who think nothing can be done with it.
![[Image: 8Hd3UZQ.png]](http://i.imgur.com/8Hd3UZQ.png)
My Private Tools:
[*] Private SQL INJECTION SCANNER! [*]
[*] HQ Tutiorals Too! [*]
RE: HACKING SITES THrough robots.txt files 02-05-2013, 08:01 AM
#15
Web site owners use the /robots.txt file to give instructions about their site to web robots; this is called The Robots Exclusion Protocol.
It works likes this: a robot wants to vists a Web site URL, say http://www.example.com/welcome.html. Before it does so, it firsts checks for http://www.example.com/robots.txt, and finds:
User-agent: *
Disallow: /
The "User-agent: *" means this section applies to all robots. The "Disallow: /" tells the robot that it should not visit any pages on the site.
Please go through this site and find something to use : http://www.robotstxt.org/robotstxt.html
It works likes this: a robot wants to vists a Web site URL, say http://www.example.com/welcome.html. Before it does so, it firsts checks for http://www.example.com/robots.txt, and finds:
User-agent: *
Disallow: /
The "User-agent: *" means this section applies to all robots. The "Disallow: /" tells the robot that it should not visit any pages on the site.
Please go through this site and find something to use : http://www.robotstxt.org/robotstxt.html
(03-09-2012, 10:19 AM)Dragonhacker Wrote: this is a finding from me when googling. It is known that goole keeps track of all website pages visited by anybody. Then a text file called robots.txt was invented which is used to direct google on the pages of a particular websites it should not track. Sometimes, those pages are pages which contain special pages known only to the admin of the site. They are pages which also gives u a necessary information about the site. Therefore, if u find the robots.txt file of any site. U can get juicy info from it. Here is how to find vulnerable sites. just go to google search and type
inurl:robots.txt. I hope i have helped. Comments are welcomed
Thanks
Vijay
*snip
Vijay
*snip
RE: HACKING SITES THrough robots.txt files 10-16-2013, 05:25 PM
#17
It will only show you the pages which are not available to public if they are not well configured you can also get admin/page access just by opening it.
I am N000TTTT what You think!!!!!!
RE: HACKING SITES THrough robots.txt files 10-17-2013, 05:57 PM
#18
You can't hack websites with that , you can just take some info , maybe you can hack from robots.txt the websites which are not well constructed, Or said better , terrible constructed.
If you need help , drop me a PM and I will help you with the best I can !
![[Image: V7mYdF6.png]](http://i.imgur.com/V7mYdF6.png)
RE: HACKING SITES THrough robots.txt files 11-05-2013, 10:53 AM
#20
it only display disallowed webpages and usergent how could it be useful from hacking?
