Hi!
It seems my previous Firefox trick (or hack) has gotten a bit famous, hasn’t it? Anyway, here’s another hack! man… am I turning into a life hacker or what? 🙄 This one’s a really curious thing to check out.
We all know what search engines do, right? Yes, search! Baby, search! They scour everywhere for everything. And what do website owners do? They use all sorts of SEO (search engine optimization) tricks to make things easier for search engines, so the SEs can crawl the directories inside their sites smoothly and bring more traffic! Hm… Okay, C.J., enough with the technical stuff! why are you telling us all this? Here’s why…
Did you know there are some directories on websites that owners don’t want the general public to see? Yep, there are! So, what do they do to hide them from us? They don’t exactly bribe the search engines 😀 nah! what they do is add a text file listing the directory names that should be skipped during searches. Search engines read that file first and leave those bits out of the search results page…
But you know us geeks can’t stay out of trouble, right? Yep! There’s a way to peek at those hidden directories! All you have to do is tack on /robots.txt after the domain name and see what the site owners don’t want you to find 😈
How about checking out what Mr. Bill Gates is hiding from us? 😀 Here you go:
http://www.microsoft.com/robots.txt
And what about Larry and Sergei? Yep!
http://www.google.com/robots.txt
Oh, and guys (and gals), you’d better not try this with WordPress.com, or our good old buddy Matt might kick me out of WP 8O. He’s a pretty open guy and probably doesn’t have much to hide :D, but why risk it? 😆
C.J.
Disclaimer: This is totally for educational purposes, and I’m not responsible for any trouble you get into with this!
powered by performancing firefox