up vote 2 down vote favorite

I asked this question an hour ago:

Odd entries in DNS lookup log

The question contained the string "xdnrhkbqnn". If I now Google this string I get just one hit, namely my question.

How did Google get to index this page so quickly. Is there a way in which Serverfault.com gets pages indexed quickly?

link
This is technically off topic, but i'd love to know the answer. – Tom O'Connor Jan 24 at 0:36
4  
P.S. this site isn't a 'forum', it's a Q&A site, which makes a huge difference to how much other people love it, which directly increases its google popularity and ranking, and thus indexing speed. – Mark Henderson♦ Jan 24 at 0:38
feedback

migrated from serverfault.com Jan 24 at 0:38

This question came from our site for system administrators and desktop support professionals.

3 Answers

up vote 9 down vote

You have to be really, really, really popular and have a really, really, really fast site. See http://meta.stackoverflow.com/questions/67246/how-do-stack-overflow-questions-appear-in-google-search-results-in-seconds

There's also this one:

http://meta.stackoverflow.com/questions/36925/how-frequently-are-new-questions-indexed-by-search-engines

the short answer is, that Google decided to do this themselves - it wasn't something that anyone from stack exchange did.

link
3  
"Google lives here" :-) – voretaq7♦ Jan 24 at 0:59
+1 You don't come to Google and talk to a man like Moe Greene like that! Google comes to you. – Chris S♦ Jan 24 at 1:02
feedback
up vote 0 down vote

Most likely it's just pure luck in that googlebot may have been checking the site at about the same time you were posting. I've had the same happen to my own (very low traffic) site.

link
6  
Google really does index the SE network crazy fast (at least the main 3 sites). Every time I post something, it shows up in Google about 30 seconds later. its so fast infact, that we often get people who are mildly mentally handicapped posting things like "omg did you try google? You can find the answer on their duuhbrain", and then when you check the google query they post, the only thing you see is this very question. True story, happened to me the other day. – Mark Henderson♦ Jan 24 at 1:57
@Mark, perhaps they keep bots parked on really busy sites. – John Gardeniers Jan 24 at 4:36
@MarkHenderson Saw this too :) – thinice Jan 24 at 4:36
feedback
up vote 0 down vote

Jeff answered a question over at M.SO in relation to why the SE network of sites are so fast.

The answer you are looking for (note that this doesn't mention SF, just "us", so I'm presuming all the sites.):

Google's crawler is now indexing us at, and I am not making this up, 10 requests per second, which is the maximum.

Lots of quick, topical, regularly updating content is working in SE's favour.

link
feedback

You must log in to answer this question.

Not the answer you're looking for? Browse other questions tagged