As you know, my blog (blog.int6.net) isn't been indexed by Google for 2 month,
when I have looked the google cache (site:blog.int6.net), I always saw only one page :(
I added sitmap etc... but It doesn't work :(
HOWEVER, my friends blog (kozan.int6.net) (now it's closed) is fully indexed

What should I do now ? Where did I wrong ?
Posted on 2006-08-20 18:29:39 by Dite
Why doesn't Google index all of the pages of my site?

Although we index billions of webpages and are constantly working to increase the number of pages we include, we can't guarantee that we'll crawl all of the pages of a particular site.



Webmaster Guidelines
Posted on 2006-08-20 19:10:07 by arafel
Maybe no-one is linking to it?
And since your site shares its IP with many other sites, it isn't crawled via IP-scan.
Posted on 2006-08-20 19:38:57 by Ultrano
Invest in a "robots.txt" file ;)
Posted on 2006-08-20 19:53:25 by SpooK
@Ultrano:
Hmmm, that's posible.

@SpooK:
Isn't it robot.txt prohibiting directory listing ?

@arafel:
That's obvious arafel and I'm looking for a solution for this.
I don't understand purpose of your post
Posted on 2006-08-21 04:06:25 by Dite
Purpose of my post was to show that the problem might be not related to anything 'technical' from your side.

I would still check the link I gave. There are some things that might be not so

obvious
Posted on 2006-08-21 04:19:11 by arafel
Do what everyone else seems to do - poison google's cache by hammering its URL submission link.
Not too hard, just hard enough.

Also, increase your rank by getting your url posted on sites which are already crawled, this site is crawled regularly, so post your URL in here and see a result fairly quickly :)
Posted on 2006-08-21 07:57:35 by Homer

@SpooK:
Isn't it robot.txt prohibiting directory listing ?


Yes, if you specify prohibited directories, otherwise it serves as a guide to how the robots should crawl your website.
Posted on 2006-08-21 13:32:19 by SpooK
Imho, specifying prohibited directories is a bad idea, at least if you haven't got access control for those areas...
Posted on 2006-08-21 13:36:53 by f0dder
Thanks guys.
Posted on 2006-08-22 05:15:34 by Dite