Hey guys.. As you know ive been workin on this 500k modrewrite site for a client... its going pretty well and im getting traffic from MSN, yahoo and a tad from google .. site is 3-4 weeks old... Once i launch an agressive link campaign our traffic should go up on msn yahoo... Anyways... google crawled and indexed 12,300 pages of mine but there are 500,000 more... does it take time for them to crawl and index the rest? Also i sorta gave up on the g sitemap cause my site is sooo big.. I want to make one but i cant find a solution to create 10 ... 50,000 url sitemap.xml files... Do you guys recommend I just work on deep linking for google or do you think i should also make a g sitemap? has anyone noticed google sitemap helping them more than just the regular gbot crawling ur site?
You should go for sitemap as it helps robot to crawl and indexed fast rather than to wait for spider to come and crawl.