1. I've started a massive SPAM purge, any accounts that have spammed are being removed, also for a short period new user signups are disallowed until the SPAM cleaning is finished.

Some doesn't not show regular crawling?

Discussion in 'General Webmaster Discussion' started by deven75, May 9, 2013.

  1. deven75

    deven75 Member

    Joined:
    Feb 6, 2013
    Messages:
    60
    Likes Received:
    1
    Trophy Points:
    6
    Gender:
    Female
    Hi friends,
    I have a ten pages website, 5 of them have been regularly crawled from January to April. But others 5 haven't been crawled after February. What is the main reason behind it.
    Loading...
  2. JazzB

    JazzB Member

    Joined:
    Oct 10, 2012
    Messages:
    216
    Likes Received:
    4
    Trophy Points:
    18
    Gender:
    Female
    Location:
    London
    Do you have a proper sitemap of your site? Are there any errors on those pages? You should check if there are any.
  3. I think there is an error on pages or some issue of size etc is possible as well
  4. airtravel

    airtravel New Member

    Joined:
    May 2, 2013
    Messages:
    24
    Likes Received:
    0
    Trophy Points:
    1
    Gender:
    Male
    Location:
    38 Riding House Street, London
    add robort.txt file in your site
    <meta name="Robots" content="INDEX, FOLLOW" />
  5. miczelino

    miczelino Member

    Joined:
    Apr 22, 2013
    Messages:
    41
    Likes Received:
    1
    Trophy Points:
    6
    Gender:
    Male
    Maybe You have blocked crawlers in htaccess or head section? Increase your amount of backlinks as well.

Share This Page