Dismiss Notice
Welcome to Our Community
Wanting to join the rest of our members? Feel free to sign up today.

How MSN spider works

Discussion in 'Search Engine Optimization' started by ovi, Jun 16, 2005.

  1. ovi

    ovi Guest

    Look what I have found directly from the MSN pages:

    * se only well-formed HTML code in your pages. Ensure that all tags are closed, and that all links function properly. If your site contains broken links, MSNBot may not be able to index your site effectively, and people may not be able to reach all of your pages.
    * If you move a page, set up the page's original URL to direct people to the new page, and tell them whether the move is permanent or temporary. For more information, see What to do when your site moves.
    * Make sure MSNBot is allowed to crawl your site and is not on your list of web crawlers that are prohibited from indexing your site.
    * Use a robots.txt file or meta tags to control how MSNBot and other web crawlers index your site. The robots.txt file tells web crawlers which files and folders it is not allowed to crawl. The Web Robots Pages provide detailed information on the robots.txt Robots Exclusion standard. This site may be available in English only.
    * Keep your URLs simple and static. Complicated or frequently changed URLs are difficult to use as link destinations. For example, the URL www.example.com/mypage is easier for MSNBot to crawl and for people to type than a long URL with multiple extensions. Also, a URL that doesn't change is easier for people to remember, which makes it a more likely link destination from other sites.

    Content guidelines for your website (back to top)

    The best way to attract people to your site, and keep them coming back, is to design your pages with valuable content that your target audience is interested in.

    * In the visible page text, include words users might choose as search query terms to find the information on your site.
    * Limit all pages to a reasonable size. We recommend one topic per page. An HTML page with no pictures should be under 150 KB.
    * Make sure that each page is accessible by at least one static text link.
    * Keep the text that you want indexed outside of images. For example, if you want your company name or address to be indexed, make sure it is displayed on your page outside of a company logo.
    * Add a site map. This enables MSNBot to find all of your pages easily. Links embedded in menus, list boxes, and similar elements are not accessible to web crawlers unless they appear in your site map.
    * Keep your site hierarchy fairly flat. That is, each page should only be one to three clicks away from the home page.

    Items and techniques discouraged by MSN Search (back to top)

    The following items and techniques are not appropriate uses of the index. Use of these items and techniques may affect how your site is ranked within MSN Search and may result in the removal of your site from the MSN Search index.

    * Loading pages with irrelevant words in an attempt to increase a page's keyword density. This includes stuffing ALT tags that users are unlikely to view.
    * Using hidden text or links. You should use only text and links that are visible to users.
    * Using techniques to artificially increase the number of links to your page, such as link farms.

  2. sgtsearch

    sgtsearch Guest

    Good post.

    I've mentioned on our site as well about getting hit by MSN. Half of my HTML coding is deprecated and I plan on fixing that soon - going to an almost exclusive CSS based design.

    This part I really like :

    "In the visible page text, include words users might choose as search query terms to find the information on your site"

    A search engine telling us to use keywords. I haven't used MSN much - just testing for position - but it seems spot on :

    Seach Tests:

    UK Web Directory (Position 6)

    UK Directory (Position 3)

    And for you guys :

    uk webmaster forum (Position 5)

    Let's hope they can at least get a little more market share - for our sake.
  3. ovi

    ovi Guest


    sgtsearch, thanks for let me know, actually I have verify some time ago but not lately.


Featured Resources (View All)

Share This Page