Hints And Tips research knowledge archive
Tip# 388
Sponsored Links
 
Subject: DNN: Make search engines reach all your pages
Updated: Jan-28-2007
Rating: Not Rated
By: Rocky Moore - Member #: 461
Location: Klamath Falls, Oregon USA
Website: www.ReflectedThought.com
Category: Computers > Programming > General Web Development > DotNetNuke
Rate This Tip (10=Great):  1  2  3  4  5  6  7  8  9  10
Update: Checked 4.4.0 on my system and it seemed to handle Google properly.  You can check on your system by using a tool called Fiddler, found at http://www.fiddlertool.com.  Open Fiddler and click on the "Reqest Builder" tab (far right) and enter your URL and in the "Request Headers" enter:

User-Agent: Mozilla/5.0+(compatible;+Googlebot/2.1;++http://www.google.com/bot.html)


You should then see the output the exact same as Google does.

--

I noticed that none of the search engines were going past the main page unless they were directly linked.  After viewing the "cached" page provide by the search engine, I noticed the menu was completely gone.  Afer further searching I found that you need to add some settings to your web.config file to inform Solpart menu system that the visitor is a search engine allowing it to force out the correctly formatted links.

The following is the current settings I am using as of this post.  You need to cut and paste these settings into your web.config file in the <System.Web> section.  Just look for the </System.Web> tag and past right above it.  If you already have a browserCaps section, be sure to only include the <filter> items, if not do not worry.



    <browserCaps>
      <filter>
        <!-- SEARCH ENGINES GROUP -->
        <!-- check Google (Yahoo uses this as well) -->
        <case match="^Googlebot(\-Image)?/(?'version'(?'major'\d+)(?'minor'\.\d+)).*">
          browser=Google
          version=${version}
          majorversion=${major}
          minorversion=${minor}
          crawler=true
        </case>
 
        <!-- check Alta Vista (Scooter) -->
        <case match="^Scooter(/|-)(?'version'(?'major'\d+)(?'minor'\.\d+)).*">
          browser=AltaVista
          version=${version}
          majorversion=${major}
          minorversion=${minor}
          crawler=true
        </case>
 
        <!-- check Alta Vista (Mercator) -->
        <case match="Mercator">
          browser=AltaVista
          crawler=true
        </case>
 
        <!-- check Slurp (Yahoo uses this as well) -->
        <case match="Slurp">
          browser=Slurp
          crawler=true
        </case>
 
        <!-- check MSN -->
        <case match="MSNBOT">
          browser=MSN
          crawler=true
        </case>

        <!-- check Northern Light -->
        <case match="^Gulliver/(?'version'(?'major'\d+)(?'minor'\.\d+)).*">
          browser=NorthernLight
          version=${version}
          majorversion=${major}
          minorversion=${minor}
          crawler=true
        </case>
 
        <!-- check Excite -->
        <case match="ArchitextSpider">
          browser=Excite
          crawler=true
        </case>
 
        <!-- Lycos -->
        <case match="Lycos_Spider">
          browser=Lycos
          crawler=true
        </case>
 
        <!-- Ask Jeeves -->
        <case match="Ask Jeeves">
          browser=AskJeaves
          crawler=true
        </case>
 
        <!-- check Fast -->
        <case match="^FAST-WebCrawler/(?'version'(?'major'\d+)(?'minor'\.\d+)).*">
          browser=Fast
          version=${version}
          majorversion=${major}
          minorversion=${minor}
          crawler=true
        </case>
 
        <!-- IBM Research Web Crawler -->
        <case match="http\:\/\/www\.almaden.ibm.com\/cs\/crawler">
          browser=IBMResearchWebCrawler
          crawler=true
        </case>
 
      </filter>

    </browserCaps>



I found this solution posted by Jeremy White in the following post:

http://forums.asp.net/1013338/ShowPost.aspx

[Submit DIGG for this tip]


-----------
Note: Use the tips posted on this site at your own risk. The tips are posted by the public and as such may or may not be valid.

Sponsored Links
     
Categories
hints and tips gold divider
Sponsor Sites To Visit
www.SaintsInLight.com
Thoughts on the Christian walk
along various Christian links.

CICK HERE
www.BringingInTheHarvest.com
Christian:  The harvest is ripe and
the day is short, we need to bring in
the harvest while there is time!

CLICK HERE
XML RSS News Feed For Recently Posted Hints And Tips  RSS Feed
You can now get updates to the Recent Tips section by using RSS. The address is:

HintsAndTips.com/Rss.aspx

* Posting Tips *
To post a Tip, Recommendation or Tips Wanted, simply browse to the category you feel is a best fit for your post (click on the Recommention or Tips Wanted tab if fitting) and then click on "New Post" option.
(C) Copyright 1998-2010 All Rights Reserved