traineo community
Member of traineo? Sign in here
traineo Community / Website Support / XML feed showing in search engine?
Author Message
Josh P.
traineo Newbie
Posts: 8

Post History
# Posted: 14 Sep 2006 17:55


So the XML feed for my progress is in the first 10 search results for my name on Google. How can I completely turn all of that off from search engines?


Ron Bell
traineo Fanatic
Posts: 119

Post History
# Posted: 14 Sep 2006 18:09


Google is probably indexing all publicly accessible sites on Traineo. One thing that might work is to go into the Traineo about me section and to deselect "allow non-members to see my page." Presumably, such non-public sites are either inaccessible to Google's crawlers or contain "robot.txt" exclusion tags, which Google and Yahoo both say that they honor.

Max, Chris?


Maxwell Lamb
Fitness Guru
Posts: 369

Admin
Post History
# Posted: 14 Sep 2006 18:49


Hi Josh, Ron,

Very interesting that google is deciding to prioritise your XML feed over your actual page. What I can do is this:

Firstly, XML feeds respect your privacy settings - so if you've disallowed others from seeing your profile etc., they won't be able to see your feed.

So, if you've got an externally viewable page, what we can do is make sure that robots.txt excludes all publically viewable user's XML feeds - there is, however, a caveat to this, insofar as there are some badly behaved web-crawlers out there who basically do exactly what your robots.txt file says not to do.

As Ron says, the non-public sites are invisible to the crawlers, as they are to any non-logged-in user.

Sound reasonable?

Thanks,

Maxwell


Josh P.
traineo Newbie
Posts: 8

Post History
# Posted: 14 Sep 2006 18:57


I've desiabled non-member stuff, so that should fix this issue. I could have sword I had that disabled before but I've been wrong before :P

So for me this issue is fixed with just changing the privacy settings for non-members.


Jeremiah Utecht
traineo Fanatic
Posts: 190

Post History
# Posted: 14 Sep 2006 20:16


w00t my Traineo Page has the #2 spot behind my Podcast ... very groovy!


Please sign up to traineo or log in if you wish to post.
 
© traineo 2007