My robots file

[Chris Gwynne]

Hey

Can you just tell me if you think this is alright for my robots.txt file, anything I've missed or something I should remove from there?

User-agent: *
Disallow: /forums/admincp/
Disallow: /forums/cpstyles/
Disallow: /forums/customavatars/
Disallow: /forums/images/
Disallow: /forums/includes/
Disallow: /forums/modcp/
Disallow: /forums/statistic/
Disallow: /forums/subscriptions/
Disallow: /forums/attachment.php
Disallow: /forums/calendar.php
Disallow: /forums/avatar.php
Disallow: /forums/editpost.php
Disallow: /forums/error.php
Disallow: /forums/login.php
Disallow: /forums/member.php
Disallow: /forums/member2.php
Disallow: /forums/memberlist.php
Disallow: /forums/misc.php
Disallow: /forums/moderator.php
Disallow: /forums/newreply.php
Disallow: /forums/newthread.php
Disallow: /forums/online.php
Disallow: /forums/poll.php
Disallow: /forums/postings.php
Disallow: /forums/printthread.php
Disallow: /forums/private.php
Disallow: /forums/private2.php
Disallow: /forums/profile.php
Disallow: /forums/report.php
Disallow: /forums/register.php
Disallow: /forums/search.php
Disallow: /forums/sendmessage.php
Disallow: /forums/subscription.php
Disallow: /forums/sendtofriend.php
Disallow: /forums/threadrate.php
Disallow: /forums/usercp.php

Thanks for the help.


Regards,
Chris

 

[Dietrich]

Wouldn't it be more useful to disallow the whole forums/ directory except the files to view the index, threads and forums?

 

[Clasione]

Why would you disallow so much information from the spiders...

Like calendar? I specifically set it as view for all just so they can see it....

The more they can eat, the more they will digest.... I'd say, lettem eat it all up....