Go Back  HTML Forums - Free Webmaster Forums and Help Forums > PROMOTION & COMMERCE > Search Engine Tactics & Optimization
Reload this Page prevent spider grabbing URLs....
User Name:
Password:
 

Reply
Thread Tools   Display Modes
  View First Unread
 
Old 05-13-2008, 08:35 AM
  #1
herz
Aspirant (Level 2)
 
Join Date: Mar 2008
Posts: 15
iTrader: (0)
herz is an unknown quantity at this point
prevent spider grabbing URLs....
Is there any way to prevent a spider from grabbing URLs that you want to keep off search engines?

thanks......
__________________
online personal finance credit cards for ok credit
herz is offline   Add to del.icio.us Add to del.icio.us    Can you digg it?Can you digg it? Reply With Quote
Old 05-13-2008, 06:27 PM
  #2
Horus_Kol
Mod of the Underlay
 
Horus_Kol's Avatar
 
Join Date: Jun 2002
Location: At a desk, hooked up and ready to rock
Posts: 15,824
iTrader: (0)
Horus_Kol is a jewel in the roughHorus_Kol is a jewel in the roughHorus_Kol is a jewel in the rough
a discussion that was started right before yours:
http://www.htmlforums.com/search-eng...ls-103067.html
__________________


So sue me for being pedantic... I can give you a bullet-list of reasons why you can't
Horus_Kol is offline   Add to del.icio.us Add to del.icio.us    Can you digg it?Can you digg it? Reply With Quote
Old 06-02-2008, 08:32 AM
  #3
Thomas Schulz
Adept (Level 5)
 
Thomas Schulz's Avatar
 
Join Date: Jul 2006
Posts: 47
iTrader: (0)
Thomas Schulz is an unknown quantity at this point
robots.txt, nofollow in a tags, noindex and nofollow in meta tags
Thomas Schulz is offline   Add to del.icio.us Add to del.icio.us    Can you digg it?Can you digg it? Reply With Quote
Reply
« Previous Thread | Next Thread »


 
Currently Active Users Viewing This Thread: 1 (0 members and 1 guests)
 
  
  
 
 



 
  POSTING RULES
 
 
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts
vB code is On
Smilies are On
[IMG] code is On
HTML code is Off
Thread Tools
Display Modes
Linear Mode Linear Mode

Forum Jump

 

All times are GMT -5. The time now is 02:52 PM.
   
Network Sites: Web Tools and Resources | Web Templates | Free Webmaster Resources | Free JavaScripts | Free Clip Art | Clipart Resources |
Turnkey Website Templates | Free Fonts | HTML Help | Stock Photos | Quality Hosting | Learn Perl and CGI | Top Web Hosts | CMS Templates

Partner Sites: Free Web Templates | Webmaster Resources | Javascripts | Website Reviews | DHTML Scripts | Create a free forum | Web Hosting Reviews |Free Ecommerce Web Hosting

Mascot team created by Drawshop.com

Powered by vBulletin® Version 3.6.7
Copyright ©2000 - 2008, Jelsoft Enterprises Ltd.

Server Monitoring by ENIACmonitor 0.01
HTMLforums.com © Big Resources, Inc. Web Design by BoxedArt.com
vRewrite 1.5 beta SEOed URLs completed by Tech Help Forum and Chalo Na.