View Full Version : How Often Should I Resubmit My Optimized Site?
rudolf1
05-19-2007, 06:01 PM
Hello there! I am a web developer and recently my boss asked me the following:
Since we submit an optimized site what is going on with spiders, and that is how often do they spiders pass from my site, do we have to resubmit the site to engines and directories, will the spiders pass forever and if that happens should i refresh the site's content?
Could anyone help me?
themanwhowas
05-19-2007, 06:20 PM
search engines WANT to give their users up to date links and descriptions. Once your site has been spidered the first time, it is added to the search engines spider database and will come back frequently. The frequency is dependent on your popularity, pagerank with google for instance. The bigger your site, by bigger i mean more popular, the more you will be spidered. If you have some kind of webstats you can find the robots there to see how often they come by
markov
09-16-2007, 09:15 AM
There is no need of submitting the site to the search engines, they will spider the site if you constantly update the site. The BIG sites like CNN are crawled many a times within a single day. So this proves the point.
Horus_Kol
09-16-2007, 07:05 PM
also, many search engines will ignore multiple submissions...
Samiic
09-19-2007, 02:48 AM
All depends on frequensy of appearing new content on your web site.
airtrance
10-17-2007, 03:45 PM
But does submitting again harm the site? will it get penalize??
Horus_Kol
10-18-2007, 07:25 PM
But does submitting again harm the site? will it get penalize??
I can't say that I've heard of that happening - but I wouldn't be surprised...
in any event, there isn't a lot of point to it - once you're in the system, you're in
recover
10-20-2007, 08:37 AM
Hi
Btw how I can know if my website has been spidered. Does it has got to do something with indexing?
Thanks
Horus_Kol
10-21-2007, 04:32 AM
you know if your page has been spidered/indexed by checking your logs (any decent web hosting service should provide a decent report)... you will see the GoogleBot, or other search engines bots, in the list of agents... that means you have been visited and spidered by the bot...
learningwords
10-21-2007, 05:48 AM
Hi
And also as Newbie , I heard that if in Google search page, if you see snippets( bold) in the keywords of your website, it has been spidered. Is that true?
Horus_Kol
10-22-2007, 06:15 AM
if you search for www.whatever-domain.com and it has a description and some snippet of your content, then yes, your index page has been spidered...
whether the whole site has been spidered is another thing - Google (or other bots) might have trouble following your links for whatever reason...
the most reliable thing is to check your logs
jvfconsulting
01-04-2008, 06:46 PM
I've always been told patience is key and not o resubmit your site, it may be removed for multiple submissions. Also when you make your sitemap make sure you have <priority>0.5</priority>
<changefreq>daily</changefreq>
Reiss
02-27-2008, 10:23 AM
I'd highly recommend you sign up for a free google webmasters account.
This has tools to see exactly how often your site is crawled, what keywords are picked out by google (ie what the bot reads) and many more essential SEO tools.
www.google.com/webmasters/tools/
vBulletin® v3.6.7, Copyright ©2000-2010, Jelsoft Enterprises Ltd.