what is this? (dvdtalk html related)
#1
Thread Starter
DVD Talk Hall of Fame
Joined: Feb 2000
Posts: 7,849
Likes: 0
Received 0 Likes
on
0 Posts
From: on the mountain
what is this? (dvdtalk html related)
http://www.dvdtalk.com/forum/archive.../t-397793.html
just did a google and came up with this. never seen this before. does the forum software export a seperate version of the forums that is made to get high rankings?
there weren't adds so i dunno how that would help so much
just did a google and came up with this. never seen this before. does the forum software export a seperate version of the forums that is made to get high rankings?
there weren't adds so i dunno how that would help so much
#4
DVD Talk Limited Edition
Joined: Sep 2000
Posts: 5,176
Likes: 0
Received 0 Likes
on
0 Posts
From: CT
if you click on the 'archive' link at the bottom of the page, this is what you'll see.. pretty sure it's vBulletin's way of making things easier for the search engines to crawl your site..
#6
DVD Talk Godfather
It's available on every thread, not just archived ones. It also happens near instantenously, as I guess the HTML files are always being rewritten.
For example: http://dvdtalk.com/forum/archive/ind.../t-430428.html
I think their robots.txt file probably sends them to snoop only within archive. Although I can't get DVD Talk's robots.txt file.
For example: http://dvdtalk.com/forum/archive/ind.../t-430428.html
I think their robots.txt file probably sends them to snoop only within archive. Although I can't get DVD Talk's robots.txt file.




