How to restrict who may read my blog?
web crawler using POST method
Hello Guest		   
  • Login
• Register…
• Start blog		   • Who, Where, When
• What can I do?
• What to Read?		   • Polls
• Avatars
• Interests		   • Cities and Countries
• Random blog
• Users search		   • Search
• Games
• Tests
• QAIX		   • Сообщества
• Talxy Chat
• Horoscope
• Online		  
Зарегистрируйся!
QAIX > Search Engine Optimization > web crawler using POST method 18 October 2005 02:58:19
  Recent blog posts: 
Free iPod nano raffle for…
Aimersoft 2008 Christmas promotion: "Free iPod nano raffle for Chrismas" and "Buy 1 Get…

How to convert Rhapsody to…
Music purchased from Rhapsody is under DRM protection, which stops customers from playing the downloaded&helli­p;

PS3 firmware update adds full…
Eric Lempel, Sony's Director of PlayStation Network Operations, has posted on the official PlayStation 3…

Nintendo makes $6 profit on…
According to Macquarie Securities analyst David Gibson, Nintendo makes $6 USD operating profit on each…

Maintenance in winter
Skin for winter very easy to do, if does not supplement the moisture in time, like persimmons, flat and…

'Jasper' Xbox 360s finally…
'Jasper' Xbox 360s finally available According to a flooding of posts over at xbox-scene, it appears…

How to transfer Napster music…
Music purchased from Napster is under DRM protection, which stops customers from playing the downloaded&helli­p;

The song my brother taught me
Don't let your heart be hardened Don't let your love grow cold May it always stay so childlike May it…

My brother taught me this…
God grant me the serenity to accept the things I cannot change; courage to change the things I can;…

baz-baz-baz-baz pam-parabaram…
baz-baz-baz-baz pam-parabaram baz-baz-baz-baz pam-parabaram baz-baz-baz-baz pam-parabaram-baz ba-ra-ba…

  They have birthday today: 
xiongchong
henna diah
  Forums:   
    topic feeds

• QAIX  all topics, blogs and comments

• PHP web-programming

• Perl web-programming

• ASP web-programming

• Visual Basic Programming

• .Net Development

• C/C++ Programming

• Java Programming

• Javascript web-programming

• Apache HTTP Server

• Web-design

• Web-hosting, dedicated, colocation

• HTML web-programming

• XML development

• General Web-programming

• Content Management Systems

• ColdFusion

• Search Engine Optimization

• Hardware

• Software, Computer Help

• MySQL database development

• PostgreSQL database development

• MS Access database development

• Oracle database development

• MS SQL database development

• Informix database development

• Buy / Sell

• Open discussion

• Anonymous
  Discuss: 
Google media-partner bot used…
I joined here today becuase i dont know who to tell about what has happened, and what i feel is a…

any + or - feedback on company…
these guys are callining us "trafficconversions­.com" -- articus

Any one heard of 192.comAgent?
I am seeing 192.comAgent in my logs, and have not found any information on it. Anyone know what this…

Need Automotive Information?
Need Automotive Information? Try this! Results 1 - 10 of 1857 found for the search Ford…
  Recent forum topics: 
why infix:<div>:(Int, Int…
HaloO, I realized from the typed literal thread that S03 now explicitly states that div on two Ints…

[rt.cpan.org #41329] VMS…
<URL: http://rt.cpan.org/­Ticket/Display.html?­id=41329 > Thanks, applied

how to write literals of some…
Hello, I'm wondering how to write anonymous value literals of some Perl 6 basic types, and I didn't…
  Recent forum comments:
RE: Updating A Portion Of A Site
Thanks! I remembered just before I came back to check. It's amazing the things you forget. Thanks…

RE: Updating A Portion Of A Site
Use a FrontPage include file - see Help on Included Content. Or, if all pages are asp or PHP, use a…

RE: Index Files
What they are telling you is the home page of your site (before you publish it) must be named index.htm…

RE: Website diifers from local copy
I see it as a 40x68 icon (clear your cache) - as for the position check w/ Google API help Neither issue…

RE: Forced submit
"Ellie" <ellymay999nospam@n­ospamnetzero.com> wrote in message…

RE: access denied
IUSR account doesn't have access to cmd.exe by default (assuming you are using anonymous…

RE: access denied
Hey guys, I'm totally out of my league here, I don't even know how I got stuck with this problem, it's…

RE: Forced submit
Ellie wrote on 05 sep 2008 in microsoft.public.in­etserver.asp.general­: You cannot…

RE: [patch@34995] vms.c - Memory…
On Wed, Dec 3, 2008 at 7:38 PM, John E. Malmberg <wb8tyw@qsl.net> wrote: Thanks, applied as…

RE: why infix:<div>:(Int, Int…
On Thu, Dec 4, 2008 at 3:26 PM, David Green <david.green@telus.­net> wrote: Using…
  Moderators:
 Administrator
 Protorioris

web crawler using POST method

Laura Connor 18 October 2005 02:58:19
 Hi!

Present web crawlers don't seem to use the HTTP POST method. Is this
unethical or even illegal? It may sure cause some problems in the
beginning, but in the end it may make more information accessible
through search engines. What do you think?

Laura
Add comment
Philip Baker 18 October 2005 02:58:19 [ permanent link ]
 In article <dj0cbm$9tg$1@news.­innotek.vu>, Laura Connor
<lconnor@innotek.vu­> writes>Present web crawlers don't seem to use the HTTP POST method. Is this>unethical or even illegal? It may sure cause some problems in the>beginning, but in the end it may make more information accessible>through search engines. What do you think?

What would they POST to the web site? A SOAP request?
--
Philip Baker
Add comment
 

Add new comment

As:
Login:  Password:  
 
 
  
 
Пожалуйста, относитесь к собеседникам уважительно, не используйте нецензурные слова, не злоупотребляйте заглавными буквами, не публикуйте рекламу и объявления о купле/продаже, а также материалы нарушающие сетевой этикет или УК РФ.

QAIX > Search Engine Optimization > web crawler using POST method 18 October 2005 02:58:19
see also:
can't retrieve data through PHP
Multi-line requests in COPY ... FROM…
[Fwd: [ph-linux-newbie] help on cron]
пройди тесты:
see also:
How to convert protected and…
MelodyCan YouTube Ripper
Convert video (AVI, WMV, MOV) to iPod
  Copyright © 2001—2008 QAIX
Idea: Miсhael Monashev
Помощь и задать вопросы можно в сообществе support.qaix.com.
Сообщения об ошибках оставляем в сообществе bugs.qaix.com.
Предложения и комментарии пишем в сообществе suggest.qaix.com.
Информация для родителей.
Write us at:
If you would like to report an abuse of our service, such as a spam message, please .