Every day, a huge amount of new materials appears on the Internet: websites are created, old web pages are updated, photos and video files are uploaded. Without invisible search robots, it would be impossible to find any of these documents on the World Wide Web. There is currently no alternative to such robotic programs. What is a search robot, why is it needed and how do they function?
What is a search robot
( ) – , -, . , - . : , , .
, , – -, , , - , . , () . HTML- , .
– , , - . , , , , , . , -. , ( ) .
, Google "" .
: «» , , «» - ( , ). , .
, ? «» , . , :
robots.txt. , , . "", , , "" Google.
-
« » , , "" "". , .
, :
- : , , , ; ;
- : , , , .;
- : , (, Opera, IE, Google Chrome, Firefox), (Viber, Telegram) (MS Outlook Qualcomm).
"" "" "". , "" , , .
. :
- «» - .
- – -.
- – , .
- – , .
- – , - , .
- «» - , .
- «» - , .
- – -, (, .ru, .kz .ua).
- – .
. , . - :
- . , "" .
- . Google ( ), "" .
- . Google , "" .
- . "" , Google – 14 .
, , . , . , "", , -.
, "" . -, .
, «» . , "" . – -, , . , .
, -. . , : -.