The act by a search engine robot of following website links and gathering content. When a web page is included in a search engine’s database, it is said to be indexed. Used as a synonym for spider and crawl.
|
|
|
May 3, 2011
The act by a search engine robot of following website links and gathering content. When a web page is included in a search engine’s database, it is said to be indexed. Used as a synonym for spider and crawl. |