Indexing

The act by a search engine robot of following website links and gathering content. When a web page is included in a search engine’s database, it is said to be indexed. Used as a synonym for spider and crawl.