Crawlers (or bots) are used to assemble info out there on the web. By using web site navigation menus, and studying internal and exterior links, the bots start to grasp the context of a web page. Of course, the words, photographs, and other knowledge on pages additionally help search engines like google and yahoo understand what they’re about. Ob