It takes between 2 days and 4 weeks for your brand new website to be crawled and indexed by Google. This range, however, is fairly broad and has been challenged by those who claim to have indexed sites in less than 4 days. Even though Google’s inimitable search engine works on an algorithm, the eternal math that’s happening behind the scenes can’t produce a single, solid answer for us. Still, a guideline of 4 days to 1 month gives webmasters a small amount of comfort while they wait to see where their page will appear in the search giant’s results pages.

How Sites Are Crawled and Indexed by Google

The entire process of indexing is handled by Google’s search algorithm and bots like the Googlebot, which have real-world limitations of hardware speed and physical space for servers. The bots run constantly as they turn the endless digital fields of lost information into over 100,000,000 gigabytes of index. In this way, Google creates a map of the infinite library of the visible Internet.

  1. Googlebot, the algorithm-equipped web-crawling digital robot, sets out to explore the Internet and stops at websites.
  2. When it encounters a site, it reads the information on the website according to instructions outlined in the site’s robots.txt file. Bots like Googlebot prefer to read text and follow links that they find to bank more information, and will follow sitemaps provided by webmasters.
  3. The content the bot discovers and what that content contains is sent back to Google servers, where it is added to a database.
  4. Information in the database is fed to computer programs that keep track of which sites should be crawled, how often bots should visit them, and the number of pages to fetch.
  5. Other programs determine the relevance and value of the content on crawled sites and reward the ones that meet Google’s strict criteria with rankings near the beginning of search results.

Googlebot has an affinity for new sites, changes to existing sites, and dead links. If you’re a new site owner and want your site to be indexed as quickly as possible, you may want to put the spotlight on your site using some of the methods listed below so that the bots looking for fresh reading are drawn to your domain. But there are times when the console refuses to register a new site map. Read this real story with davoraltman and alekandrijevic. Crazy work, but the search engine is also a machine and sometimes it goes wrong. Now everything is OK and both sites are crawled and indexed by Googlе.

Source: https://steemit.com/google/@elpakk/how-long-does-it-take-google-to-index-a-new-site

SEO оптимизация