Thinking about starting an SEO (search engine optimization) campaign to get those business opportunity leads to your website? You will often hear the term “web crawling”. If you are new, you might be wondering just what the heck does it mean. Even if you have been doing SEO for quite some time, many do not know precisely what this term represents.

So..Just what exactly is “web crawling”?

First of all, generally speaking, search engines (like Google for instance) primarily perform several tasks. They search the internet for important words, index those words, and then allow us to look for either those specific words or combinations of those words.

I really can not get into all of the specifics of SEO in one short writing but let’s take Google for instance. They have a series of hundreds and thousands of your typical computers which are typically connected to each other. An analogy would be like links in a chain. Each of these computers has a process or a program on them that sends out queries to the many servers on the internet. In fact, if you hear the word “robot” being used, it is because the process running on these computers is called “Googlebot”. A server is a much more powerful computer than yours and mine that can sustain many more functions. Computers are connected to these servers through what are called IP addresses.

If you are still with me, “Googlebot” is constantly sending out queries. There is a file on your websites’ computer called “spider.txt” that is used to obtain the content and the main keywords and keyword phrases of the pages on your website .. Once the pages are received, Google then indexes them.

That said … Just where does this process all begin?

Google goes to the most popular sites. They query those sites, grab all of the words and index them. They then grab all of the embedded links. They then follow those links and grab whatever is on the other end of each specific link. It goes on and on and on. It is in this way that it takes the form of a spider web. That is where the term web crawling became popular.

Again, with that said, it is in this process that reveals why your keywords should be strategically placed on your website. Also why you should have plenty of them while not saturating your site.

There has to be some order in what I wrote about above. Google needs to produce useful results if either you or I am are searching for something in particular. In other words, if you are searching for the keywords “business opportunity” and that is what you are looking for, you do not want to get results from pages who might have used the term once from someone writing a resume or whatever.

The keywords you type in have to bring up the most favorable responses or websites that you might be looking for.

To make search results more useful and accurate, the keywords for each site are given a “weight” or number ranking based on the number of times that they used on a website as well as title tags, meta tags, or links. Increasing values are given to those keyword and keyword phrases the higher ones are up on your page.

So, now you know all about the slang terms “robot,” “spiders,” and “web crawling.”

 

Source by Jim Eberle