Content State

Not many web master take the time to use a robots.txt file for their website. For search engine spiders that use the robots.txt to see what directories to search through, the robots.txt file can be very helpful in keeping the spiders indexing your actual pages and not other information, such as looking through your stats!

The robots.txt file is useful in keeping your spiders from accessing parts folders and files in your hosting directory that are totally unrelated to your actual web site content. You can choose to have the spiders kept out of areas that contain programming that search engines cannot parse properly, and to keep them out of the web stats portion of your site.

Many search engines cannot view dynamically generated content properly, mainly created by programming languages, such as PHP or ASP. If you have an online store programmed in your hosting account, and it is in a seperate directory, you would be wise to block out the spiders from this directory so it only finds relevant information.

The robots.txt file should be placed in the directory where your main files for your hosting are located. So you would be advised to create a blank text file, and save it as robots.txt, and then upload it to your web hosting to the same directory your index.htm file is located.

Here is examples of the use of the robots.txt file:

To block out a directory in a robots.txt file, such as a subdirectory for your online store called /store/ you would do the following:
Disallow: /store/

Another example to block out your stats directory:
Disallow: /stats/

You may also want to disallow individual files that you do not want searched by the search engines. For example you dont want search.php to be parsed by the Search Engines. To do this you type in the following on its own line:

Disallow: /search.php

Following the rules outlined and creating the robots.txt file, you will keep search engine spiders out of unwanted files and directories, and letting them go through the important files to see what your web site is all about!

Michael Kralj is owner of Emenki Web Solutions and Domains at Retail. Emenki Web Solutions are web site designers and programmers based in Hamilton, Ontario, providing businesses with an informative and strategic approach to establishing an online presence on the web.

Please visit Emenki Web Solutions & Web Design in Hamilton, Ontario on the web http://www.emenki.com

Please visit Domains at Retail - Cheap Domain Name Registration on the web: http://www.domainsatretail.com

New Online Advertising Today

Online Marketing nowadays consists of a long number of undertakings going from SEO over PPC to SMM. See where you’ll get the most profitable means to help your online marketing budget.

Search Engine Optimization/SEO/Search Marketing

By optimizing your website for Google/Bing/Yahoo your traffic will rise with all the new traffic from the search engines. Search Engine Optimization/SEO/Search Marketing is a extended time endeavour which includes tasks like link building, keyword research and code optimisation. Most SEO Agencies nowadays employ specialists/experts in each area.

Nowadays the most essential and most time intense SEO job is link progressing. Correctly done link construction will make wonders for your search engine positions, so if link analysis uncovers want of incoming links, then link construction is the first antecedence. Substance still matters and enough select content/copy is essential too. Website coding in ways that either blur search engines or misinforms them are common, particularly for CMS, so arrest for indexing roadblocks on your website before you start. We can help you get more traffic from search engines via our SEO expertise .

PPC/Google Adwords/Paid Search

In most nations it’s enough to campaign on the leading PPC networks like Google Adwords or Microsoft Advertising. Some states require local knowledge of wide utilized local PPC networks. We can help you find the right PPC/Paid search choices for your commercial enterprise. Paid Advertisement is also possible on social media places like Facebook, and MySpace shows Google Adwords.

Social Marketing

SMM on Facebook, Twitter, MySpace and YouTube is a must in any successful on-line selling campaign. The power of today’s media has changed the balance and today it’s the buyers who are in power. Anybody can make a blog, a Facebook or Twitter account and start commenting on you, your company or your wares, so presence on social media is necessary both to mind and to answer. We can help you build a social media strategy to beef up your business and branding in social media.