Robot Control Pro - Official User Guide - FAQ



RCP 4.0 Users Questions Menu

Search Engines     List of Categories


Page 1
Page 2




  • Basic Search engine info for Webmasters

    It has no use to built a website and not paying attention to search engines and or the process of how search engines work and how to use them to get traffic visitors to your site. Unless if you do not wish to receive visitors on your website you do not need search engines. But you will still need tool and info to keep them of your site or else you might still get listed on search engines without knowing so.

    Search engines are the only tool for people world wide to find information and websites based on keywords of there interest. IN order to join the search engine process and to make sure your website can be found as well in search engines using keywords related to your website. You need to pay attention to certain things that are required by search engines in order to get your site listed in there keyword database. <

    This is called a Meta-Tag. Meta-Tag is a couple of lines that provide search engines quick details about your site. Details. what is your site about, who made this site, What keywords should people use to find your website. You can use one and the same Meta-Tag code for each html page in your site or give each page a different one or only give your index.html page a Meta-Tag. Without a Meta-Tag the change is big that its will become nearly impossible to find your website in a search engines. Or it shows up on search results page 100 or higher. Once your HTML pages contain a good meta-tag that describes your website. You need to tell the search engines please come index my website so my site gets listed in your search engine and people can find me. There are many free tools programs that allow you to submit your site to the top 10 search engines. It has no use to spend lots of money on site claiming they can submit your site to millions of different search engines. Just make sure your site gets listed on the top 10 engines. Google, altavista, yahoo etc...

    Required meta-tag lines for a search engine are:

    < META NAME="Title" CONTENT="my site title " >
    < META NAME="Description" CONTENT="my site description" >
    < META NAME="Keywords" CONTENT="keywords, keywords, keywords, keywords" >

    Top


  • Optimizing Your HTML Images " alt " tag Attributes

    Did you know that images in your page can help improve your search engine listings too? Each image HTML tag on your page can include a keyword phrase or two that relates to the image. Many search engines evaluate the alternative text of images. If you want to improve your search engine ranking, you should add keywords to your image alternative texts.This text will also show up & help those that may have their images turned off when visiting your site. This does not work for all engines, but it certainly does not hurt so we recommend you give it a try where you can. Many search engines will pick up the image tag words as real keywords.

    Sample of image HTML image tag without alt keywords:

    < IMG SRC="RobotControlPro.gif" width="10" height="10" > Search engies will ignore each image.

    Here is a good sample that uses the Alt keywords: < IMG SRC="RobotControlPro.gif" width="10" height="10" alt="Robot Control Pro! The Ultimate Website Protection Tool" >

    You can add the "alt" attribute to any image on your page.Tag limits: We do not recommend using more than a brief sentence or two to describe an image.Tag tips: Be sure to use the keyword phrases that you also used in the copy of your page, title tag, meta description, and other tags. Do not try to cram a bunch of keywords into the "alt" attribute. We recommend using no more than 2-3 per image. Describe the image - do not just list keywords.The "alt" attribute is also a good place for misspellings and plural keyword phrases that you may not have used elsewhere.

    Top


  • Why submit your website(s) to search engines

    If you don't no one will be able to find your webiste. Unless you do not wish to be found you really should prepare your site for the search engine requirements. Add a Meta-Tag to your site and submit your site URL to the top 10 search engines. In return world wide users will be able to find your website using keywords in the search engine. Once a match of the keyword is found in your website Meta-Tag people will be able to visit your site by clicking the link in the search results.

    Top


  • How do i know if a search engine has indexed my website

    With Robot Control Pro installed you can turn on the option to receive a detailed email as soon a search engine has started to index your website. This allows you to monitor the search engines behavior. After you have submitted your URL to a search engine it usually takes 3 to 5 days before the search engine robot will visit your site to make a index of all files. A month after your site has been indexed you should be able to see a growing line in the amount of visitors on your website. Without RCP its hard to tell if your site has been indexed or not. If you have access to your website access log file then you could check the access.log in a plain text editor and search for any known search engine robot useragent. But this is not a easy job. RCP also allows you to set index rules for each robot and you decide wich robot may or may not index your website. RCP means full control on all robots and spiders visiting your site.

    Top


  • Which search engine is " The Biggest " ?

    They'd all like you to believe they're either "the biggest" or, if they can't possibly claim that, "the best." Google currently claims to index over 3.3 billion pages, while Alltheweb.com (one of Yahoo‚s many search properties) claims to index over 3.1 billion.   Search engines which demand that site owners pay to have their sites indexed, such as AskJeeves, index fewer pages. Google is at the moment the most used search engine world wide.

    Top


  • How Long Does it Take to Get Listed for Free?

    Here's the length of time it currently takes to get listed at each of the major search engines once you have submitted your web page for free. Search engines also offer paid options to be listed real quick. Get listed in about 48 hours for a price around: $25/$50. Search engines also offer pay per click keywords you can bid on. This means you can bid a price on a keyword matching your site. You then only pay per clicked search engine result. If you really want to get the best out of a search engine it is well worth to try the paid traffic options of the well known search engines.

    MSN.com - Up to 2 months
    Google.com - Up to 4 weeks
    AltaVista.com - Up to 1 week
    Alltheweb.com - Up to 2 weeks
    Excite.com - Up to 6 weeks
    Northern Light - Up to 4 weeks
    AOL.com - Up to 2 months
    HotBot.com - Up to 2 months
    iWon.com - Up to 2 months


    Top


  • Do not SPAM the search engines with your site!

    There are several things, considered "spamming", that you can do to try to get your page listed higher on a search engine results page. Basically, you should never try to trick a search engine in any way, or you risk being blacklisted by them. Since the majority of your traffic will come from search engines the risk far outweighs the benefits in the long run. Below is a list of the more common things we recommend that you never do when trying to achieve better listings.

    Things Not To do:

    1) Do anything to trick the search engines into listing your site better. The search engines will likely view it as spam and penalize you.

    2) List your keywords anywhere except in your keywords meta tag. By "list" we mean something like:  keyword 1, keyword 2, keyword 3, keyword 4, etc. There are very few legitimate reasons that a list of keywords would actually appear on a web page or within the page's HTML code and the search engines know this. While you may have a legitimate reason for doing this we would recommend avoiding it so that you do not risk being penalized by the search engines.

    3) Use the same color text on your page as the page's background color. This has often been used to keyword stuff a web page. Search engines can detect this and view it as spam.

    4) Use multiple instances of the same tag. For example, using more than one title tag. Search engines can detect this and view it as spam.

    5) Submit identical pages. For example, do not duplicate a page of your site, give the copies different file names, and submit each one. Search engines can detect this and view it as spam.

    6) Submit the same page to any engine more than once within 24hrs. Use any keywords in your keywords meta tag that do not directly relate to the content of your page.

    Top


  • Use Keyword in your url's and folder names

    This is a very easy but effective trick. Using a keyword in your URL or folder or file name will help boost your relevancy on most search engines. URL's Such as a URL of http://www.myhome.com/listings.htm doesn't say too much, but a URL of http://www.myhome.com/toasters.htm includes the keyword "toaster" in any searches. That is quality web ranking design advice. Its also a tricky way of working in ranking, design, and advice to reinforce my keywords.

    For example: this sites base directory used to be loaded on our own ISP in the SHOWCASE directory. I couldn't figure out why my Ag and Farming Search Engine was getting so many hits on "Case" Tractors and the keyword "Showcase". Turns out that, "showcase" in my URL was pulling in traffic for the Case tractors, and other people where searching literally for "Showcase" design. Use keywords related to your site as names for folders on your website.

    Top


  • Use high value keyword "phrases"

    Do use high value keyword "phrases" in addition to your keywords in your Meta tag. Look for something unusual, don't just copy the competition, but do target the competition. Look at your referrals and see what combinations of words are being used together and work them into a phrase near the beginning of your keywords.

    For example: < meta name="keywords" content="Robot control pro, Website protection" > Will return more hits from search engines then: < meta name="keywords" content="Robot, control, pro, Website, protection" >

    Top


  • Robots.txt / rcp robottxt.out Tutorial

    Search engines will look in your root domain for a special file named "robots.txt" (http://www.mydomain.com/robots.txt). This file tells the robot (spider) which files it may spider (index). This system is called, The Robots Exclusion Standard. Websites using Robot Control Pro. Your robots.txt file is the robottxt.out file in your robot folder (works the same as a robots.txt file).

    The format for the robots.txt file is special. It consists of records. Each record consists of two fields : a User-agent line and one or more Disallow: lines. The format is: ":"

    The robots.txt file should be created in Unix line ender mode! Most good text editors will have a Unix mode or your FTP client *should* do the conversion for you. Do not attempt to use an HTML editor that does not specifically have a text mode to create a robots.txt file.

    RCP users do not need to include User Agents specifies in the robots.txt file. RCP will take care for you wish robots may and may not index your site using the RCP admin area Approved and denied list.

    The User-agent line For example: User-agent: *
    The wildcard character "*" to specify all robots: User-agent: * RCP will then check which are or are not allowed to index your site.

    Disallow:The second part of a record consists of Disallow: directive lines. These lines specify files and/or directories. For example, the following line instructs spiders that it can not download email.htm: Disallow: email.htm. You may also specify directories: Disallow: /cgi-bin/ Which would block spiders from your cgi-bin directory. There is a wildcard nature to the Disallow directive. The standard dictates that /bob would disallow /bob.html and /bob/indes.html (both the file bob and files in the bob directory will not be indexed).

    If you leave the Disallow line blank, it indicates that ALL files may be retrieved. At least one disallow line must be present for each User-agent directive to be correct. A completely empty Robots.txt file is the same as if it were not present.

    White Space & Comments Any line in the robots.txt that begins with # is considered to be a comment only. The standard allows for comments at the end of directive lines, but this is really bad style: Disallow: bob #comment
    Some spider will not interpret the above line correctly and instead will attempt to disallow "bob#comment." The moral is to place comments on lines by themselves. White space at the beginning of a line is allowed, but not recommended. For example:

    # My comments go here (stay out my cgi)

    Disallow: /cgi-bin/

    The following allows all robots (RCP will check which robots are allowed. There for in the robottxt.out it should allow all robots. ) To index all files because the wildcard "*" specifies all robots.

    User-agent: *
    Disallow:

    he next one bars all robots from the cgi-bin and images directories:

    User-agent: *
    Disallow: /cgi-bin/
    Disallow: /images/


    This one bans only googlebot from getting at your cheese.htm file. Google is still allowed to index all other files. Any other robot will also be allowed to index the cheese.htm :

    User-agent: googlebot
    Disallow: cheese.htm


    Top


Page 1 Page 2


..



Robot Control Pro - Copyright Webcomposing.com © 1997-2003 - All rights reserved.
Robot Control is a trademark of Webcomposing.com Corporation, registered in the U.S. and other countries.