|
RCP
4.0 Users Questions Menu
|
Approved List - Green button
List
of Categories
-
Explain the use of the Approved List -
"Green button" page
The Approved List - "Green button" page allows
you to control the search engines and spider
robots that are allowed to index your
website/store/server. All standard top 10 search
engines are currently listed on the green page.
This means that the listed useragents from
robots are allowed to read the your site
robots.txt file (wish is the RCP robottxt.out
file in the cgi-bin/robot folder) and the robots
are allowed to index and list your site on there
search engine or linklist page. Feel free to add
or remove useragents from the green page. Keep
in mind that any search engine that is not
listed is not allowed to index your website and
this robot will get banned on any attempt to
index your site.
Top
-
What is a UserAgent?
A useragent is an identification name for a
program or robot. Nearly 98% of all programs
ever made or used on the internet have there
very own unique useragent identification name.
User Agents are standard logged in your website
access.log file identifying the browser and
platform used by your visitors. If you enter the
RCP Approved green button page you will see that
the page will display the current UserAgent of
the browser you are using. Sample:
Scooter/3.3.vscooter is the useragent of the
well known robot that spiders web sites for
Altavista.com
Top
-
Why allow a robot or Search Engine to index
your site?
The answer is quit simple all. Because you will
need the traffic (visitors) that you can get
from search engines. Unless you wish to keep
your site private or hidden. Then you should
remove all useragents. Standard listed are all
the top search engines. These will bring you the
hard needed traffic to your site. Unknown
spiders robots that are not listed are standard
not allowed to index your site. They are blocked
by RCP . Only robots listed on your green page
are allowed to index your site. You can set the
index rules in your RCP robottxt.out file.
Top
-
How to add a Robot to your green approved
list?
Each robot from a search engine has a unique
useragent and comments field. In order to allow
a new robot to index your site/store/server you
must add only the useragent to your green button
page.
Sample:
The UserAgent of a robot is:
SurveyBot/2.3 (Whois Source)
What you see is a useragent and some comments
between the (.....) All you need to add is the
first part wish is: SurveyBot/2.3 This is the
real useragent. Do not include the text behind
it. The (Whois Source) are only comments and not
originally part of the useragent. In order to
add a useragent add only the first part. Add:
SurveyBot/2.3 to the form in the top of the
green page and click Add UserAgent...
Top
|
..
|
|
