Easing GoogleBots life - Kiesler phpWebsite consulting

Easing GoogleBots life

updated by rck, 2006-05-02

Googlebot the well-known crawler. A while ago, a new beta program of Google started. Google Sitemaps. There, Webmasters can upload sitemaps of their sites. Thus, pages not even linked properly can be made accessible to Googlebot easier.

Uploading happens with a well-defined XML format, which is specified on the Google Sitemaps homepage. I made a little php program to generate such sitemaps automatically out of the installation of a phpWebSite. You can even specify multiple phpWebSites on the same server and let the program generate a site map for each.

1 | 2 | 3

Google Sitemap
First, you need to register with [url=http://www.google.com/webmasters/sitemaps/login]Google Sitemap[/url]. Then, you can claim the sites you've specified there by uploading a special file made available through your Google Sitemap instance. As soon as you've claimed your web directory, you can upload you gzipped sitemap file and that's it. If the site changes, you can upload the file again. Those steps can all be automated, even the notification of new content.

Google Sitemap

First, you need to register with [url=http://www.google.com/webmasters/sitemaps/login]Google Sitemap[/url]. Then, you can claim the sites you've specified there by uploading a special file made available through your Google Sitemap instance.

As soon as you've claimed your web directory, you can upload you gzipped sitemap file and that's it. If the site changes, you can upload the file again. Those steps can all be automated, even the notification of new content.

Installation
First, download sitemap_0.1.0.tar.gz(1622). After untar/gzipping it, you will notice two directories inside a folder called "tools". "inc" contains the configuration, specify your sites here. "sitemap" contains the actual script. It is called "index.php", so calling this directory directly calls the script as well. Unpack this directory right into your installation directory of phpwebsite. If your installation is in /home/yourname/pws/, put all the directories in /home/yourname/pws/tools/. Next, change "all_sites.php" in the directory inc. I've included a sample-file, it shows you the needed parameter. All of your sites are stored in a "$sites" array, which is pretty generic. It contains a path, caption and the boolean super_short for every site. [b]Path[/b] tells the sitemap script, where your phpWebSite installation is. It will take the database configuration from there as well as the web-path. [b]caption[/b] is, how you refer to your site later on when calling the script on the command-line. And [b]super_short[/b] is special. It means "use a special form of the mod_rewrite hack". Usually, you'd want to leave this false.

Installation

First, download sitemap_0.1.0.tar.gz(1622). After untar/gzipping it, you will notice two directories inside a folder called "tools". "inc" contains the configuration, specify your sites here. "sitemap" contains the actual script. It is called "index.php", so calling this directory directly calls the script as well.

Unpack this directory right into your installation directory of phpwebsite. If your installation is in /home/yourname/pws/, put all the directories in /home/yourname/pws/tools/.

Next, change "all_sites.php" in the directory inc. I've included a sample-file, it shows you the needed parameter. All of your sites are stored in a "$sites" array, which is pretty generic. It contains a path, caption and the boolean super_short for every site.

[b]Path[/b] tells the sitemap script, where your phpWebSite installation is. It will take the database configuration from there as well as the web-path. [b]caption[/b] is, how you refer to your site later on when calling the script on the command-line. And [b]super_short[/b] is special. It means "use a special form of the mod_rewrite hack". Usually, you'd want to leave this false.

1 | 2 | 3

Google Sitemap
Running the Script
Poll

Comments - Make a comment

Please go ahead and share your thoughts about this with us. Thank you!

Nice Script

Posted on 2006-12-01 01:05:11 By Anonymous

Just wanted to say nice script.. Im installing a copy at url=http://slimshady.us]http://slimshady.us/url]

[Reply ]

IIS installation

Posted on 2007-02-13 22:59:42 By trf000_[7]

Will this script run on IIS? And if so, how do I make it recurring?

[Reply ]

No Subject

Posted on 2009-01-22 23:41:39 By Anonymous

Has anybody gotten this to run under PHP5? I had it working great in PHP4 but then I migrated and now it doesn't produce anything. It looks like the call to DB::connect() is a problem of some sort.

[Reply ]

All Articles

2008, 2007, 2006, 2005, 2004