Comments on: Sitemap Creator 0.2 beta

By: Terry

Terry — Thu, 27 May 2010 00:42:11 +0000

whether not weather

By: Terry

Terry — Thu, 27 May 2010 00:06:27 +0000

It’s ok I found out why sub folder were not being crawled!
There has to be links to them first - silly me.

By: Terry

Terry — Wed, 26 May 2010 20:03:17 +0000

Hi there, I think the script is great - so far so good. I just cant get it to crawl deeper than the root directory http://www.example.com It will not look into sub directory folders eg http://www.example.com/folder Any ideas anyone?

By: guia rio preto

guia rio preto — Thu, 11 Mar 2010 20:29:23 +0000

So great, I liked so much, thx!!

By: blindados

blindados — Thu, 11 Mar 2010 20:26:35 +0000

Why the crawler did takes my sub-domain?
I just specified the first domain :S

By: Fabricio Sahdo

Fabricio Sahdo — Tue, 09 Mar 2010 12:29:05 +0000

Hi dude, I have a question.

Why after 44 seconds my crawler redirect for page 404 not found?
Have somebody any explication?

thx

By: Luciffere

Luciffere — Fri, 19 Feb 2010 13:30:16 +0000

I want to craw the http://www.transeurotour.ro but:
No Pages were crawled, Please make sure you have set your site domain correctly and you have valid connection to host
The script works in the past. I don't made any modification. What happened?
Thank you.

By: Ceri

Ceri — Sat, 30 Jan 2010 08:18:19 +0000

hi thx for u sharing i need it …

By: Angiolelli

Angiolelli — Tue, 08 Sep 2009 00:45:31 +0000

Hi Karim, thanks a lot for this awesome script. I did install with only little adoptions and works like a charm. Crawled 7395! pages on my site (time limit: 7000, memory: 600) without a hickup. Sitemap successfully published to the different search engines as well.

Only issue right now is the created sitemap only contains 500 pages. Checked the config a couple of times, but found nothing. Am I missing something?

Cheers
Daniel…

By: Harry

Harry — Fri, 28 Aug 2009 18:10:49 +0000

Warning: Division by zero in /var/www/sitemap/.function.inc.php on line 320

Help please

Using lighttpd.

By: Jim

Jim — Sun, 09 Aug 2009 20:03:15 +0000

Every time I attempt to crawl my site with your program I get a “Zero Size Reply". What is this telling me and how do I fix it?

Thanks

By: hotep

hotep — Sun, 26 Jul 2009 19:15:54 +0000

Thank you for the excellent script!

Anybody know the best parameters to include when trying to parse phpBB version 2?

The just script hangs when trying to crawl the bulletin board.

By: wkarim

wkarim — Wed, 20 May 2009 21:10:29 +0000

@yannick
I am afraid the crawler can not understand JavaScript.

By: yannick

yannick — Wed, 20 May 2009 16:54:53 +0000

is there a way to get all url in javascript like document.location='http://…'

By: simon

simon — Wed, 08 Apr 2009 11:46:45 +0000

this is the best script I have used.
Thanks for it.

Could you do a meta,keyword one that would be good?

or does anyone know if one that crawls your site to make them like this script crawls your site.

By: minobu

minobu — Fri, 03 Apr 2009 08:08:56 +0000

$url = str_replace('http:', ”, $url);
$url = str_replace('/', ”, $url);
$url = SMC_SCHEME. $url .'/';

By: minobu

minobu — Fri, 03 Apr 2009 08:06:40 +0000

First: your script is a realy nice work, thanks for that stuff!

I had a similar bug like mauro. I solved it with the following patch. Maybe this helps someone.

.function.inc.php - arround line 288:
————-
/** original **/
$url = preg_replace('#/[^/]*$#','/',$url);

/** replace with this **/
$url = str_replace("http:", “", $url);
$url = str_replace("/", “", $url);
$url = SMC_SCHEME. $url .'/';
————-

And if you are already coding you may add something to line 252
————-
/** original **/
if( !empty($sub) && preg_match('#\.(ico|png|jpg|gif|css|js)(\?.*)?$#i', $sub) ) #excluding graphics
/** after change **/
if( !empty($sub) && preg_match('#\.(ico|png|jpg|gif|css|js|pdf|doc|eps)(\?.*)?$#i', $sub) ) #excluding graphics and other none html documents
————-

@wkarim
A user defined filter setting to rip vars like &uid=999 from the url would be nice in next release.

By: alek

alek — Sat, 28 Mar 2009 18:53:56 +0000

I got questions about this script.

1 - there’s a way to filter some directories or files? (eg: /directoryname/*)

2 - I've put define('SMC_SITE', $_SERVER['dpcgamers.com'] ); but I still got the error saying “No Pages were crawled, Please make sure you have set your site domain correctly and you have valid connection to host".

By: wkarim

wkarim — Wed, 04 Mar 2009 10:40:43 +0000

@mauro
I will investigate this more with next releases
@cdl
you need a program like lynx or cURL to execute the script, it can not be executed from php cli

By: cdl

cdl — Wed, 04 Mar 2009 05:33:34 +0000

The script runs great, no problems at all - Thanks for all the work.

My problem is getting a cron job to run it. My host uses cPanel X. I have tried everything I can think of and either get:
1. No input file specified.
-OR-
2. The complete text of the script.

Here’s the “Command to run" I'm using:
php /home/DOMAIN/public_html/sitemap/sitemap.php?do=createsitemap&secure=16312581c5c30b78630b89d2205e8675

Anyone work this out on cPanel X?

By: mauro

mauro — Wed, 04 Mar 2009 00:47:43 +0000

Hi Karim, thanks a lot for this awesome script.
It required to modify my website because of ./ links will recursive call crawling. I suggest you to remove (trim) /./ urls.
If a url is href="./pagename.html" (that I use for redirect to index.html) don't add domain-base url but link to http://pagename.html
I hope this help other people!
Best regards,
Mauro

By: wkarim

wkarim — Tue, 03 Mar 2009 15:03:33 +0000

@Blackpool
thank you for your comments
1. you will need to add your domain with 'www' on the config file
2. you need to add a redirect header for that URL to a new URL without spaces, and replace old one on all your pages. check google webmaster guidelines for more info

By: Blackpool Shows

Blackpool Shows — Tue, 03 Mar 2009 14:34:10 +0000

Hi, thanks for creating this great sitemap creator. It is the best one I have used. I do have a couple of things, please don't consider them criticisms they are not.
1. I have a htaccess redirect on my site so all domain.com is rewritten to http://www.domain.com . This does cause a problem with the emails. Its not a real problem but I guess I am not the only one who uses mod rewrite, maybe its something to consider in future versions?
2. I have one page that has a space in the page name and that is caught in the Blacklist. I must admit the page name with a space was an error of mine many years ago and I have never got round to fixing it so its my fault with bad page naming.

So thanks very much for a great sitemap creator.

Regards
Pete

By: wkarim

wkarim — Mon, 23 Feb 2009 04:26:08 +0000

@ZDN
thanks for the suggestions, I'll consider them in new releases
@Daniel
can you check the CSV file and let me know how many URLs does it have?

By: Daniel

Daniel — Mon, 23 Feb 2009 03:47:52 +0000

Only issue right now is the created sitemap only contains 500 pages. Checked the config a couple of times, but found nothing. Am I missing something?

Cheers
Daniel

By: ZDN

ZDN — Sat, 21 Feb 2009 13:50:27 +0000

giving SMC a whirl and noticing some problems and have some suggestions…

this is on LAMP with PHP v5.2.8 and a website of ~700 pages

bugs???

define('SMC_USE_BLACKLIST', true);

-if set to false, SMC is unable to crawl at all (using http://domain/sitemap/sitemap.php?do=crawl). this is repeatable 100%

if i change back to 'true', SMC fails to crawl and says “No Pages were crawled, Please make sure you have set your site domain correctly and you have valid connection to host". i'm a bit foggy here, but i think i had to delete the SMC cache to get it to run again.

suggestions…

-ability to edit priority and frequency from browser instead of CSV file, and ability to select and edit multiple files at once.

-ability to make priority and frequency static instead of being changed when re-crawled. ability to set per directory would be good here too.

-ability to set default priority and frequency for a directory, or a directory and all sub directories, so any new or existing files found in these directories during a crawl or by a future crawl will inherit the same priority/freq.

-meaningful names for blacklist directory files or, better yet, new link for sitemap.php that shows what was blacklisted

-default protection for /sitemap/ directory so public can't access

i've been looking for quite a long time for a sitemap script that can auto-ping and auto-update (CRON) and i like what you have done. looks VERY promising!

By: Harold

Harold — Mon, 09 Feb 2009 21:52:24 +0000

I have successfully used Sitemap Creator 0.2 beta for over 2 months without any problems. Just recently Google can no longer read my sitemap and when I personally visited my sitemap it says

“XML Parsing Error: no element found
Location: http://cybercircuits.co.cc/sitemap.php?do=showsitemap&sm=20090209.xml.gz
Line Number 1, Column 1:"

Any ideas?

By: wkarim

wkarim — Thu, 05 Feb 2009 07:38:10 +0000

@Scooter
the cookie should be deleted if browser closed, try clear your cookies if you want to logout

By: Scooter

Scooter — Thu, 05 Feb 2009 07:13:51 +0000

I found no major problems with your script - installing or other! I was wondering if IE7 defeats the timeout in setcookie (smc_pass)?
I have altered the time and yet to see it not show a new login page. I can work it by closing the browser. Do you have a “logout" feature or must I always close the browser?
Thanks for a neat script!!

By: Rod

Rod — Tue, 27 Jan 2009 21:36:41 +0000

i get this error can you help :

No Pages were crawled, Please make sure you have set your site domain correctly and you have valid connection to host

my config is:

'http://www.google.com/webmasters/sitemaps/ping?sitemap=',
'Yahoo' => 'http://search.yahooapis.com/SiteExplorerService/V1/updateNotification?appid=SitemapWriter&url=',
'Live Search' => 'http://webmaster.live.com/ping.aspx?siteMap=',
'Ask.com' => 'http://submissions.ask.com/ping?sitemap=',
'MoreOver' => 'http://api.moreover.com/ping?u=',
);

By: Rod

Rod — Tue, 27 Jan 2009 21:35:15 +0000

having this error massage: No Pages were crawled, Please make sure you have set your site domain correctly and you have valid connection to host

can you advise me my code is as below:
'http://www.google.com/webmasters/sitemaps/ping?sitemap=',
'Yahoo' => 'http://search.yahooapis.com/SiteExplorerService/V1/updateNotification?appid=SitemapWriter&url=',
'Live Search' => 'http://webmaster.live.com/ping.aspx?siteMap=',
'Ask.com' => 'http://submissions.ask.com/ping?sitemap=',
'MoreOver' => 'http://api.moreover.com/ping?u=',
);

By: luciffere

luciffere — Sun, 18 Jan 2009 11:31:38 +0000

Hello again… I want make sitemap with your script for http://www.sauber.ro but the script craw only 13 links… Many links who are linked from first pages are listed with 403 code but all work… Where are the problem?
Thank’s

By: wkarim

wkarim — Sun, 18 Jan 2009 07:33:01 +0000

@Pedro
- I think cron job could run every week
- priorities depends on your link structure, you might need to check your SEO
- You whether install lynx ( yum install lynx ) or you can use curl

By: Pedro

Pedro — Sat, 17 Jan 2009 05:51:38 +0000

I think lynx -dump command dont work in my cronjobs. Any alternatives?

By: Pedro

Pedro — Sat, 17 Jan 2009 05:07:15 +0000

Another doubt.
The 99% priorities of my sitemap are 0.1. I need to change manually the priorities?

Thanks.

By: Pedro

Pedro — Sat, 17 Jan 2009 04:58:42 +0000

Hi, I have installed the script and apparently works very fine (last version). I have Php 4x

I have some doubts.
A. I need to crawl first http://www.mysite.com and after mysite.com?

B. What time interval for cron is the best option?

Thanks

By: wkarim

wkarim — Wed, 14 Jan 2009 09:13:34 +0000

@luciffere
you should submit http://www.luciffere.ro/sitemap.php?do=showsitemap&sm=20081221.xml.gz instead (note that no “sitemap" directory in the URL )
@Peter
You need to edit the CSV before creating your sitemap in case you like to change something

By: Peter

Peter — Tue, 13 Jan 2009 23:56:18 +0000

Think I got it working. Found the 0.2b and some reading.

For editing: is it only the CSV I need to edit?
What about the: data/sites/klassiskabyggvaro.se_sitemaps/20090114

Thanks for a good script and active blog!

By: Peter

Peter — Tue, 13 Jan 2009 22:56:27 +0000

The url sent to searchengines seems to be wrong.
In my case it miss the directory: sitemap_creator_0.2a/
At least the url returned from moreover to my email.
Has all default settings exept SMC_SITE where $_SERVER['HTTP_HOST'] doesn´t work. Replaced with 'klassiskabyggvaror.se'

By: luciffere

luciffere — Tue, 13 Jan 2009 14:41:19 +0000

Hello. I use your scrip, and he generate the sitemep, but google tell me: Unsupported file format
Your Sitemap does not appear to be in a supported format. Please ensure it meets our Sitemap guidelines and resubmit.

Address of my sitemap is: http://www.luciffere.ro/sitemap/sitemap.php?do=showsitemap&sm=20081221.xml.gz

By: wkarim

wkarim — Tue, 13 Jan 2009 08:53:31 +0000

@Peter
Anchor Links should have escaped URI, that means you should replace any spaces on your links with %20

By: Peter

Peter — Tue, 13 Jan 2009 08:32:50 +0000

I´ve been using your SMC a while. Nice work.
I just realized that the SMC cuts an url where a space appears instead of inserting %20. This breaks my links and the sitemap points to a number of pages having mysql-errors from incompleate url.
Is there more than function: cleanurl() to correct this?
Is it about text encoding? I´m using iso-8859-1.

By: Drone

Drone — Sun, 28 Dec 2008 10:07:12 +0000

Your script very cool. But some webmasters need to correct var max_execution_time in php.ini or in htaccess file.

By: wkarim

wkarim — Sun, 21 Dec 2008 17:45:20 +0000

@Luciffere
you can add “http://www.luciffere.ro/sitemap.php?do=showsitemap&sm=sitemap.xml.gz" to Google webmaster tools. For MSN webmaster tools please create a rewrite rule for this URL…it should look like “http://www.luciffere.ro/sitemap.xml.gz"

By: Luciffere

Luciffere — Sun, 21 Dec 2008 17:04:12 +0000

After the script finished the job, he tell me put this link http://www.luciffere.ro/sitemap/sitemap.php?do=createsitemap&secure=4c7a34d25eff9121c49658dbceadf694 on cron job…
My question is if i put this link (http://www.luciffere.ro/sitemap/sitemap.php?do=createsitemap&secure=4c7a34d25eff9121c49658dbceadf694) generated by your script, in my cron job and set mounthly Saturday 1 12:00 AM… the script make sitemap in every mounth in first day at 12:30 AM and ping the google, yahoo… etc… ? I need to login at http://www.google.com/webmasters/tool to insert the link to the sitemap? Now i have at google a manual sitemap http://www.luciffere.ro/sitemap.xml but i deleted. Is necesary insert to google a link manualy?
Thank’s for your work….

By: wkarim

wkarim — Sun, 21 Dec 2008 16:49:48 +0000

@Luciffere
Thanks for the comment
You need to refer to Cpanel documentation for creating cron job, for UNIX crontab you may use Lynx command line browser to run the script.

By: Luciffere

Luciffere — Sun, 21 Dec 2008 16:37:59 +0000

Hello… Is the best free sitemap creator… The cron function haw is stoped or restarted? How can i put a cron job for my site to make another sitemap mounthly? I insert the link generated at end of crow in cron job from cpanel?
Thank’s

By: wkarim

wkarim — Tue, 02 Dec 2008 12:06:23 +0000

@antiwow
Try to enable the debuging mode from the config file

By: antiwow

antiwow — Tue, 02 Dec 2008 01:29:43 +0000

I get a message after crawling,

Crawler Timed out after 200 seconds while crawling http://www. etc

After that, it wont let me generate a sitemap

i looked at config, but couldnt find anything

any ideas?

By: wkarim

wkarim — Wed, 19 Nov 2008 23:17:12 +0000

@Dave
I can not investigate the problem without knowing your domain, you might want to make sure no redirects are made

By: Dave

Dave — Wed, 19 Nov 2008 20:44:38 +0000

This looks great but idea why I get this error and one one page ?

Warning: Division by zero in /myhost/public_html/sitemap/.function.inc.php on line 320

Finished crawling mydomain.com, Crawled 1 links

By: wkarim

wkarim — Fri, 31 Oct 2008 14:38:29 +0000

@Antonimo
The script is not designed to run from command line, alternatively you can use lynx with crontab…the command should look something like
lynx -dump http://example.com/sitemap/sitemap.php?do=createsitemap&hash=blah

By: Antonimo

Antonimo — Fri, 31 Oct 2008 09:17:39 +0000

Hi again,

I am having great difficulty getting the cron to work.

I have other crons that run fine using the command /usr/bin/php -q /home/DOMAIN/public_html/BackUp.php (for example)

Whe I try to run the sitemap creator from cron, (/usr/bin/php -q /home/DOMAIN/public_html/sitemap/sitemap.php?do=createsitemap) I receive an error, “No input file specified"

Is there a special way to do this or can I call the “do" script from another php file?

By: Antonimo

Antonimo — Thu, 23 Oct 2008 08:56:14 +0000

@wkarim
Thanks for the quick response.
Cron set up - looking forward to seeing the results.
Excellent script - kudos

By: wkarim

wkarim — Thu, 23 Oct 2008 08:11:36 +0000

@Antonimo
Yes, all sitemaps are time stamped and the ping is for the newest created one.
if the request does not contain a time stamp then the script will send the most recently created sitemap

By: Antonimo

Antonimo — Thu, 23 Oct 2008 07:58:21 +0000

After crawling the site, the page displays all of the urls etc. At the end of the page is the URL to add to the crontbab.

The page then shows a link to “Create Sitemaps" - The sitemap has a date stamp. Is the XML sitemap created automatically when it is run from the crontab? Does it have a new time stamp?

If the Ping is enabled in the config file, will the correct sitemap be “pinged" to the search engines?

By: wkarim

wkarim — Sat, 11 Oct 2008 01:34:45 +0000

@Jorge
the password is 'demopass'
change it to any password you like in the config file

By: jorge

jorge — Wed, 08 Oct 2008 12:45:16 +0000

When I enter to my page energyenhancement.org/sitemap_creator/sitemap.php they ask me for a loggin.
Where can I find it?

By: wkarim

wkarim — Tue, 23 Sep 2008 20:11:39 +0000

@Stuart
Thre must be something wrong with your connection

By: Stuart

Stuart — Thu, 18 Sep 2008 08:38:46 +0000

Hi,
I created a new file within the sitemap directory called test.php and copied in the above short script, removing the space after the first < in your example. The results are as follows:
Warning: file_get_contents(http://www.tractiontime.co.uk/) [function.file-get-contents]: failed to open stream: Connection refused in /home/sites/tractiontime.co.uk/public_html/sitemap/test.php on line 1

By: wkarim

wkarim — Thu, 18 Sep 2008 06:46:37 +0000

@Stuart
please check your connection from the server running the script to http://www.tractiontime.co.uk, check what you get with < ?php echo file_get_contents( 'http://www.tractiontime.co.uk/'); ?>

By: Stuart

Stuart — Wed, 17 Sep 2008 12:49:50 +0000

I have tried this scrip, unmodified on php4 and i get the following message when i run the script:
WARNING: Connection failed (111) Connection refused
DEBUG: URL “http://www.tractiontime.co.uk/" Blacklisted. Reason : Empty Page

The page i presume it’s refering to is index.php and i know its not empty. Can you shed any light on this please?
MAny thanks

By: Khal

Khal — Mon, 08 Sep 2008 06:15:51 +0000

I installed it on my site and worked fine so far, i created a sitemap and managed to ping all search engines.
Thanks
Khal

By: wkarim

wkarim — Wed, 13 Aug 2008 22:06:00 +0000

@king
looks like you pinged google with a sitemap then deleted it, try ping google again with the right sitemap name or add it manually on google webmaster tools

By: king

king — Wed, 13 Aug 2008 14:40:25 +0000

I'm running php4 and 0.2b and can not get it to run. I have got to the point where everything runs fine, but google and others returns errors. the below one is saying the file is not present i 20080813 and there is no file

/hsphere/local/home/mgruppe/forkortelse.dk/sitemap/data/sites/www.forkortelse.dk_sitemaps/20080813 could not be found IP -: http://whois.domaintools.com/66.249.71.79
Date -: 04:26:44 pm ( Wednesday 13 August 2008 ) Bot -: Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html) Location -: http://www.forkortelse.dk/sitemap.php?do=showsitemap&sm=20080813.xml.gz

if i go to http://www.forkortelse.dk/sitemap.php?do=showsitemap&sm=20080813.xml.gz
it returns that something is wrong with the xml file

file attibutes should be ok
Thanks for a nice script!

BR
Henrik

By: wkarim

wkarim — Wed, 06 Aug 2008 15:51:19 +0000

@mikey, SearkeCom
Please enable debug mode to give me a better idea about what is happening.

By: mikey

mikey — Tue, 05 Aug 2008 20:13:08 +0000

i been checking the log file and the only error in it is this one:

[05-Aug-2008 15:06:56] PHP Fatal error: Maximum execution time of 30 seconds exceeded in /home/xxxxxxx/public_html/sitemap/.function.inc.php on line 295

By: mikey

mikey — Tue, 05 Aug 2008 20:01:25 +0000

Same here i upgrade to the new version and still no luck when i click the Crawl link it displays a number then it does nothing, now if i click any other link it shows that the cache has around 36 elements but nothing else no list nothing, dont know what else to do

By: SearleCom

SearleCom — Thu, 31 Jul 2008 19:34:24 +0000

Installed, crawls fine after logging in via http://thenetradio.co.uk/sitemap/sitemap.php

Once crawl has finished I press Create Sitemaps and get Please crawl thenetradio.co.uk/index.php first.

Sevrer is running PHP 5.2.6

Any ideas?

Mike

By: wkarim

wkarim — Thu, 24 Jul 2008 06:39:46 +0000

@Bo
it should continue crawling the site normally but http://mym8.eu/ will not show on the sitemap as it’s a redirect page

By: Bo

Bo — Thu, 24 Jul 2008 03:45:18 +0000

hi,
i get this error:
WARNING: Page http://mym8.eu/ is redirecting to home.php
DEBUG: URL “http://mym8.eu/" Blacklisted. Reason : Empty Page

can you please advice?
thank you in advance

By: wkarim

wkarim — Thu, 17 Jul 2008 00:04:05 +0000

@flobster
yes, you can use regular expressions to disable those URLs, examples are included on the config file.
ex : define('SMC_DISABLED_DIRS', '\?a=page:2′ );

By: flobster

flobster — Wed, 16 Jul 2008 23:30:19 +0000

nice script! just one question: i have several urls ending with “?a=page:2″ which i want to exclude from being crawled. Will this be possible using SMC_DISABLED_DIRS?

By: bispak

bispak — Sat, 12 Jul 2008 10:10:39 +0000

Thanks wkarim, works well using this version.

I use it on my site tukarinfobispak.com

anytime search engine robot read my sitemap, email sent to my mailbox inform about their activity.

By: Ferran

Ferran — Wed, 18 Jun 2008 09:06:12 +0000

@wkarim
I set to false SMC_GSS and the result is the same…
When I look at CSV or the table of sitemap.php show the links… It may be the codification of the files? I try in my sites in UTF and works perfectly, but when i try in this site that’s in ISO, the xml is corrupt… I don't understand it, the functions are correct and config too…

By: wkarim

wkarim — Wed, 18 Jun 2008 07:19:40 +0000

@Ferran
can you change constant SMC_GSS to false to disable GSS and try again?

By: links for 2008-06-18 « Free Open Source Directory

links for 2008-06-18 « Free Open Source Directory — Wed, 18 Jun 2008 00:35:00 +0000

[...] Sitemap Creator 0.2 beta :: GadElKareem (tags: Sitemap Creator 0.2 beta :: GadElKareem) [...]

By: Ferran

Ferran — Tue, 17 Jun 2008 07:43:07 +0000

http://cordigual.com/__sitemap/sitemap.php?do=showsitemap&sm=sitemap.xml.gz

By: wkarim

wkarim — Sat, 14 Jun 2008 03:13:26 +0000

@Ferran
can you give me a like to your sitemap xml file?

By: Ferran

Ferran — Fri, 13 Jun 2008 12:54:56 +0000

I use your Sitemap Creator for a site and all going OK, show a table with the URL’s and no error messages. But when I click “Create Sitemaps" the XML is mal formed and incorrect. Any suggestion?
The Site is in ISO-8859-1 and Sitemap in UTF-8…

By: wkarim

wkarim — Wed, 28 May 2008 21:14:22 +0000

@abyzn
Can you enable the debug mode from the configuration file and give me the results?

By: abyzn

abyzn — Tue, 27 May 2008 14:22:28 +0000

where is the right setting for site

By: abyzn

abyzn — Tue, 27 May 2008 14:21:46 +0000

hi
help me
i see this error:

No Pages were crawled, Please make sure you have set your site domain correctly and you have valid connection to host

By: wkarim

wkarim — Tue, 20 May 2008 23:44:22 +0000

@gtnman
- touch() is not related to Plesk, you need to have permissions to modify files in that directory, I can not find any relation between touch() function and utime. make sure you 'chmod 777′ data directory.
- robots.txt are not generated every time the sitemap is created, you only need to modify it once.

By: gtnman

gtnman — Mon, 19 May 2008 16:13:00 +0000

Another note, I tested this on my ubuntu box and it worked fine which utime did exist on.

By: gtnman

gtnman — Mon, 19 May 2008 16:09:08 +0000

Interesting note. I have tested this script on two VPS servers both running the latest version of Plesk on two different web hosts. Seems that the unix command utime (which touch()) uses is not available in Plesk. Is touch vital to the script or will is_writable do the same thing? (I made this change, and the robots.txt generated perfectly.)
Does the cronjob re-generate robots.txt or is this something that the user must do.

By: wkarim

wkarim — Fri, 16 May 2008 23:09:15 +0000

@gtnman
Please use “Add reference to robots.txt" to show you the default sitemap URL, remember to chmod 666 robots.txt .
it should look something like
http://www.greatertalent.com/sitemap.php?do=showsitemap&sm=sitemap.xml.gz

By: gtnman

gtnman — Fri, 16 May 2008 22:57:03 +0000

What is the URL you are supposed to submit to google for the sitemap?

By: Sitemap Creator 0.2 beta Released « jared.brodsky

Sitemap Creator 0.2 beta Released « jared.brodsky — Fri, 16 May 2008 16:11:06 +0000

[...] You need a sitemap! Lucky for you GadElKareem created a little script written in PHP called Sitemap Creator. So what does it do? Upon logging into the sitemap admin section and clicking “Crawl [...]