Though I wonder about your html_compress function. Is it necessary to use so much regex ? I have a function that does the nearly the same :

function compress($string){
$string = str_replace("\n", “", $string);
$string = str_replace("\t", “", $string);
$string = wordwrap($string, 990, “\n");

return $string;
}

The thing that is cleary missing, is a way to preserve the code and pre tags. So my function is not complete, but yours seems overkill to me.

There has to be a correct middle.

/hsphere/local/home/mgruppe/forkortelse.dk/sitemap/data/sites/www.forkortelse.dk_sitemaps/20080813 could not be found IP -: http://whois.domaintools.com/66.249.71.79
Date -: 04:26:44 pm ( Wednesday 13 August 2008 ) Bot -: Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html) Location -: http://www.forkortelse.dk/sitemap.php?do=showsitemap&sm=20080813.xml.gz

if i go to http://www.forkortelse.dk/sitemap.php?do=showsitemap&sm=20080813.xml.gz
it returns that something is wrong with the xml file

file attibutes should be ok
Thanks for a nice script!

BR
Henrik

[05-Aug-2008 15:06:56] PHP Fatal error: Maximum execution time of 30 seconds exceeded in /home/xxxxxxx/public_html/sitemap/.function.inc.php on line 295

Once crawl has finished I press Create Sitemaps and get Please crawl thenetradio.co.uk/index.php first.

Sevrer is running PHP 5.2.6

Any ideas?

Mike

Can you please help ?

can you please advice?
thank you in advance

Greetings,

Damir

I use it on my site tukarinfobispak.com

anytime search engine robot read my sitemap, email sent to my mailbox inform about their activity.

sitemap20080711.xml.gz Created successfully

Where i can see sitemap20080711.xml.gz ?

when i'll submit sitemap to google as per SMC advised i dont know what i can submit since i cant find xml file under root or sitemap folder.

Please more advise and sorry to make you busy with my questions. Hope you dont mind.

and then at the end mention about the url to add to crontab or schedule tasks.

Still, when i click “Create Sitemaps" i got answer: “Please crawl tukarinfobispak.com first".

I use PHP Version 5.2.5

No Pages were crawled, Please make sure you have set your site domain correctly and you have valid connection to host

I have curl disabled and www set to true.

line 217:
$ch = curl_init($url);

changed to:
foreach ($options as $myoption => $myvalue) {
curl_setopt ($ch, $myoption, $myvalue);
}
–
line 233:
if ( isset($header['content_type']) && stripos($header['content_type'], 'text') === false ){

changed to:
if ( isset($header['content_type']) && strpos(strtolower($header['content_type']), 'text') === false ){
–

i have 3 domains and want them all crawled seperate and they seem to be working but what do i need to tell google my site map is? sitemap.php?

if we get this working properly i will help you promote it my placing a link on my sites!

can you tell me if the
/*internal settings*/
define('SMC_VERSION', '0.2a');
define('SMC_DATA_CACHE', SMC_DATA.'cache/');
define('SMC_DATA_SITES', SMC_DATA.’sites/');
define('SMC_DATA_ERRORS', SMC_DATA.'errors/');
define('SMC_DATA_SITEMAPS', SMC_DATA_SITES.SMC_SITE.'_sitemaps/');
$pings = array (
'Google' => 'http://www.google.com/webmasters/sitemaps/ping?sitemap=',
'Yahoo' => 'http://search.yahooapis.com/SiteExplorerService/V1/updateNotification?appid=SitemapWriter&url=',
'Live Search' => 'http://webmaster.live.com/ping.aspx?siteMap=',
'Ask.com' => 'http://submissions.ask.com/ping?sitemap=',
'MoreOver' => 'http://api.moreover.com/ping?u=',
);
does any of this have to be edited and will this script automatacly ping the search engines
because google askes for sitemap.xml in your root directory and the script does not save one there that i can see please explain how this works!! the scrips is awsome also in the admin section it would be nice if the admin could edit or add to the robots.txt file i have set up a cron task to run every hour it seems to work but does it save a new site map in the cron task or just update the existing one i have an auction site so it will be changing all the time.

I CAN NOT SAY THAK YOU ENOUGH!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!

WARNING: Connection failed (0)
WARNING: Connection failed (0)
NOTICE: Document type is application/xml for URL http://mysite.com/clients/announcements.xml
WARNING: Connection failed (0)
NOTICE: Document type is application/zip for URL http://mysite.com/themes/dreamland.zip
NOTICE: Document type is application/zip for URL http://mysite.com/themes/Green-Glow_000.zip
NOTICE: Document type is application/zip for URL http://mysite.com/themes/mountain-dawn.zip
NOTICE: Document type is application/zip for URL http://mysite.com/themes/yalla.zip

It went through and indexed everything fine. Works like a charm, thanks webmaster!

http://bestplaces2be.com/sitemap/sitemap.php

and use this in config.inc.php
define('SMC_SITE', $_SERVER['HTTP_HOST']);

if ( isset($header['content_type']) && strpos(strtolower($header[’content_type’]), 'text') === false ){
_error("Document type is {$header['content_type']} for URL {$url}“);

after this it stops I think

1. Yes, there are two sitemap.php files, and you are supposed to use the one inside the sitemap folder
to extract directly on your server do
tar xzf sitemap_creator.tar.gz

2. same as previous

Now I get:

Warning: tempnam() [function.tempnam]: open_basedir restriction in effect. File(/tmp) is not within the allowed path(s): (/var/www/virtual/anysite.com/:/usr/share/php/:/tmp/) in /var/www/virtual/anysite.com/htdocs/sitemap/.function.inc.php on line 87

Warning: file_exists() [function.file-exists]: open_basedir restriction in effect. File(/smc_cookies) is not within the allowed path(s): (/var/www/virtual/anysite.com/:/usr/share/php/:/tmp/) in /var/www/virtual/anysite.com/htdocs/sitemap/.function.inc.php on line 143

Also, I have two questions:

1. I see a folder with sitemaps. Is there supposed to be a seperate sitemaps.php for the root and then a seperate folder called sitemap.

2. The script keeps stating that my “data" folder may not exist or might not be writable. However, it does exist and is writable.

cache and errors empty, result the same

I had to remove the brackets to post.

I have downloaded the most recent script and still get the same error.

When I try any function, it goes back to sign-in page.

I did this also.

No Pages were crawled, Please make sure you have set your site domain correctly and you have valid connection to host

I've index.php in the root folder which redirects to http://www.bestplaces2be.com/md/index.php

index.php

any idee what goes wrong here?

But, considering $html as the web page content, i need to rewrite all my scripts…
How can I cache the page without putting the content to $html var?

Any idea?
Thanks!

i just solve the matter by uploading the config file without any change BUT now, my website can't be crawled …

here’s the error message:

No Pages were crawled, Please make sure you have set your site domain correctly and you have valid connection to host

but idon't know how to set the domain …

Please help

Warning: curl_setopt_array() [function.curl-setopt-array]: CURLOPT_FOLLOWLOCATION cannot be activated when in safe_mode or an open_basedir is set in /home/www/pfff/www/sitemap/.function.inc.php on line 218
ERROR6: Couldn't resolve host 'wwwwebynuxnet' for URL http://wwwwebynuxnet/

No Pages were crawled, Please make sure you have set your site domain correctly and you have valid connection to host

why the “." are note between www, webynux and net ?