Comments for GadElKareem

Comment on Compressing your HTML, CSS and Javascript using simple PHP Code by Thomas

Thomas — Fri, 29 Apr 2011 10:38:42 +0000

I think you’ll get a lot of Spaghetti code due to this optimization, although it looks very fine.
I gonna try it on my test-base.
Thank you!

Comment on jQuery plugin : monnaTip 0.1 by Sean

Sean — Thu, 14 Apr 2011 20:54:32 +0000

For some reason the following line is creating a small black circle at the top left of my document …how do i fix this?

tip = $(”).appendTo(document.body);

Comment on Allow bots / spiders / crawlers into your private vbulletin forums by Bot Developer

Bot Developer — Thu, 24 Mar 2011 17:18:37 +0000

This is great, I was looking for it for about a month, thanks a lot.

Comment on jQuery plugin : monnaTip 0.1 by Alex

Alex — Wed, 02 Mar 2011 13:29:34 +0000

Good job. jQuery UI tooltip suxx.

Comment on jQuery plugin : monnaTip 0.1 by ayeo

ayeo — Wed, 02 Mar 2011 11:23:43 +0000

I’ve found alternative solution using standard tooltip pligin
[code]
$(document).ajaxComplete(function()
{
$('.tooltippable).tooltip();
}
[/code]

Hope it helps. Your plugin is hardcoded, there is no option to change behavior using custom options.

Comment on Sitemap Creator 0.2 beta by peps

peps — Thu, 17 Feb 2011 21:24:30 +0000

still figuring out how.. anyone?
i get this notice:
NOTICE: Document type is application/pdf for URL http://example.com/test.pdf

Comment on Sitemap Creator 0.2a: Create sitemaps 09 valid for Google, Yahoo, MSN, Ask.com and moreover sitemaps by Doug

Doug — Thu, 17 Feb 2011 20:26:37 +0000

Sorry, I discovered that it is correct. I did not have the first sitemap.php in the correct directory.

Does it submit the correct type of sitemap (xml or text)?

Comment on Sitemap Creator 0.2a: Create sitemaps 09 valid for Google, Yahoo, MSN, Ask.com and moreover sitemaps by Doug

Doug — Thu, 17 Feb 2011 13:46:01 +0000

The url placed in my robot.txt file gets a 404 error when I place it in the browser address. Here is the url: http://www.wereviewitall.com/sitemap.php?do=showsitemap&sm=sitemap.xml.gz

Is this correct?

Comment on Sitemap Creator 0.2 beta by peps

peps — Tue, 01 Feb 2011 00:14:30 +0000

anyone?

Comment on Sitemap Creator 0.2 beta by peps

peps — Mon, 24 Jan 2011 11:21:54 +0000

Thanks for this great script!! Works great!

How do i add .pdf & .docx to the allowed file types so that they will be added to the sitemap?

Thanks!

Comment on Sitemap Creator 0.2a: Create sitemaps 09 valid for Google, Yahoo, MSN, Ask.com and moreover sitemaps by Tonkin

Tonkin — Tue, 18 Jan 2011 10:34:20 +0000

Wkarim,

Your script works excellently on my site. You are the best.

I have a question: I got a 404 error on a very very long URL. The URL also has “,” and “+”. How can I overcome this error. It’s very important that this URL gets indexed. I will have many more like it so I don’t want to manually edit every time. Please advise. Here is the URL that had the 404 error:

http://cupodona.com/search/word/Valentines,+Valentine's,+jewelry,+diamond,+chocolate,+flower,+her,+him,+love,+candy,+heart,+ring,+fragrance,+wine,+lingerie,+stone,+perfume/1.html

Thanks in advance for your advice.

Comment on jQuery plugin : monnaTip 0.1 by Vincent

Vincent — Sun, 12 Dec 2010 10:47:47 +0000

Great plugin, I was looking for a possibility to have a “live” tooltip from ajax loaded content and it did it.

Thank you very much!

Comment on Sitemap Creator 0.2a: Create sitemaps 09 valid for Google, Yahoo, MSN, Ask.com and moreover sitemaps by auto giełda

auto giełda — Sat, 11 Dec 2010 01:01:40 +0000

Nice work, thanks!

Comment on jQuery plugin : monnaTip 0.1 by Thiago

Thiago — Sun, 21 Nov 2010 20:10:48 +0000

Great work, thx shady!!
It’s save my job!

Comment on Sort Unix processes on ps by highest memory usage by Frank

Frank — Thu, 16 Sep 2010 12:39:00 +0000

excellent!
Thanks,

Comment on Sitemap Creator 0.2a: Create sitemaps 09 valid for Google, Yahoo, MSN, Ask.com and moreover sitemaps by iam

iam — Tue, 27 Jul 2010 17:03:58 +0000

My wp have coment like this:
couldn’t resolve host ‘search.yahooapis.com’

Comment on Sitemap Creator 0.2 beta by Terry

Terry — Thu, 27 May 2010 00:42:11 +0000

whether not weather

Comment on Sitemap Creator 0.2 beta by Terry

Terry — Thu, 27 May 2010 00:06:27 +0000

It’s ok I found out why sub folder were not being crawled!
There has to be links to them first – silly me.

Comment on Sitemap Creator 0.2 beta by Terry

Terry — Wed, 26 May 2010 20:03:17 +0000

Hi there, I think the script is great – so far so good. I just cant get it to crawl deeper than the root directory http://www.example.com It will not look into sub directory folders eg http://www.example.com/folder Any ideas anyone?

Comment on Sort Unix processes on ps by highest memory usage by Sascha Ziemann

Sascha Ziemann — Tue, 11 May 2010 14:36:46 +0000

This will keep the headline in the first line:
ps -eo pmem,pcpu,rss,vsize,args | { head -1 ; sort -k 1 -r -n ; } | less

Comment on jQuery plugin : monnaTip 0.1 by wkarim

wkarim — Tue, 11 May 2010 07:26:57 +0000

@campana
what’s different about MIT license ?

Comment on jQuery plugin : monnaTip 0.1 by campana

campana — Tue, 11 May 2010 07:10:33 +0000

please release it under mit
plz plz plz

Comment on jQuery plugin : monnaTip 0.1 by Emad

Emad — Wed, 05 May 2010 10:03:49 +0000

Great work!

keep it up

Comment on Fixing Flickr FAlbum rewrite rules, thumbnails, javascripts and more … by Ricky

Ricky — Wed, 14 Apr 2010 23:45:39 +0000

Thank you! The 404 errors were driving me nuts. Your step-by-step still works, even nearly 2.5 years later.

Comment on jQuery plugin : monnaTip 0.1 by Anonymous

Anonymous — Sun, 11 Apr 2010 01:29:24 +0000

ilove

Comment on Sitemap Creator 0.2 beta by guia rio preto

guia rio preto — Thu, 11 Mar 2010 20:29:23 +0000

So great, I liked so much, thx!!

Comment on Sitemap Creator 0.2 beta by blindados

blindados — Thu, 11 Mar 2010 20:26:35 +0000

Why the crawler did takes my sub-domain?
I just specified the first domain :S

Comment on Sitemap Creator 0.2 beta by Fabricio Sahdo

Fabricio Sahdo — Tue, 09 Mar 2010 12:29:05 +0000

Hi dude, I have a question.

Why after 44 seconds my crawler redirect for page 404 not found?
Have somebody any explication?

thx

Comment on jQuery plugin : monnaTip 0.1 by wkarim

wkarim — Fri, 26 Feb 2010 17:58:38 +0000

@mody
to be considered!

Comment on jQuery plugin : monnaTip 0.1 by Mahmoud M. Abdel-Fattah

Mahmoud M. Abdel-Fattah — Fri, 26 Feb 2010 17:35:25 +0000

what about fade effect ?

Comment on jQuery plugin : monnaTip 0.1 by wkarim

wkarim — Thu, 25 Feb 2010 08:14:37 +0000

thx shady!!

Comment on jQuery plugin : monnaTip 0.1 by Shady

Shady — Thu, 25 Feb 2010 08:08:30 +0000

Good work!

It’s a good idea to make use of .live() function, it’d help lots of people ..

keep up the good work bro

Comment on Sitemap Creator 0.2 beta by Luciffere

Luciffere — Fri, 19 Feb 2010 13:30:16 +0000

I want to craw the http://www.transeurotour.ro but:
No Pages were crawled, Please make sure you have set your site domain correctly and you have valid connection to host
The script works in the past. I don’t made any modification. What happened?
Thank you.

Comment on Sitemap Creator 0.2 beta by Ceri

Ceri — Sat, 30 Jan 2010 08:18:19 +0000

hi thx for u sharing i need it …

Comment on Using iptables to block ips that spam or attack your server by Pedro Pablo

Pedro Pablo — Tue, 19 Jan 2010 19:54:51 +0000

Sorry for the mistake, you should replace CORREO by MAIL

Comment on Using iptables to block ips that spam or attack your server by Pedro Pablo

Pedro Pablo — Tue, 19 Jan 2010 19:53:35 +0000

It can be made a little change in order to improve the performance. I only want to check the packet that are addressed to port 25.

If you don’t want logging, just comment out the line.

iptables -N MAIL
iptables -N MAILLOG

iptables -A INPUT -i eth0 -j MAIL ! -s 127.0.0.1 -p tcp –dport 25

iptables -A MAILLOG -j LOG
iptables -A MAILLOG -j DROP

and then
iptables -A CORREO -i eth0 -j MAILLOG -s 188.54.0.0/15

Now, please is there any “badip” file to share.

Thanks

Comment on Compressing your HTML, CSS and Javascript using simple PHP Code by atans

atans — Mon, 04 Jan 2010 01:38:18 +0000

multi-line HTML comments are not work

Comment on Convert html to vbcode and post to vbulletin by Muhammad

Muhammad — Sun, 27 Dec 2009 06:07:06 +0000

nice sharing

Comment on Sitemap Creator 0.2a: Create sitemaps 09 valid for Google, Yahoo, MSN, Ask.com and moreover sitemaps by coolboy

coolboy — Wed, 16 Dec 2009 22:32:43 +0000

Can you tell where to download a newest version..?

Comment on Dynamic Content Caching using Lighty + mod_magnet + lua by wesnur

wesnur — Tue, 15 Dec 2009 09:58:11 +0000

It’s really very interesting. There is no doubt that dynamic caching is the ultimate solution for the issues like Scalability, Reliability and Performance. State of the growth unfolds many opportunities but is also holds challenges as a result of change. Not only does performance affect your operational cost, it also reflects directly on end-users experience. I would like to share another very informative read with you people. Benefits of using NCache Dynamic Clustering Capabilities not only describes the benefits of cache but it also highlights the some other important aspects like different topologies InProc Mode, OutProc Mode etc.

Comment on Allow bots / spiders / crawlers into your private vbulletin forums by Muhammad

Muhammad — Sat, 05 Dec 2009 14:28:41 +0000

Thanks for sharing.
I am looking for

Comment on Compressing your HTML, CSS and Javascript using simple PHP Code by georgi

georgi — Thu, 05 Nov 2009 21:37:25 +0000

It’a a good idea to pack all files into one
file for keeping HTTP Requests as low as possible
(good if you have 5-6 js/css in your page)

Comment on Sitemap Creator 0.2a: Create sitemaps 09 valid for Google, Yahoo, MSN, Ask.com and moreover sitemaps by Depoastur

Depoastur — Sat, 31 Oct 2009 12:40:30 +0000

Thanks for it.
I have download it

Comment on Sitemap Creator 0.1 : Create Sitemaps 0.9 valid for Google, Yahoo! and MSN Sitemaps by H@ZEM

H@ZEM — Sun, 18 Oct 2009 20:45:00 +0000

thanks very much for this program

Comment on Using iptables to block ips that spam or attack your server by xOxolatito

xOxolatito — Tue, 29 Sep 2009 19:43:32 +0000

awesome!! =)

Comment on Adding FAlbum URLs to XML-Sitemap WordPress Plugin by tamedcats

tamedcats — Sun, 27 Sep 2009 03:57:51 +0000

Hi,

I tried to add image but I don’t know how to do this
Can anyone be kind to tell me how?

thanks a lot

Comment on Tamer game by daline

daline — Tue, 22 Sep 2009 04:17:24 +0000

heyyy

Comment on Sitemap Creator 0.2 beta by Angiolelli

Angiolelli — Tue, 08 Sep 2009 00:45:31 +0000

Hi Karim, thanks a lot for this awesome script. I did install with only little adoptions and works like a charm. Crawled 7395! pages on my site (time limit: 7000, memory: 600) without a hickup. Sitemap successfully published to the different search engines as well.

Only issue right now is the created sitemap only contains 500 pages. Checked the config a couple of times, but found nothing. Am I missing something?

Cheers
Daniel…

Comment on Sitemap Creator 0.2 beta by Harry

Harry — Fri, 28 Aug 2009 18:10:49 +0000

Warning: Division by zero in /var/www/sitemap/.function.inc.php on line 320

Help please

Using lighttpd.

Comment on Dynamic Content Caching using Lighty + mod_magnet + lua by Lighttpd + mod_magnet on CentOS (64 bit) | BlueScripts

Lighttpd + mod_magnet on CentOS (64 bit) | BlueScripts — Tue, 18 Aug 2009 15:20:28 +0000

[...] to: http://gadelkareem.com/2007/09/17/dynamic-content-caching-using-lighty-mod_magnet-lua/ && [...]

Comment on Sitemap Creator 0.2 beta by Jim

Jim — Sun, 09 Aug 2009 20:03:15 +0000

Every time I attempt to crawl my site with your program I get a “Zero Size Reply”. What is this telling me and how do I fix it?

Thanks

Comment on Sitemap Creator 0.2 beta by hotep

hotep — Sun, 26 Jul 2009 19:15:54 +0000

Thank you for the excellent script!

Anybody know the best parameters to include when trying to parse phpBB version 2?

The just script hangs when trying to crawl the bulletin board.

Comment on Sort Unix processes on ps by highest memory usage by yonit

yonit — Wed, 08 Jul 2009 11:16:14 +0000

Hi, this one helped me out,
apperantly pslist wasnt installed on the machine in question.

Comment on GoodBye IE6..please don’t come back! by Assistua Admin

Assistua Admin — Tue, 23 Jun 2009 07:53:30 +0000

In a perfect world Micro$oft didn’t exist

Comment on Elvis Presley – The Original Elvis Presley Collection 50CD by Anonymous

Anonymous — Tue, 16 Jun 2009 23:54:26 +0000

hi,i wounder if you could tell me colour is the certificate you i just brought one but i think the certificate is a copy

Comment on Dynamic Content Caching using Lighty + mod_magnet + lua by Vic

Vic — Mon, 08 Jun 2009 07:21:18 +0000

Your solution might work if cache files aren’t constantly being updated or used, but what about open file pointers? Unless I’m missing something, with large files and open file pointer conflicts, you could be generating a lot of lost+found files only retrievable by a disk repair when clearing the cache that way, because lighttpd or the fastcgi processes may have them open for reading/writing. So best case you avoid any conflicts, worst case you interrupt files being served and lose files in the filesystem.

Comment on Sitemap Creator 0.2 beta by wkarim

wkarim — Wed, 20 May 2009 21:10:29 +0000

@yannick
I am afraid the crawler can not understand JavaScript.

Comment on Sitemap Creator 0.2 beta by yannick

yannick — Wed, 20 May 2009 16:54:53 +0000

is there a way to get all url in javascript like document.location=’http://…’

Comment on Configure sendmail to accept emails only if “from”, “to” or specific field matches by John M

John M — Tue, 19 May 2009 15:38:53 +0000

Can we edit sendmail.mc file to do like that ?
If I edit manually, when I rebuild sendmail.cf from sendmail.mc I need to edit sendmail.cf again.

Thank you.

John M

Comment on Fixing Flickr FAlbum rewrite rules, thumbnails, javascripts and more … by FAlbumin Rewrite Rule -ongelma | Valontuoja

FAlbumin Rewrite Rule -ongelma | Valontuoja — Wed, 29 Apr 2009 10:06:27 +0000

[...] esiin omassa käytössäni. Ongelmani koskivat lähinnä toimimattomia rewrite ruleja. Tässä GadElKareem.com kirjoittama artikkeli ratkaisemaan Falbumin Rewrite -ongelma. Omalla kohdalla tämä auttoi. 29. Huhtikuu 2009 ( 1 [...]

Comment on Sitemap Creator 0.2 beta by simon

simon — Wed, 08 Apr 2009 11:46:45 +0000

this is the best script I have used.
Thanks for it.

Could you do a meta,keyword one that would be good?

or does anyone know if one that crawls your site to make them like this script crawls your site.

Comment on Sitemap Creator 0.2 beta by minobu

minobu — Fri, 03 Apr 2009 08:08:56 +0000

$url = str_replace(‘http:’, ”, $url);
$url = str_replace(‘/’, ”, $url);
$url = SMC_SCHEME. $url .’/';

Comment on Sitemap Creator 0.2 beta by minobu

minobu — Fri, 03 Apr 2009 08:06:40 +0000

First: your script is a realy nice work, thanks for that stuff!

I had a similar bug like mauro. I solved it with the following patch. Maybe this helps someone.

.function.inc.php – arround line 288:
————-
/** original **/
$url = preg_replace(‘#/[^/]*$#’,'/’,$url);

/** replace with this **/
$url = str_replace(“http:”, “”, $url);
$url = str_replace(“/”, “”, $url);
$url = SMC_SCHEME. $url .’/';
————-

And if you are already coding you may add something to line 252
————-
/** original **/
if( !empty($sub) && preg_match(‘#\.(ico|png|jpg|gif|css|js)(\?.*)?$#i’, $sub) ) #excluding graphics
/** after change **/
if( !empty($sub) && preg_match(‘#\.(ico|png|jpg|gif|css|js|pdf|doc|eps)(\?.*)?$#i’, $sub) ) #excluding graphics and other none html documents
————-

@wkarim
A user defined filter setting to rip vars like &uid=999 from the url would be nice in next release.

Comment on Sitemap Creator 0.2 beta by alek

alek — Sat, 28 Mar 2009 18:53:56 +0000

I got questions about this script.

1 – there’s a way to filter some directories or files? (eg: /directoryname/*)

2 – I’ve put define(‘SMC_SITE’, $_SERVER['dpcgamers.com'] ); but I still got the error saying “No Pages were crawled, Please make sure you have set your site domain correctly and you have valid connection to host”.

Comment on Sitemap Creator 0.2a: Create sitemaps 09 valid for Google, Yahoo, MSN, Ask.com and moreover sitemaps by Michael

Michael — Sat, 28 Mar 2009 10:58:43 +0000

The site map looks good on the screen using url below but Google WebMaster tools shows errors and says wrong file type.
ttp://www.reddotdeals.com/sitemap.php?do=showsitemap&sm=20090328.xml.gz

I actually copied the code this generates and saved it as sitemap.xml and this works perfectly.

I would suggest the script should create ‘sitemap.xml’ either on demand or using a chron

respect for the work on this script

Michael

Comment on Sitemap Creator 0.2a: Create sitemaps 09 valid for Google, Yahoo, MSN, Ask.com and moreover sitemaps by Antony

Antony — Sun, 22 Mar 2009 20:27:55 +0000

Thank you for the script. It worked ok, I think. But now I have two doubts:
1- The program automaticaly pings to google and yahoo and the others?
2- Where is the xml file created so we can put it in google webmaster tools?

Thank you

Comment on Sitemap Creator 0.2 beta by wkarim

wkarim — Wed, 04 Mar 2009 10:40:43 +0000

@mauro
I will investigate this more with next releases
@cdl
you need a program like lynx or cURL to execute the script, it can not be executed from php cli

Comment on Sitemap Creator 0.2 beta by cdl

cdl — Wed, 04 Mar 2009 05:33:34 +0000

The script runs great, no problems at all – Thanks for all the work.

My problem is getting a cron job to run it. My host uses cPanel X. I have tried everything I can think of and either get:
1. No input file specified.
-OR-
2. The complete text of the script.

Here’s the “Command to run” I’m using:
php /home/DOMAIN/public_html/sitemap/sitemap.php?do=createsitemap&secure=16312581c5c30b78630b89d2205e8675

Anyone work this out on cPanel X?

Comment on Sitemap Creator 0.2 beta by mauro

mauro — Wed, 04 Mar 2009 00:47:43 +0000

Hi Karim, thanks a lot for this awesome script.
It required to modify my website because of ./ links will recursive call crawling. I suggest you to remove (trim) /./ urls.
If a url is href=”./pagename.html” (that I use for redirect to index.html) don’t add domain-base url but link to http://pagename.html
I hope this help other people!
Best regards,
Mauro

Comment on Sitemap Creator 0.2 beta by wkarim

wkarim — Tue, 03 Mar 2009 15:03:33 +0000

@Blackpool
thank you for your comments
1. you will need to add your domain with ‘www’ on the config file
2. you need to add a redirect header for that URL to a new URL without spaces, and replace old one on all your pages. check google webmaster guidelines for more info

Comment on Sitemap Creator 0.2 beta by Blackpool Shows

Blackpool Shows — Tue, 03 Mar 2009 14:34:10 +0000

Hi, thanks for creating this great sitemap creator. It is the best one I have used. I do have a couple of things, please don’t consider them criticisms they are not.
1. I have a htaccess redirect on my site so all domain.com is rewritten to http://www.domain.com . This does cause a problem with the emails. Its not a real problem but I guess I am not the only one who uses mod rewrite, maybe its something to consider in future versions?
2. I have one page that has a space in the page name and that is caught in the Blacklist. I must admit the page name with a space was an error of mine many years ago and I have never got round to fixing it so its my fault with bad page naming.

So thanks very much for a great sitemap creator.

Regards
Pete

Comment on Configure sendmail to accept emails only if “from”, “to” or specific field matches by ray

ray — Sat, 28 Feb 2009 12:18:35 +0000

working for me..thx

Comment on Sitemap Creator 0.2 beta by wkarim

wkarim — Mon, 23 Feb 2009 04:26:08 +0000

@ZDN
thanks for the suggestions, I’ll consider them in new releases
@Daniel
can you check the CSV file and let me know how many URLs does it have?

Comment on Sitemap Creator 0.2 beta by Daniel

Daniel — Mon, 23 Feb 2009 03:47:52 +0000

Only issue right now is the created sitemap only contains 500 pages. Checked the config a couple of times, but found nothing. Am I missing something?

Cheers
Daniel

Comment on Sitemap Creator 0.2 beta by ZDN

ZDN — Sat, 21 Feb 2009 13:50:27 +0000

giving SMC a whirl and noticing some problems and have some suggestions…

this is on LAMP with PHP v5.2.8 and a website of ~700 pages

bugs???

define(‘SMC_USE_BLACKLIST’, true);

-if set to false, SMC is unable to crawl at all (using http://domain/sitemap/sitemap.php?do=crawl). this is repeatable 100%

if i change back to ‘true’, SMC fails to crawl and says “No Pages were crawled, Please make sure you have set your site domain correctly and you have valid connection to host”. i’m a bit foggy here, but i think i had to delete the SMC cache to get it to run again.

suggestions…

-ability to edit priority and frequency from browser instead of CSV file, and ability to select and edit multiple files at once.

-ability to make priority and frequency static instead of being changed when re-crawled. ability to set per directory would be good here too.

-ability to set default priority and frequency for a directory, or a directory and all sub directories, so any new or existing files found in these directories during a crawl or by a future crawl will inherit the same priority/freq.

-meaningful names for blacklist directory files or, better yet, new link for sitemap.php that shows what was blacklisted

-default protection for /sitemap/ directory so public can’t access

i’ve been looking for quite a long time for a sitemap script that can auto-ping and auto-update (CRON) and i like what you have done. looks VERY promising!

Comment on Sitemap Creator 0.2 beta by Harold

Harold — Mon, 09 Feb 2009 21:52:24 +0000

I have successfully used Sitemap Creator 0.2 beta for over 2 months without any problems. Just recently Google can no longer read my sitemap and when I personally visited my sitemap it says

“XML Parsing Error: no element found
Location: http://cybercircuits.co.cc/sitemap.php?do=showsitemap&sm=20090209.xml.gz
Line Number 1, Column 1:”

Any ideas?

Comment on Sitemap Creator 0.2 beta by wkarim

wkarim — Thu, 05 Feb 2009 07:38:10 +0000

@Scooter
the cookie should be deleted if browser closed, try clear your cookies if you want to logout

Comment on Sitemap Creator 0.2 beta by Scooter

Scooter — Thu, 05 Feb 2009 07:13:51 +0000

I found no major problems with your script – installing or other! I was wondering if IE7 defeats the timeout in setcookie (smc_pass)?
I have altered the time and yet to see it not show a new login page. I can work it by closing the browser. Do you have a “logout” feature or must I always close the browser?
Thanks for a neat script!!

Comment on Integrate Theme Switcher by Adrian Silva

Adrian Silva — Sun, 01 Feb 2009 11:30:08 +0000

Nice trick.

Still working on WordPress 2.7.

Comment on Sitemap Creator 0.2a: Create sitemaps 09 valid for Google, Yahoo, MSN, Ask.com and moreover sitemaps by Shopping cart

Shopping cart — Sun, 01 Feb 2009 07:28:42 +0000

Creat i needed this for my site

Comment on Sitemap Creator 0.2 beta by Rod

Rod — Tue, 27 Jan 2009 21:36:41 +0000

i get this error can you help :

No Pages were crawled, Please make sure you have set your site domain correctly and you have valid connection to host

my config is:

‘http://www.google.com/webmasters/sitemaps/ping?sitemap=',
‘Yahoo’ => ‘http://search.yahooapis.com/SiteExplorerService/V1/updateNotification?appid=SitemapWriter&url=',
‘Live Search’ => ‘http://webmaster.live.com/ping.aspx?siteMap=',
‘Ask.com’ => ‘http://submissions.ask.com/ping?sitemap=',
‘MoreOver’ => ‘http://api.moreover.com/ping?u=',
);

Comment on Sitemap Creator 0.2 beta by Rod

Rod — Tue, 27 Jan 2009 21:35:15 +0000

having this error massage: No Pages were crawled, Please make sure you have set your site domain correctly and you have valid connection to host

can you advise me my code is as below:
‘http://www.google.com/webmasters/sitemaps/ping?sitemap=',
‘Yahoo’ => ‘http://search.yahooapis.com/SiteExplorerService/V1/updateNotification?appid=SitemapWriter&url=',
‘Live Search’ => ‘http://webmaster.live.com/ping.aspx?siteMap=',
‘Ask.com’ => ‘http://submissions.ask.com/ping?sitemap=',
‘MoreOver’ => ‘http://api.moreover.com/ping?u=',
);

Comment on Sitemap Creator 0.2a: Create sitemaps 09 valid for Google, Yahoo, MSN, Ask.com and moreover sitemaps by Sitemap Creator- create sitemap for google,yahoo,msn and ask.com | SAYFARZ

Sitemap Creator- create sitemap for google,yahoo,msn and ask.com | SAYFARZ — Tue, 27 Jan 2009 08:37:30 +0000

[...] Homepage Download Share [...]

Comment on Sitemap Creator 0.2 beta by luciffere

luciffere — Sun, 18 Jan 2009 11:31:38 +0000

Hello again… I want make sitemap with your script for http://www.sauber.ro but the script craw only 13 links… Many links who are linked from first pages are listed with 403 code but all work… Where are the problem?
Thank’s

Comment on Sitemap Creator 0.2 beta by wkarim

wkarim — Sun, 18 Jan 2009 07:33:01 +0000

@Pedro
- I think cron job could run every week
- priorities depends on your link structure, you might need to check your SEO
- You whether install lynx ( yum install lynx ) or you can use curl

Comment on Sitemap Creator 0.2 beta by Pedro

Pedro — Sat, 17 Jan 2009 05:51:38 +0000

I think lynx -dump command dont work in my cronjobs. Any alternatives?

Comment on Sitemap Creator 0.2 beta by Pedro

Pedro — Sat, 17 Jan 2009 05:07:15 +0000

Another doubt.
The 99% priorities of my sitemap are 0.1. I need to change manually the priorities?

Thanks.

Comment on Sitemap Creator 0.2 beta by Pedro

Pedro — Sat, 17 Jan 2009 04:58:42 +0000

Hi, I have installed the script and apparently works very fine (last version). I have Php 4x

I have some doubts.
A. I need to crawl first http://www.mysite.com and after mysite.com?

B. What time interval for cron is the best option?

Thanks

Comment on Sitemap Creator 0.2 beta by wkarim

wkarim — Wed, 14 Jan 2009 09:13:34 +0000

@luciffere
you should submit http://www.luciffere.ro/sitemap.php?do=showsitemap&sm=20081221.xml.gz instead (note that no “sitemap” directory in the URL )
@Peter
You need to edit the CSV before creating your sitemap in case you like to change something

Comment on Sitemap Creator 0.2 beta by Peter

Peter — Tue, 13 Jan 2009 23:56:18 +0000

Think I got it working. Found the 0.2b and some reading.

For editing: is it only the CSV I need to edit?
What about the: data/sites/klassiskabyggvaro.se_sitemaps/20090114

Thanks for a good script and active blog!

Comment on Sitemap Creator 0.2 beta by Peter

Peter — Tue, 13 Jan 2009 22:56:27 +0000

The url sent to searchengines seems to be wrong.
In my case it miss the directory: sitemap_creator_0.2a/
At least the url returned from moreover to my email.
Has all default settings exept SMC_SITE where $_SERVER['HTTP_HOST'] doesn´t work. Replaced with ‘klassiskabyggvaror.se’

Comment on Sitemap Creator 0.2 beta by luciffere

luciffere — Tue, 13 Jan 2009 14:41:19 +0000

Hello. I use your scrip, and he generate the sitemep, but google tell me: Unsupported file format
Your Sitemap does not appear to be in a supported format. Please ensure it meets our Sitemap guidelines and resubmit.

Address of my sitemap is: http://www.luciffere.ro/sitemap/sitemap.php?do=showsitemap&sm=20081221.xml.gz

Comment on Sitemap Creator 0.2 beta by wkarim

wkarim — Tue, 13 Jan 2009 08:53:31 +0000

@Peter Anchor Links should have escaped URI, that means you should replace any spaces on your links with %20

Comment on Sitemap Creator 0.2 beta by Peter

Peter — Tue, 13 Jan 2009 08:32:50 +0000

I´ve been using your SMC a while. Nice work.
I just realized that the SMC cuts an url where a space appears instead of inserting %20. This breaks my links and the sitemap points to a number of pages having mysql-errors from incompleate url.
Is there more than function: cleanurl() to correct this?
Is it about text encoding? I´m using iso-8859-1.

Comment on Sitemap Creator 0.2 beta by Drone

Drone — Sun, 28 Dec 2008 10:07:12 +0000

Your script very cool. But some webmasters need to correct var max_execution_time in php.ini or in htaccess file.

Comment on Sitemap Creator 0.2 beta by wkarim

wkarim — Sun, 21 Dec 2008 17:45:20 +0000

@Luciffere
you can add “http://www.luciffere.ro/sitemap.php?do=showsitemap&sm=sitemap.xml.gz” to Google webmaster tools. For MSN webmaster tools please create a rewrite rule for this URL…it should look like “http://www.luciffere.ro/sitemap.xml.gz”

Comment on Sitemap Creator 0.2 beta by Luciffere

Luciffere — Sun, 21 Dec 2008 17:04:12 +0000

After the script finished the job, he tell me put this link http://www.luciffere.ro/sitemap/sitemap.php?do=createsitemap&secure=4c7a34d25eff9121c49658dbceadf694 on cron job…
My question is if i put this link (http://www.luciffere.ro/sitemap/sitemap.php?do=createsitemap&secure=4c7a34d25eff9121c49658dbceadf694) generated by your script, in my cron job and set mounthly Saturday 1 12:00 AM… the script make sitemap in every mounth in first day at 12:30 AM and ping the google, yahoo… etc… ? I need to login at http://www.google.com/webmasters/tool to insert the link to the sitemap? Now i have at google a manual sitemap http://www.luciffere.ro/sitemap.xml but i deleted. Is necesary insert to google a link manualy?
Thank’s for your work….

Comment on Sitemap Creator 0.2 beta by wkarim

wkarim — Sun, 21 Dec 2008 16:49:48 +0000

@Luciffere
Thanks for the comment
You need to refer to Cpanel documentation for creating cron job, for UNIX crontab you may use Lynx command line browser to run the script.

Comment on Sitemap Creator 0.2 beta by Luciffere

Luciffere — Sun, 21 Dec 2008 16:37:59 +0000

Hello… Is the best free sitemap creator… The cron function haw is stoped or restarted? How can i put a cron job for my site to make another sitemap mounthly? I insert the link generated at end of crow in cron job from cpanel?
Thank’s

Comment on Sitemap Creator 0.2a: Create sitemaps 09 valid for Google, Yahoo, MSN, Ask.com and moreover sitemaps by Stupid

Stupid — Sat, 13 Dec 2008 22:50:16 +0000

Great script.It works perfect

Comment on Sitemap Creator 0.2 beta by wkarim

wkarim — Tue, 02 Dec 2008 12:06:23 +0000

@antiwow
Try to enable the debuging mode from the config file

Comment on Sitemap Creator 0.2 beta by antiwow

antiwow — Tue, 02 Dec 2008 01:29:43 +0000

I get a message after crawling,

Crawler Timed out after 200 seconds while crawling www. etc

After that, it wont let me generate a sitemap

i looked at config, but couldnt find anything

any ideas?

Comment on Sitemap Creator 0.2a: Create sitemaps 09 valid for Google, Yahoo, MSN, Ask.com and moreover sitemaps by wkarim

wkarim — Sat, 29 Nov 2008 13:26:01 +0000

@DoubleClic
you might need to urlencode() your URL
http://www.example.com/she’s.htm should be http://www.example.com/she%27s.htm

Comment on Sitemap Creator 0.2a: Create sitemaps 09 valid for Google, Yahoo, MSN, Ask.com and moreover sitemaps by DoubleClic

DoubleClic — Sat, 29 Nov 2008 12:03:11 +0000

I have an error with url with quote.
Example :
http://www.site.com/she's.htm

The script return only the first part :
http://www.site.com/she

Thank’s for your script.

Comment on Sitemap Creator 0.2a: Create sitemaps 09 valid for Google, Yahoo, MSN, Ask.com and moreover sitemaps by wkarim

wkarim — Sat, 22 Nov 2008 08:53:40 +0000

@prakash
it should be at http://example.com/sitemap.php?do=showsitemap&sm=sitemap.xml.gz
you might use rewrite rules to create more simple URL
make sure you use the new version at http://gadelkareem.com/2008/05/15/sitemap-creator-02-beta/

Comment on Sitemap Creator 0.2a: Create sitemaps 09 valid for Google, Yahoo, MSN, Ask.com and moreover sitemaps by Prakash Subba

Prakash Subba — Sat, 22 Nov 2008 05:14:36 +0000

It works well on my site but how to added sitemap at google webmaster tool? which file should be added?

Comment on Sitemap Creator 0.2 beta by wkarim

wkarim — Wed, 19 Nov 2008 23:17:12 +0000

@Dave
I can not investigate the problem without knowing your domain, you might want to make sure no redirects are made

Comment on Sitemap Creator 0.2 beta by Dave

Dave — Wed, 19 Nov 2008 20:44:38 +0000

This looks great but idea why I get this error and one one page ?

Warning: Division by zero in /myhost/public_html/sitemap/.function.inc.php on line 320

Finished crawling mydomain.com, Crawled 1 links

Comment on Sitemap Creator 0.2 beta by wkarim

wkarim — Fri, 31 Oct 2008 14:38:29 +0000

@Antonimo
The script is not designed to run from command line, alternatively you can use lynx with crontab…the command should look something like
lynx -dump http://example.com/sitemap/sitemap.php?do=createsitemap&hash=blah

Comment on Sitemap Creator 0.2 beta by Antonimo

Antonimo — Fri, 31 Oct 2008 09:17:39 +0000

Hi again,

I am having great difficulty getting the cron to work.

I have other crons that run fine using the command /usr/bin/php -q /home/DOMAIN/public_html/BackUp.php (for example)

Whe I try to run the sitemap creator from cron, (/usr/bin/php -q /home/DOMAIN/public_html/sitemap/sitemap.php?do=createsitemap) I receive an error, “No input file specified”

Is there a special way to do this or can I call the “do” script from another php file?

Comment on Sitemap Creator 0.2 beta by Antonimo

Antonimo — Thu, 23 Oct 2008 08:56:14 +0000

@wkarim
Thanks for the quick response.
Cron set up – looking forward to seeing the results.
Excellent script – kudos

Comment on Sitemap Creator 0.2 beta by wkarim

wkarim — Thu, 23 Oct 2008 08:11:36 +0000

@Antonimo
Yes, all sitemaps are time stamped and the ping is for the newest created one.
if the request does not contain a time stamp then the script will send the most recently created sitemap

Comment on Sitemap Creator 0.2 beta by Antonimo

Antonimo — Thu, 23 Oct 2008 07:58:21 +0000

After crawling the site, the page displays all of the urls etc. At the end of the page is the URL to add to the crontbab.

The page then shows a link to “Create Sitemaps” – The sitemap has a date stamp. Is the XML sitemap created automatically when it is run from the crontab? Does it have a new time stamp?

If the Ping is enabled in the config file, will the correct sitemap be “pinged” to the search engines?

Comment on Sitemap Creator 0.2 beta by wkarim

wkarim — Sat, 11 Oct 2008 01:34:45 +0000

@Jorge
the password is ‘demopass’
change it to any password you like in the config file

Comment on Sitemap Creator 0.2 beta by jorge

jorge — Wed, 08 Oct 2008 12:45:16 +0000

When I enter to my page energyenhancement.org/sitemap_creator/sitemap.php they ask me for a loggin.
Where can I find it?

Comment on Sitemap Creator 0.2a: Create sitemaps 09 valid for Google, Yahoo, MSN, Ask.com and moreover sitemaps by evgenij2007

evgenij2007 — Wed, 24 Sep 2008 19:24:02 +0000

Sitemap Creator the best

Comment on Sitemap Creator 0.2 beta by wkarim

wkarim — Tue, 23 Sep 2008 20:11:39 +0000

@Stuart
Thre must be something wrong with your connection

Comment on Fixing Flickr FAlbum rewrite rules, thumbnails, javascripts and more … by svensonsan

svensonsan — Sat, 20 Sep 2008 15:59:46 +0000

Thanks a lot.
Really.

First falbum always produces 404 header responses – but after i’ve done all this everything is fine.

Again, thanks a lot.

Comment on Sitemap Creator 0.2 beta by Stuart

Stuart — Thu, 18 Sep 2008 08:38:46 +0000

Hi,
I created a new file within the sitemap directory called test.php and copied in the above short script, removing the space after the first < in your example. The results are as follows:
Warning: file_get_contents(http://www.tractiontime.co.uk/) [function.file-get-contents]: failed to open stream: Connection refused in /home/sites/tractiontime.co.uk/public_html/sitemap/test.php on line 1

Comment on Sitemap Creator 0.2 beta by wkarim

wkarim — Thu, 18 Sep 2008 06:46:37 +0000

@Stuart
please check your connection from the server running the script to http://www.tractiontime.co.uk, check what you get with < ?php echo file_get_contents( 'http://www.tractiontime.co.uk/‘); ?>

Comment on Sitemap Creator 0.2 beta by Stuart

Stuart — Wed, 17 Sep 2008 12:49:50 +0000

I have tried this scrip, unmodified on php4 and i get the following message when i run the script:
WARNING: Connection failed (111) Connection refused
DEBUG: URL “http://www.tractiontime.co.uk/” Blacklisted. Reason : Empty Page

The page i presume it’s refering to is index.php and i know its not empty. Can you shed any light on this please?
MAny thanks

Comment on Elvis Presley – The Original Elvis Presley Collection 50CD by Blazer3030

Blazer3030 — Fri, 12 Sep 2008 17:03:32 +0000

Does Anyone Know where I can download this entire collection ????
Thanks for any info…

Comment on Sitemap Creator 0.2 beta by Khal

Khal — Mon, 08 Sep 2008 06:15:51 +0000

I installed it on my site and worked fine so far, i created a sitemap and managed to ping all search engines.
Thanks
Khal

Comment on Compressing your HTML, CSS and Javascript using simple PHP Code by wkarim

wkarim — Wed, 27 Aug 2008 22:29:03 +0000

@louis
Thanks for your comment.
I think I need to simplify it a lil yes

Comment on Compressing your HTML, CSS and Javascript using simple PHP Code by Louis

Louis — Wed, 27 Aug 2008 22:06:15 +0000

Hi wkarim, and thanks for sharing these pieces of code. They are interesting.

Though I wonder about your html_compress function. Is it necessary to use so much regex ? I have a function that does the nearly the same :

function compress($string){
$string = str_replace(“\n”, “”, $string);
$string = str_replace(“\t”, “”, $string);
$string = wordwrap($string, 990, “\n”);

return $string;
}

The thing that is cleary missing, is a way to preserve the code and pre tags. So my function is not complete, but yours seems overkill to me.

There has to be a correct middle.

Comment on Sitemap Creator 0.2 beta by wkarim

wkarim — Wed, 13 Aug 2008 22:06:00 +0000

@king
looks like you pinged google with a sitemap then deleted it, try ping google again with the right sitemap name or add it manually on google webmaster tools

Comment on Sitemap Creator 0.2 beta by king

king — Wed, 13 Aug 2008 14:40:25 +0000

I’m running php4 and 0.2b and can not get it to run. I have got to the point where everything runs fine, but google and others returns errors. the below one is saying the file is not present i 20080813 and there is no file

/hsphere/local/home/mgruppe/forkortelse.dk/sitemap/data/sites/www.forkortelse.dk_sitemaps/20080813 could not be found IP -: http://whois.domaintools.com/66.249.71.79
Date -: 04:26:44 pm ( Wednesday 13 August 2008 ) Bot -: Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html) Location -: http://www.forkortelse.dk/sitemap.php?do=showsitemap&sm=20080813.xml.gz

if i go to http://www.forkortelse.dk/sitemap.php?do=showsitemap&sm=20080813.xml.gz
it returns that something is wrong with the xml file

file attibutes should be ok
Thanks for a nice script!

BR
Henrik

Comment on Sitemap Creator 0.2 beta by wkarim

wkarim — Wed, 06 Aug 2008 15:51:19 +0000

@mikey, SearkeCom
Please enable debug mode to give me a better idea about what is happening.

Comment on Sitemap Creator 0.2 beta by mikey

mikey — Tue, 05 Aug 2008 20:13:08 +0000

i been checking the log file and the only error in it is this one:

[05-Aug-2008 15:06:56] PHP Fatal error: Maximum execution time of 30 seconds exceeded in /home/xxxxxxx/public_html/sitemap/.function.inc.php on line 295

Comment on Sitemap Creator 0.2 beta by mikey

mikey — Tue, 05 Aug 2008 20:01:25 +0000

Same here i upgrade to the new version and still no luck when i click the Crawl link it displays a number then it does nothing, now if i click any other link it shows that the cache has around 36 elements but nothing else no list nothing, dont know what else to do

Comment on Sitemap Creator 0.2 beta by SearleCom

SearleCom — Thu, 31 Jul 2008 19:34:24 +0000

Installed, crawls fine after logging in via http://thenetradio.co.uk/sitemap/sitemap.php

Once crawl has finished I press Create Sitemaps and get Please crawl thenetradio.co.uk/index.php first.

Sevrer is running PHP 5.2.6

Any ideas?

Mike

Comment on Adding FAlbum URLs to XML-Sitemap WordPress Plugin by wkarim

wkarim — Wed, 30 Jul 2008 12:43:37 +0000

@coalman please use text file to copy your code

Comment on Adding FAlbum URLs to XML-Sitemap WordPress Plugin by Coalman

Coalman — Wed, 30 Jul 2008 09:17:55 +0000

I am unable to cut + paste your code as it throws up unusual characters. I’ve tried visual browsers like Firefox and also Lynx.

Can you please help ?

Comment on Sitemap Creator 0.2 beta by wkarim

wkarim — Thu, 24 Jul 2008 06:39:46 +0000

@Bo
it should continue crawling the site normally but http://mym8.eu/ will not show on the sitemap as it’s a redirect page

Comment on Sitemap Creator 0.2 beta by Bo

Bo — Thu, 24 Jul 2008 03:45:18 +0000

hi,
i get this error:
WARNING: Page http://mym8.eu/ is redirecting to home.php
DEBUG: URL “http://mym8.eu/” Blacklisted. Reason : Empty Page

can you please advice?
thank you in advance

Comment on Sitemap Creator 0.2a: Create sitemaps 09 valid for Google, Yahoo, MSN, Ask.com and moreover sitemaps by wkarim

wkarim — Tue, 22 Jul 2008 01:47:53 +0000

@Frank
Good point! It has not been tested from console, however I will consider adding console interface on the next versions

Comment on Sitemap Creator 0.2a: Create sitemaps 09 valid for Google, Yahoo, MSN, Ask.com and moreover sitemaps by Frank

Frank — Mon, 21 Jul 2008 17:23:02 +0000

Hi,
first, thank you for this great script. It works perfect with a browser. But it doesn’t work from console. The only output is the HTML Markup from sitemap.php. But nothing is crawled and no sitemap is created. Do you have a workaround how to crawl from console/cron?
Thank You

Comment on Sitemap Creator 0.2 beta by wkarim

wkarim — Thu, 17 Jul 2008 00:04:05 +0000

@flobster
yes, you can use regular expressions to disable those URLs, examples are included on the config file.
ex : define(‘SMC_DISABLED_DIRS’, ‘\?a=page:2′ );

Comment on Sitemap Creator 0.2 beta by flobster

flobster — Wed, 16 Jul 2008 23:30:19 +0000

nice script! just one question: i have several urls ending with “?a=page:2″ which i want to exclude from being crawled. Will this be possible using SMC_DISABLED_DIRS?

Comment on Fixing Flickr FAlbum rewrite rules, thumbnails, javascripts and more … by Damir

Damir — Sat, 12 Jul 2008 14:55:05 +0000

Thanks a lot! I am preparing my own blog and this really helped me out! At first, the Show Exif was not working. After I followed your steps the problem was solved!

Greetings,

Damir

Comment on Sitemap Creator 0.2 beta by bispak

bispak — Sat, 12 Jul 2008 10:10:39 +0000

Thanks wkarim, works well using this version. I use it on my site tukarinfobispak.com anytime search engine robot read my sitemap, email sent to my mailbox inform about their activity.

Comment on Sitemap Creator 0.2a: Create sitemaps 09 valid for Google, Yahoo, MSN, Ask.com and moreover sitemaps by bispak

bispak — Fri, 11 Jul 2008 05:01:24 +0000

when i download, install and run sitemap creator 0.2b
Voila.. it’s works well.. yippeeee….

sitemap20080711.xml.gz Created successfully

Where i can see sitemap20080711.xml.gz ?

when i’ll submit sitemap to google as per SMC advised i dont know what i can submit since i cant find xml file under root or sitemap folder.

Please more advise and sorry to make you busy with my questions. Hope you dont mind.

Comment on Sitemap Creator 0.2a: Create sitemaps 09 valid for Google, Yahoo, MSN, Ask.com and moreover sitemaps by bispak

bispak — Fri, 11 Jul 2008 04:20:41 +0000

thanks, i’ll download and try sitemap creator 0.2b

Comment on Sitemap Creator 0.2a: Create sitemaps 09 valid for Google, Yahoo, MSN, Ask.com and moreover sitemaps by wkarim

wkarim — Wed, 09 Jul 2008 19:46:12 +0000

@bispak please use the new version sitemap creator 0.2b

Comment on Sitemap Creator 0.2a: Create sitemaps 09 valid for Google, Yahoo, MSN, Ask.com and moreover sitemaps by bispak

bispak — Wed, 09 Jul 2008 00:58:06 +0000

same result happened with or without “www”.
success in crawl but csv file and sitemap not created.
what’s wrong with me? am i not lucky?

Comment on Sitemap Creator 0.2a: Create sitemaps 09 valid for Google, Yahoo, MSN, Ask.com and moreover sitemaps by bispak

bispak — Wed, 09 Jul 2008 00:11:24 +0000

When i clink on “Display CSV File” the result is same with when i click on “Create Sitemaps”.
“Please crawl tukarinfobispak.com first”

Comment on Sitemap Creator 0.2a: Create sitemaps 09 valid for Google, Yahoo, MSN, Ask.com and moreover sitemaps by bispak

bispak — Wed, 09 Jul 2008 00:07:24 +0000

i’m sure crawling is finish with the result:
Finished crawling http://www.tukarinfobispak.com, Crawled 72 links
Took 26.69 Seconds, using 2MB of memory

and then at the end mention about the url to add to crontab or schedule tasks.

Still, when i click “Create Sitemaps” i got answer: “Please crawl tukarinfobispak.com first”.

I use PHP Version 5.2.5

Comment on Sitemap Creator 0.2a: Create sitemaps 09 valid for Google, Yahoo, MSN, Ask.com and moreover sitemaps by wkarim

wkarim — Tue, 08 Jul 2008 14:53:59 +0000

@bispak
Make sure the script finishes crawling before you create the sitemap

Comment on Sitemap Creator 0.2 beta by Ferran

Ferran — Wed, 18 Jun 2008 09:06:12 +0000

@wkarim
I set to false SMC_GSS and the result is the same…
When I look at CSV or the table of sitemap.php show the links… It may be the codification of the files? I try in my sites in UTF and works perfectly, but when i try in this site that’s in ISO, the xml is corrupt… I don’t understand it, the functions are correct and config too…

Comment on Sitemap Creator 0.2 beta by wkarim

wkarim — Wed, 18 Jun 2008 07:19:40 +0000

@Ferran
can you change constant SMC_GSS to false to disable GSS and try again?

Comment on Sitemap Creator 0.2 beta by links for 2008-06-18 « Free Open Source Directory

links for 2008-06-18 « Free Open Source Directory — Wed, 18 Jun 2008 00:35:00 +0000

[...] Sitemap Creator 0.2 beta :: GadElKareem (tags: Sitemap Creator 0.2 beta :: GadElKareem) [...]

Comment on Sitemap Creator 0.2 beta by Ferran

Ferran — Tue, 17 Jun 2008 07:43:07 +0000

http://cordigual.com/__sitemap/sitemap.php?do=showsitemap&sm=sitemap.xml.gz

Comment on Sitemap Creator 0.2 beta by wkarim

wkarim — Sat, 14 Jun 2008 03:13:26 +0000

@Ferran
can you give me a like to your sitemap xml file?

Comment on Sitemap Creator 0.2 beta by Ferran

Ferran — Fri, 13 Jun 2008 12:54:56 +0000

I use your Sitemap Creator for a site and all going OK, show a table with the URL’s and no error messages. But when I click “Create Sitemaps” the XML is mal formed and incorrect. Any suggestion?
The Site is in ISO-8859-1 and Sitemap in UTF-8…

Comment on Sitemap Creator 0.2 beta by wkarim

wkarim — Wed, 28 May 2008 21:14:22 +0000

@abyzn
Can you enable the debug mode from the configuration file and give me the results?

Comment on Sitemap Creator 0.2 beta by abyzn

abyzn — Tue, 27 May 2008 14:22:28 +0000

where is the right setting for site

Comment on Sitemap Creator 0.2 beta by abyzn

abyzn — Tue, 27 May 2008 14:21:46 +0000

hi
help me
i see this error:

No Pages were crawled, Please make sure you have set your site domain correctly and you have valid connection to host

Comment on Sitemap Creator 0.2 beta by wkarim

wkarim — Tue, 20 May 2008 23:44:22 +0000

@gtnman
- touch() is not related to Plesk, you need to have permissions to modify files in that directory, I can not find any relation between touch() function and utime. make sure you ‘chmod 777′ data directory.
- robots.txt are not generated every time the sitemap is created, you only need to modify it once.

Comment on Sitemap Creator 0.2 beta by gtnman

gtnman — Mon, 19 May 2008 16:13:00 +0000

Another note, I tested this on my ubuntu box and it worked fine which utime did exist on.

Comment on Sitemap Creator 0.2 beta by gtnman

gtnman — Mon, 19 May 2008 16:09:08 +0000

Interesting note. I have tested this script on two VPS servers both running the latest version of Plesk on two different web hosts. Seems that the unix command utime (which touch()) uses is not available in Plesk. Is touch vital to the script or will is_writable do the same thing? (I made this change, and the robots.txt generated perfectly.)
Does the cronjob re-generate robots.txt or is this something that the user must do.

Comment on Sitemap Creator 0.2 beta by wkarim

wkarim — Fri, 16 May 2008 23:09:15 +0000

@gtnman
Please use “Add reference to robots.txt” to show you the default sitemap URL, remember to chmod 666 robots.txt .
it should look something like
http://www.greatertalent.com/sitemap.php?do=showsitemap&sm=sitemap.xml.gz

Comment on Sitemap Creator 0.2 beta by gtnman

gtnman — Fri, 16 May 2008 22:57:03 +0000

What is the URL you are supposed to submit to google for the sitemap?

Comment on Sitemap Creator 0.2 beta by Sitemap Creator 0.2 beta Released « jared.brodsky

Sitemap Creator 0.2 beta Released « jared.brodsky — Fri, 16 May 2008 16:11:06 +0000

[...] You need a sitemap! Lucky for you GadElKareem created a little script written in PHP called Sitemap Creator. So what does it do? Upon logging into the sitemap admin section and clicking “Crawl [...]

Comment on Sitemap Creator 0.2a: Create sitemaps 09 valid for Google, Yahoo, MSN, Ask.com and moreover sitemaps by gtnman

gtnman — Fri, 09 May 2008 19:34:30 +0000

I turned off safe mode, however when I crawl the site it crawls perfect then I click create sitemap, and it tell me I must crawl the site first.

I have curl disabled and www set to true.

Comment on Sitemap Creator 0.2a: Create sitemaps 09 valid for Google, Yahoo, MSN, Ask.com and moreover sitemaps by gtnman

gtnman — Wed, 07 May 2008 21:22:44 +0000

I assume that this script does not work w/ PHP safemode?

Comment on Sitemap Creator 0.2a: Create sitemaps 09 valid for Google, Yahoo, MSN, Ask.com and moreover sitemaps by cyberswept

cyberswept — Thu, 01 May 2008 22:22:04 +0000

sl I changed the .function.inc.php as you described and it now crawls my site, but when I go to create the sitemaps it says, please crawl domain.com first. Any suggestions?

Comment on Adding FAlbum URLs to XML-Sitemap WordPress Plugin by Fixing Flickr FAlbum rewrite rules, thumbnails, javascripts and more … :: GadElKareem

Tue, 29 Apr 2008 00:18:00 +0000

[...] to get xml-sitemaps and FAlbum to play nice together…not sure I have the time to do it! Adding FAlbum URLs to XML-Sitemap WordPress Plugin [...]

Comment on Sitemap Creator 0.2a: Create sitemaps 09 valid for Google, Yahoo, MSN, Ask.com and moreover sitemaps by Gsm files center

Gsm files center — Sat, 26 Apr 2008 23:10:36 +0000

Thanks for the sitemap script, it’s working great
nice work ..

Comment on Sitemap Creator 0.2a: Create sitemaps 09 valid for Google, Yahoo, MSN, Ask.com and moreover sitemaps by sl

sl — Wed, 23 Apr 2008 17:00:40 +0000

stripos() and curl_setopt_array() is not php 4.x compilant. so i fixed following lines in file .function.inc.php.

line 217:
$ch = curl_init($url);

changed to:
foreach ($options as $myoption => $myvalue) {
curl_setopt ($ch, $myoption, $myvalue);
}
–
line 233:
if ( isset($header['content_type']) && stripos($header['content_type'], ‘text’) === false ){

changed to:
if ( isset($header['content_type']) && strpos(strtolower($header['content_type']), ‘text’) === false ){
–

Comment on Sort Unix processes on ps by highest memory usage by T Crever

T Crever — Fri, 18 Apr 2008 18:08:20 +0000

how about
ps -eo pmem,pcpu,rss,vsize,args | sort -k 1 -r -n | more

Comment on Sitemap Creator 0.2a: Create sitemaps 09 valid for Google, Yahoo, MSN, Ask.com and moreover sitemaps by wkarim

wkarim — Mon, 14 Apr 2008 12:45:23 +0000

@shawn
- No, you mostly do not need to edit this.
- For crawling more than one domain you need to keep SMC_SITE as $_SERVER['HTTP_HOST'] and run the script from these different domains, every domain will create its own sitemap and will product a different sitemap which you can submit to Google webmaster’s CP.
- You are welcome to show a link back to Sitemap Creator.

Comment on Sitemap Creator 0.2a: Create sitemaps 09 valid for Google, Yahoo, MSN, Ask.com and moreover sitemaps by shawn

shawn — Mon, 14 Apr 2008 12:42:19 +0000

sorry i do have this sitemap.php file and it is in the root directory.and there is also referance in the robots.txt to it!

i have 3 domains and want them all crawled seperate and they seem to be working but what do i need to tell google my site map is? sitemap.php?

if we get this working properly i will help you promote it my placing a link on my sites!

Comment on Sitemap Creator 0.2a: Create sitemaps 09 valid for Google, Yahoo, MSN, Ask.com and moreover sitemaps by shawn

shawn — Mon, 14 Apr 2008 12:20:01 +0000

so you do need to add any thing to these
Google’ => ‘http://www.google.com/webmasters/sitemaps/ping?sitemap=',
‘Yahoo’ => ‘http://search.yahooapis.com/SiteExplorerService/V1/updateNotification?appid=SitemapWriter&url=',
‘Live Search’ => ‘http://webmaster.live.com/ping.aspx?siteMap=',
‘Ask.com’ => ‘http://submissions.ask.com/ping?sitemap=',
‘MoreOver’ => ‘http://api.moreover.com/ping?u=',?

Comment on Sitemap Creator 0.2a: Create sitemaps 09 valid for Google, Yahoo, MSN, Ask.com and moreover sitemaps by wkarim

wkarim — Sat, 12 Apr 2008 18:05:14 +0000

@shawn
- you do not need to edit internal settings.
- the script provides another page ‘sitemap.php’ which should be placed in the root directory where it redirects the bot to the sitemap location.
- There is an option on the admin area to add the sitemap URL to robots.txt
- The script creates a new sitemap if the time of crawling is one day different from the last created sitemap, you can create a cron job to delete old sitemaps
- The sitemap on the posted URL does not exist, please regenerate it.

Comment on Sitemap Creator 0.2a: Create sitemaps 09 valid for Google, Yahoo, MSN, Ask.com and moreover sitemaps by shawn

shawn — Tue, 08 Apr 2008 17:26:39 +0000

Sitemap : http://floafieds.com/sitemap.php?do=showsitemap&sm=sitemap.xml.gz
when google runs this they get a server internal error is there any fix?

Comment on Sitemap Creator 0.2a: Create sitemaps 09 valid for Google, Yahoo, MSN, Ask.com and moreover sitemaps by shawn

shawn — Tue, 08 Apr 2008 12:29:33 +0000

wkarim,

can you tell me if the
/*internal settings*/
define(‘SMC_VERSION’, ’0.2a’);
define(‘SMC_DATA_CACHE’, SMC_DATA.’cache/’);
define(‘SMC_DATA_SITES’, SMC_DATA.’sites/’);
define(‘SMC_DATA_ERRORS’, SMC_DATA.’errors/’);
define(‘SMC_DATA_SITEMAPS’, SMC_DATA_SITES.SMC_SITE.’_sitemaps/’);
$pings = array (
‘Google’ => ‘http://www.google.com/webmasters/sitemaps/ping?sitemap=',
‘Yahoo’ => ‘http://search.yahooapis.com/SiteExplorerService/V1/updateNotification?appid=SitemapWriter&url=',
‘Live Search’ => ‘http://webmaster.live.com/ping.aspx?siteMap=',
‘Ask.com’ => ‘http://submissions.ask.com/ping?sitemap=',
‘MoreOver’ => ‘http://api.moreover.com/ping?u=',
);
does any of this have to be edited and will this script automatacly ping the search engines
because google askes for sitemap.xml in your root directory and the script does not save one there that i can see please explain how this works!! the scrips is awsome also in the admin section it would be nice if the admin could edit or add to the robots.txt file i have set up a cron task to run every hour it seems to work but does it save a new site map in the cron task or just update the existing one i have an auction site so it will be changing all the time.

Comment on Adding FAlbum URLs to XML-Sitemap WordPress Plugin by wkarim

wkarim — Tue, 01 Apr 2008 14:25:28 +0000

@Matt
Welcome! you don’t need to add the fixes from the other post for adding falbum to sitemap to work.

Comment on Adding FAlbum URLs to XML-Sitemap WordPress Plugin by Matt

Matt — Mon, 31 Mar 2008 14:39:21 +0000

Thanks, I’ll try– also, I didn’t do your other updates from your other post… is it necessary to do that as well, or can I just do this one?

Comment on Adding FAlbum URLs to XML-Sitemap WordPress Plugin by wkarim

wkarim — Mon, 31 Mar 2008 08:25:02 +0000

@Matt
Please copy and paste the code again, or replace all unicode (’‘) with ‘

Comment on Adding FAlbum URLs to XML-Sitemap WordPress Plugin by Matt

Matt — Mon, 31 Mar 2008 05:35:27 +0000

Hi! Whenever I paste your above script into wp-content/plugins/falbum/wordpress-falbum-plugin.php, it takes down my blog… running falbum 0.7.1 and sitemaps 3.0.3. Any suggestions? is it a pathing issue? (the blog sits at /blog, but it is actually at the root).

Comment on Sitemap Creator 0.2a: Create sitemaps 09 valid for Google, Yahoo, MSN, Ask.com and moreover sitemaps by wkarim

wkarim — Thu, 27 Mar 2008 07:04:32 +0000

@shawn
glad it helped, thanks for nice words

Comment on Compressing your HTML, CSS and Javascript using simple PHP Code by wkarim

wkarim — Thu, 27 Mar 2008 06:59:57 +0000

@Shawn
there are a lot of ways to speed up static contents of your website, check your server’s configuration optimization tutorials for more info. Most common way is to put them on a separate server with a different sub domain like static.gadelkareem.com and use something like lighttpd to serve static contents.

Comment on Compressing your HTML, CSS and Javascript using simple PHP Code by shawn

shawn — Thu, 27 Mar 2008 06:32:24 +0000

any idea’s on how i can get my front portal page to load faster (graphics and animation from frontpage)

Comment on Sitemap Creator 0.2a: Create sitemaps 09 valid for Google, Yahoo, MSN, Ask.com and moreover sitemaps by shawn

shawn — Thu, 27 Mar 2008 06:25:15 +0000

this is just what i was looking for for a week and 50 scripts later yep works like a charm my site is huge so i uped the mem to 600 and time out to 1800 and it rolls like a swiss watch

I CAN NOT SAY THAK YOU ENOUGH!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!

Comment on Using iptables to block ips that spam or attack your server by Lorenzo

Lorenzo — Wed, 26 Mar 2008 07:32:26 +0000

cool,
just what I was looking for, thanks.

Comment on Sitemap Creator 0.2a: Create sitemaps 09 valid for Google, Yahoo, MSN, Ask.com and moreover sitemaps by Sitemap Creator - Create sitemaps for Google, Yahoo, MSN and Ask.comphp and javascript

Sun, 23 Mar 2008 20:18:38 +0000

[...] URL: http://gadelkareem.com/2007/12/10/sitemap-creator-02a-create-sitemaps-09-valid-for-google-yahoo-and-... [...]

Comment on Sitemap Creator 0.2a: Create sitemaps 09 valid for Google, Yahoo, MSN, Ask.com and moreover sitemaps by wkarim

wkarim — Fri, 29 Feb 2008 23:34:26 +0000

@Tammy
please change SMC_USE_WWW to true and add www to your domain as all links displayed there include www

Comment on Sitemap Creator 0.2a: Create sitemaps 09 valid for Google, Yahoo, MSN, Ask.com and moreover sitemaps by Tammy

Tammy — Fri, 29 Feb 2008 16:49:08 +0000

thank you wkarim, I do that but now when it crawls it goes through the whole 350 seconds and then tells me:
No Pages were crawled, Please make sure you have set your site domain correctly and you have valid connection to host

Comment on Sitemap Creator 0.2a: Create sitemaps 09 valid for Google, Yahoo, MSN, Ask.com and moreover sitemaps by wkarim

wkarim — Wed, 27 Feb 2008 20:21:39 +0000

@Tammy
This might be related to concurrent connection or bandwidth limit per session on your server.
To solve this problem try commenting line :
$get .= “Connection: close\r\n\r\n”;
on function.inc.php file

Comment on Sitemap Creator 0.2a: Create sitemaps 09 valid for Google, Yahoo, MSN, Ask.com and moreover sitemaps by Tammy

Tammy — Wed, 27 Feb 2008 19:40:04 +0000

I keep getting this error when crawling. I’ve tried raising the timeout to no avail

WARNING: Connection failed (0)
WARNING: Connection failed (0)
NOTICE: Document type is application/xml for URL http://mysite.com/clients/announcements.xml
WARNING: Connection failed (0)
NOTICE: Document type is application/zip for URL http://mysite.com/themes/dreamland.zip
NOTICE: Document type is application/zip for URL http://mysite.com/themes/Green-Glow_000.zip
NOTICE: Document type is application/zip for URL http://mysite.com/themes/mountain-dawn.zip
NOTICE: Document type is application/zip for URL http://mysite.com/themes/yalla.zip

Comment on Sitemap Creator 0.2a: Create sitemaps 09 valid for Google, Yahoo, MSN, Ask.com and moreover sitemaps by wkarim

wkarim — Tue, 26 Feb 2008 03:35:25 +0000

@Darren
I am afraid this is not available, I will try to include that as an option on the config file on next releases.
A workaround is to edit the csv file and delete links you do not want to include on the sitemap. Or in case you do not want to crawl that directory you may blacklist it.

Comment on Sitemap Creator 0.2a: Create sitemaps 09 valid for Google, Yahoo, MSN, Ask.com and moreover sitemaps by Darren

Darren — Tue, 26 Feb 2008 03:18:04 +0000

Is there a way to limit the depth in a single directory. I have a calendar and once it goes into that area it fills it up fast.

Comment on Sitemap Creator 0.2a: Create sitemaps 09 valid for Google, Yahoo, MSN, Ask.com and moreover sitemaps by wkarim

wkarim — Fri, 22 Feb 2008 02:25:16 +0000

@Andrew
Thank you for your comment.

Comment on Sitemap Creator 0.2a: Create sitemaps 09 valid for Google, Yahoo, MSN, Ask.com and moreover sitemaps by Andrew

Andrew — Thu, 21 Feb 2008 19:57:29 +0000

Guys and Girls..I downloaded the most recent version on hotscripts.com and edited config.php.inc. All I changed was the prefix for my email and the password (did not touch the HTTP_HOST). I uploaded the files to my site, chmod 777 the data folder, and accessed the site via this link: http://domain.com/sitemap/sitemap.php (NO WWW)

It went through and indexed everything fine. Works like a charm, thanks webmaster!

Comment on Sitemap Creator 0.2a: Create sitemaps 09 valid for Google, Yahoo, MSN, Ask.com and moreover sitemaps by wkarim

wkarim — Mon, 18 Feb 2008 17:46:53 +0000

@Dhyar IRdiansyah
make sure the links on the page have the same domain as your localhost or make changes on the config file

Comment on Sitemap Creator 0.2a: Create sitemaps 09 valid for Google, Yahoo, MSN, Ask.com and moreover sitemaps by Dhyar IRdiansyah

Dhyar IRdiansyah — Mon, 18 Feb 2008 17:42:41 +0000

I get error “No Pages were crawled, Please make sure you have set your site domain correctly and you have valid connection to host”. what must i do?

Comment on Sitemap Creator 0.2a: Create sitemaps 09 valid for Google, Yahoo, MSN, Ask.com and moreover sitemaps by wkarim

wkarim — Mon, 18 Feb 2008 15:17:05 +0000

@neeraj
as far as there’s a link to the forums it should crawl it with no problem

Comment on Sitemap Creator 0.2a: Create sitemaps 09 valid for Google, Yahoo, MSN, Ask.com and moreover sitemaps by neeraj

neeraj — Mon, 18 Feb 2008 11:25:20 +0000

hello
i have install it at mmmec.com but i have a forum under mmmec.com/forum ,so how can i make it to map my forum also ,where should i put the link depth for it ??

Comment on Sitemap Creator 0.2a: Create sitemaps 09 valid for Google, Yahoo, MSN, Ask.com and moreover sitemaps by wkarim

wkarim — Sat, 16 Feb 2008 14:05:25 +0000

@Ruud
yes, That should work

Comment on Sitemap Creator 0.2a: Create sitemaps 09 valid for Google, Yahoo, MSN, Ask.com and moreover sitemaps by Ruud

Ruud — Sat, 16 Feb 2008 13:56:19 +0000

this way I access the script:

http://example.com/sitemap/sitemap.php