Comments on: JCrawler – 1.9 Joomla 1.5/1.6/1.7

By: patrick

patrick — Sun, 28 Dec 2008 22:43:13 +0000

There are no further comments possible, please check out the forums: http://www.pixelschieber.ch/forum/

By: patrick

patrick — Sun, 28 Dec 2008 22:42:06 +0000

Hey, your post was not approved yet,

your page is changing, there are a forum, comments etc..
that can be a reason, or due serverload there are some timeouts on urls

greets patrick

By: patrick

patrick — Sun, 28 Dec 2008 15:17:41 +0000

Hi SdK,

Ok, thats an user agent problem. I’ll change the useragent to “google” in the next version. So there will be less problems with the useragent.

Greets Patrick

By: patrick

patrick — Sun, 28 Dec 2008 15:14:14 +0000

Hi Marc,

thank you, i’ve found a bug.
Will be fixed in the next version

Greets Patrick

By: vince

vince — Sat, 27 Dec 2008 18:57:26 +0000

hello,

it seems my other post has disappeared.

my question in regards is that i notice when i run jcrawler it will show like 800 links. when i run jcrawler another day it will show less say 780 links.

can you tell me why it does this?

thank you,

vince

By: Charlie

Charlie — Fri, 26 Dec 2008 00:16:35 +0000

Like a couple of others, I am getting the HTTP/1.1 403 FORBIDDEN error on many, but not all the links.

I am not using .htaccess but I am using sh404SEF. If I am not using .htaccess, there is no where to comment out the “RewriteBase /”.

I get roughly 1/2 my links written to xml file and the other 1/2 are the error.

Any ideas?

Thanks in advance.

By: SdK

SdK — Thu, 25 Dec 2008 16:13:42 +0000

I just moved from my own server (win2k3) to byethost (linux) and now another host. On both hosts I cannot get Jcrawler to generate sitemap. The first does not allow for non standard user agents. Is there any way to solve such an issue? I just send an email to my new host if they also sent away unknown user agents.

To be clear: the sitemap gets generated but it has no links in it, jcrawler sees 0 links (but the green stuff and the spam is added to the sitemap.xml).

Thanks in advance!

ps I think a lot of people not running their own apache will have this problem

By: Vince

Vince — Mon, 22 Dec 2008 19:34:54 +0000

Hello,

what does mean when your links goes down?

one day i will run jcrawler and shows 800 links and couple days later i run it again and will show 785.

is something getting deleted?

thank you,

By: Dirk

Dirk — Sun, 21 Dec 2008 14:55:05 +0000

Hi Patrick,

which URL? Its all in the backend!!

Do you have forum for the jcrawler?
Thx
Dirk

By: Marc

Marc — Fri, 19 Dec 2008 19:04:49 +0000

The component looks good. My only problem is that it will only create an entry for my contact page and no other pages. I only have 5 pages and I’ve tried changing the levels but nothing works.

Any guidance you can provide will be appreciated.

Marc