JCrawler Forum

» Problems

There are 0 links in your sitemap

(20 posts)

Tags:

There are 0 links in your sitemap

citrix34
Member

hi Patrick,
great product but it seems we are several user witch this bug : \'There are 0 links in your sitemap\' when we use your component.
Do you expect to realease a new beta (i suppose Jcrawler 1.6 beta) soon ?

Thanks
regards.
JP

Posted 1 year ago #
patrick
Key Master

Hey JP,

I just released the 1.6 Beta:
http://joomlacode.org/gf/project/jcrawler/frs/

Awaiting you feedback :)

Greets Patrick

Posted 1 year ago #
ssnobben
Member

Hi thanks for the update. I still go this error with 0 listing that is very annoying..:-) see this // before admin.... can that be an error with the server?

* There are 0 links in your sitemap.
* Success, wrote /hsphere/local/home/web/site.com/sitemap.xml
* Success, wrote /hsphere/local/home/web/site.com//administrator/components/com_jcrawler/config.xml
* total time: 0.1662 seconds

Schema validating with XSV 3.1-1 of 2007/12/11 16:20:05

* Target: http://www.site.com/sitemap.xml
(Real name: http://www.site.com/sitemap.xml
Length: 404 bytes

Last Modified: Thu, 05 Feb 2009 12:43:01 GMT
Server: Apache/1.3.37 (Unix) Sun-ONE-ASP/4.0.2 PHP/5.2.2 mod_throttle/3.1.2 FrontPage/5.0.2.2635 mod_psoft_traffic/0.2 mod_ssl/2.8.28 OpenSSL/0.9.6b)
* docElt: {http://www.sitemaps.org/schemas/sitemap/0.9}urlset
* Validation was strict, starting with type [Anonymous]
* schemaLocs: http://www.sitemaps.org/schemas/sitemap/0.9 -> http://www.sitemaps.org/schemas/sitemap/0.9/sitemap.xsd
* The schema(s) used for schema-validation had
no errors
* 1 schema-validity problem was found in the target

Schema resources involved

Attempt to load a schema document from
http://www.sitemaps.org/schemas/sitemap/0.9/sitemap.xsd
(source: schemaLoc) for
http://www.sitemaps.org/schemas/sitemap/0.9,
succeeded
Problems with the schema-validity of the target

http://www.site.com/sitemap.xml:3:2: Invalid per cvc-complex-type.1.2.4:
content of urlset is not allowed to end here (1), expecting [u\'{http://www.sitemaps.org/schemas/sitemap/0.9}:url\']:

Posted 1 year ago #
patrick
Key Master

hey snobben, can you give me your url? I\'ll have a look.

Greets Patrick

Posted 1 year ago #
citrix34
Member

Hi Patrick,
well it works better.. i have some links now.. but the sitemap file contains a lot of blank lines witch is a fault .. <loc></loc> with no text inside.
i also use SH404SEF ...
Could you have a look please ?
link : http://www.mephivio.fr/sitemap.xml

thanks
Jerome

Posted 1 year ago #
patrick
Key Master

Jey jerome,

its strange, i crawled your site without any problem! There are no blank lines.

I took standardconfiguration with curl, 50 connections, 3 levels or 6 levels. It looks fine.

Greets Patrick

Posted 1 year ago #
thegardener
Member

Hi Patrick
I do actually have the same problem as \"ssnobben\". I do get the following information when trying to create a sitemap with JCrawler:

Message in backend:
There are 0 links in your sitemap.
Success, wrote /home/sites/thegardener.ch/public_html/sitemap.xml
Success, wrote /home/sites/thegardener.ch/public_html//administrator/components/com_jcrawler/config.xml
total time: 3.0137 seconds

Message when validating sitemap:
Schema validating with XSV 3.1-1 of 2007/12/11 16:20:05
Target: http://www.thegardener.ch/sitemap.xml
(Real name: http://www.thegardener.ch/sitemap.xml
Length: 406 bytes
Last Modified: Fri, 06 Feb 2009 12:17:25 GMT
Server: Apache/2)
docElt: {http://www.sitemaps.org/schemas/sitemap/0.9}urlset
Validation was strict, starting with type [Anonymous]
schemaLocs: http://www.sitemaps.org/schemas/sitemap/0.9 -> http://www.sitemaps.org/schemas/sitemap/0.9/sitemap.xsd
The schema(s) used for schema-validation had no errors
1 schema-validity problem was found in the target

--------------------------------------------------------------------------------

Schema resources involved
Attempt to load a schema document from http://www.sitemaps.org/schemas/sitemap/0.9/sitemap.xsd (source: schemaLoc) for http://www.sitemaps.org/schemas/sitemap/0.9, succeeded

--------------------------------------------------------------------------------

Problems with the schema-validity of the target
http://www.thegardener.ch/sitemap.xml:3:2: Invalid per cvc-complex-type.1.2.4: content of urlset is not allowed to end here (1), expecting [u\'{http://www.sitemaps.org/schemas/sitemap/0.9}:url\']:

Any help would be appreciated. As additional information: Joomla! Version 1.5.9.

Thanks and Greets
Daniel

Posted 1 year ago #
Patrick Schouten
Member

Hello Patrick, I got the same messages and more:

\'-------------8<------------------
httpcode: 403 on url http://www.kskproductions.nl

* There are 0 links in your sitemap.
* Success, wrote /home/.../sitemap.xml
* Success, wrote /home/...//administrator/components/com_jcrawler/config.xml
* total time: 16.7921 seconds

Warning: array_merge_recursive() [function.array-merge-recursive]: Argument #1 is not an array in /home/.../administrator/components/com_jcrawler/admin.jcrawler.php on line 347

Warning: array_merge_recursive() [function.array-merge-recursive]: Argument #1 is not an array in /home/.../administrator/components/com_jcrawler/admin.jcrawler.php on line 347

Warning: array_merge_recursive() [function.array-merge-recursive]: Argument #1 is not an array in /home/.../administrator/components/com_jcrawler/admin.jcrawler.php on line 347

Warning: Invalid argument supplied for foreach() in /home/.../administrator/components/com_jcrawler/admin.jcrawler.php on line 423
-------------8<------------------\'

With the previous version I had no problems.

Greetings,
Patrick Schouten
The Netherlands

http://www.KSKproductions.nl

Posted 1 year ago #
sspeed
Member

Same here, exact same problem for me...

Schema validating with XSV 3.1-1 of 2007/12/11 16:20:05
Target: http://www.bikeblogcollection.com/sitemap.xml
(Real name: http://www.bikeblogcollection.com/sitemap.xml
Length: 414 bytes
Last Modified: Mon, 09 Feb 2009 16:08:33 GMT
Server: Apache/1.3.41 (Unix) Sun-ONE-ASP/4.0.2 mod_fastcgi/2.4.2 mod_log_bytes/1.2 mod_bwlimited/1.4 mod_auth_passthrough/1.8 FrontPage/5.0.2.2635 mod_ssl/2.8.31 OpenSSL/0.9.7a)
docElt: {http://www.sitemaps.org/schemas/sitemap/0.9}urlset
Validation was strict, starting with type [Anonymous]
schemaLocs: http://www.sitemaps.org/schemas/sitemap/0.9 -> http://www.sitemaps.org/schemas/sitemap/0.9/sitemap.xsd
The schema(s) used for schema-validation had no errors
1 schema-validity problem was found in the target

--------------------------------------------------------------------------------

Schema resources involved
Attempt to load a schema document from http://www.sitemaps.org/schemas/sitemap/0.9/sitemap.xsd (source: schemaLoc) for http://www.sitemaps.org/schemas/sitemap/0.9, succeeded

--------------------------------------------------------------------------------

Problems with the schema-validity of the target
http://www.bikeblogcollection.com/sitemap.xml:3:2: Invalid per cvc-complex-type.1.2.4: content of urlset is not allowed to end here (1), expecting [u\'{http://www.sitemaps.org/schemas/sitemap/0.9}:url\']:

Posted 1 year ago #
patrick
Key Master

hmm you get a 403 error on your top url. JCrawler cannot crawl the rest of your page.

can you try to disable any security features from installed SEF components?

greets Patrick

Posted 1 year ago #
sspeed
Member

Hmm, I don\'t have any SEF components installed?

Posted 1 year ago #
patrick
Key Master

sspeed, do you get any error\'s on crawling?
403 or 404?
i crawled bikeblogcollection.com and got:

There are 257 links in your sitemap.
total time: 53.8444 seconds

try to crawl with fopen (if possible) or set the maximum parallel connections to 1

greets patrick

Posted 1 year ago #
sspeed
Member

The first time I got no errors at all, just the output I had posted. I downloaded your 1.6beta and now I simply get a page timeout and no sitemap. I don\'t know what I\'m doing wrong..

Posted 1 year ago #
patrick
Key Master

ok, we get closer :)

you get a timeout, thats exactly the problem!

Can you ask your Webspace-Provider, if there is a firewall? or something like that?
Im the 1.6 version are more errors displayed.

Greets Patrick

Posted 1 year ago #
sspeed
Member

Hey Patrick, I\'m surprised that it let you run a sitemap on http://www.bikeblogcollection.com. I have no firewall, I\'m using the new Firefox so I no longer have an http.network.connect.timeout configuration option. Firefox goes to a blank screen, Google Chrome gets a \"Error 320 (net::ERR_INVALID_RESPONSE): Unknown error.\" and IE gets a 500 Internal Server error from Apache.

Posted 1 year ago #
patrick
Key Master

Hey sspeed, i can crawls all sites with my admin version.

Ah, on your webserver is only the normal curl extension installed. JCrawler uses a special curl feature for crawling with parallel connections.

I\'ve fixed this bug yesterday :) Will come in the next version with automatic priority calculation.

If this special Curl feature is not enabled on your host this results the blank page, the server error etc.. (Depending on the browser)

Greez Patrick

Posted 1 year ago #
ssnobben
Member

Well I have still the same problem tried with new J1.6 beta and J 1.5.9.

Just got this info
* There are 0 links in your sitemap.
* Success, wrote /hsphere/local/home/site/domainurl/sitemap.xml
* Success, wrote /hsphere/local/home/site/domainurl//administrator/components/com_jcrawler/config.xml
* total time: 0.1769 seconds

I also put in allow_url_fopen=on in my php.in and .htaccess files but not working..

rgds

Posted 1 year ago #
Ian Robinson
Member

Hi Patick

I\'m a newbie to Joomla & Webdesign...
However running the latest Joomla and your Beta 1.6 JCrawler I get the message below..

* There are 0 links in your sitemap.
* Success, wrote /home/kintbur1/public_html/sitemap.xml
* Success, wrote /home/kintbur1/public_html//administrator/components/com_jcrawler/config.xml
* total time: 0.2099 seconds

And this warning for every Curl level...

Warning: array_merge_recursive() [function.array-merge-recursive]: Argument #1 is not an array in /home/kintbur1/public_html/administrator/components/com_jcrawler/admin.jcrawler.php on line 347

can anyone help... ?

Thanks :)

Posted 1 year ago #
Ian Robinson
Member

Ah... Now works...
I\'m in design mode and had marked Website as being Offline :((

Request... I\'m UK based...
Can we a a method to point the submission to designated sites..
ie. msn, ask, yahoo etc..

Thanks

IAN

Posted 1 year ago #
woody
Member

Hi Ian Robinson , i got same ur problem,,
* here are 0 links in your sitemap.
* Success, wrote /home/samarra/public_html/sitemap.xml
* Success, wrote /home/samarra/public_html//administrator/components/com_jcrawler/config.xml
* total time: 0.3868 seconds
* robots.txt contains already sitemap location

Warning: array_merge_recursive() [function.array-merge-recursive]: Argument #1 is not an array in /home/samarra/public_html/administrator/components/com_jcrawler/admin.jcrawler.php on line 347

Warning: array_merge_recursive() [function.array-merge-recursive]: Argument #1 is not an array in /home/samarra/public_html/administrator/components/com_jcrawler/admin.jcrawler.php on line 347

Warning: array_merge_recursive() [function.array-merge-recursive]: Argument #1 is not an array in /home/samarra/public_html/administrator/components/com_jcrawler/admin.jcrawler.php on line 347

Warning: Invalid argument supplied for foreach() in /home/samarra/public_html/administrator/components/com_jcrawler/admin.jcrawler.php on line 423

How can u slove ur problem..?
http://www.kintburyscouts.co.uk/sitemap.xml

Posted 1 year ago #