JCrawler Forum: Recent Topics

JCrawler Forum: Recent Topics http://www.pixelschieber.ch/forum/ Help forums for JCrawler en Fri, 12 Mar 2010 12:56:24 +0000 shawn on "sitemap doesn\'t validate" http://www.pixelschieber.ch/forum/topic/sitemap-doesnt-validate#post-279 Fri, 12 Jun 2009 13:16:32 +0000 shawn 279@http://www.pixelschieber.ch/forum/ When I try to validate my sitemap, I get the following error: Invalid per cvc-complex-type.1.2.4: element {http://www.sitemaps.org/schemas/sitemap/0.9}:changefreq not allowed here (5) in element {http://www.sitemaps.org/schemas/sitemap/0.9}:url, expecting [{Wildcard: ##other, strict},$]: If I manually adjust the xml file from: <url> <loc>http://www.mysite.com/</loc> <lastmod>2009-06-12T06:12:05Z</lastmod> <priority>1.0</priority> <changefreq>monthly</changefreq> </url> to this: <url> <loc>http://www.mysite.com/</loc> <lastmod>2009-06-12T06:12:05Z</lastmod> <changefreq>monthly</changefreq> <priority>1.0</priority> </url> it then validates. Any ideas what I\'ve done wrong????? I\'m getting the same result on 2 separate sites on different hosts. debocracy on ""The bytes parameter must greater then zero" error" http://www.pixelschieber.ch/forum/topic/quotthe-bytes-parameter-must-greater-then-zeroquot-error#post-396 Thu, 12 Nov 2009 02:23:58 +0000 debocracy 396@http://www.pixelschieber.ch/forum/ I just installed a fresh download of Jcrawler on a new Joomla 1.5.15 site and it generated this error immediately at upload: zip_entry_read() [function.zip-entry-read]: The bytes parameter must greater then zero in /home/nychotsp/public_html/libraries/joomla/filesystem/archive/zip.php on line 238 the website is <a href="http://www.nychotspots.com/index.php" rel="nofollow">http://www.nychotspots.com/index.php</a> I can edit the zip.php file, but is it going to work after that? Thank you so much for your help. peterkaras on "Error Loading ModulesMySQL" http://www.pixelschieber.ch/forum/topic/error-loading-modulesmysql#post-447 Fri, 19 Feb 2010 21:39:50 +0000 peterkaras 447@http://www.pixelschieber.ch/forum/ Hi, I\'m using JCrawler 1.7 with Joomla 1.5. Its looks like a great component However I get the following error: Error Loading ModulesMySQL server has gone away SQL=SELECT id, title, module, position, content, showtitle, control, params FROM jos_modules AS m LEFT JOIN jos_modules_menu AS mm ON mm.moduleid = m.id WHERE m.published = 1 AND m.access <= 2 AND m.client_id = 1 ORDER BY position, ordering A site map is produced, but I\'m not sure if its complete. Do you know what the problem might be ? Any help would be greatly appreciated ! Thanks icw.mod on "Testing jcrawler on local Joomla" http://www.pixelschieber.ch/forum/topic/testing-jcrawler-on-local-joomla#post-445 Sun, 07 Feb 2010 19:14:38 +0000 icw.mod 445@http://www.pixelschieber.ch/forum/ Hi, i try to test JCrawler on my local jommla enviroment. (Joomla2Go). But seems, that this is a problem for jCrawler? Cause it\'s local on 127.0.0.1? Or there some workarounds? Regards Andy jeff71 on "error httpcode: 403, only 1 link" http://www.pixelschieber.ch/forum/topic/error-httpcode-403-only-1-link#post-443 Sun, 31 Jan 2010 12:53:21 +0000 jeff71 443@http://www.pixelschieber.ch/forum/ I use JCRAWLER 1.7 beta. This component ran perfectily. But seen some days I have an error httpcode: 403 on url <a href="http://millepattesmacon.free.fr/" rel="nofollow">http://millepattesmacon.free.fr/</a> And I have only 1 link in the sitemap I used curl method When I used fopen method, no error but only 1 link in my sitemap Thanks for your help and thanks at the creator of this helpfull component Joomla 1.5.15 Jcrawler 1.7 beta website: <a href="http://millepattesmacon.free.fr/" rel="nofollow">http://millepattesmacon.free.fr/</a> patrick on "Testing url\'s wanted" http://www.pixelschieber.ch/forum/topic/testing-urls-wanted#post-163 Fri, 27 Mar 2009 20:17:21 +0000 patrick 163@http://www.pixelschieber.ch/forum/ Hey there, Im looking for testing urls for development purposes. So anyone who wants to have crawled his url please post here. Please post only Joomla based sites. Thank you! greets Patrick frankiep on "only 1 url in google after submission" http://www.pixelschieber.ch/forum/topic/only-1-url-in-google-after-submission#post-442 Fri, 29 Jan 2010 17:56:12 +0000 frankiep 442@http://www.pixelschieber.ch/forum/ Hi- I created a sitemep which gave me 818 urls. I really only have about 30 articles, 75 sobi listings and 25 blog posts. Anyway that is not the problem - Last night I submitted the sitemap to google and it said 818 suubmitted, 50 urls accepted. this morning it says 818 submitted, 1 url accepted. Anyone know what the problem could be. url is <a href="http://www.islandspot.com" rel="nofollow">http://www.islandspot.com</a> I\'m willing to troubleshoot because I\'m pretty happy with this sitemap product just give throw me some ideas. Thanks! Fran festim on "Curl error on url http://clearland.org.uk: Connection time-out after 100044 ms" http://www.pixelschieber.ch/forum/topic/curl-error-on-url-httpclearlandorguk-connection-time-out-after-100044-ms#post-74 Wed, 11 Feb 2009 18:07:59 +0000 festim 74@http://www.pixelschieber.ch/forum/ Hi, am also experiencing \"There are 0 links in your sitemap\" but i also get a Curl error as well as a bunch of other warnings: Notice: Use of undefined constant error - assumed \'error\' in /vhost/vhost8/c/l/e/clearland.org.uk/www/administrator/components/com_jcrawler/admin.jcrawler.php on line 660 Notice: Undefined variable: ret_array in /vhost/vhost8/c/l/e/clearland.org.uk/www/administrator/components/com_jcrawler/admin.jcrawler.php on line 347 Warning: array_merge_recursive() [function.array-merge-recursive]: Argument #1 is not an array in /vhost/vhost8/c/l/e/clearland.org.uk/www/administrator/components/com_jcrawler/admin.jcrawler.php on line 347 Warning: array_merge_recursive() [function.array-merge-recursive]: Argument #1 is not an array in /vhost/vhost8/c/l/e/clearland.org.uk/www/administrator/components/com_jcrawler/admin.jcrawler.php on line 347 Warning: array_merge_recursive() [function.array-merge-recursive]: Argument #1 is not an array in /vhost/vhost8/c/l/e/clearland.org.uk/www/administrator/components/com_jcrawler/admin.jcrawler.php on line 347 Warning: Invalid argument supplied for foreach() in /vhost/vhost8/c/l/e/clearland.org.uk/www/administrator/components/com_jcrawler/admin.jcrawler.php on line 423 Any help please? Much appreciated Festim kaeldaven on "DB Error MySql, server has gone away..." http://www.pixelschieber.ch/forum/topic/db-error-mysql-server-has-gone-away#post-365 Sat, 26 Sep 2009 04:39:36 +0000 kaeldaven 365@http://www.pixelschieber.ch/forum/ Curl error on url <a href="http://www.averagejoeknows.com/automotive/aviation/kitplanes-magazine.html" rel="nofollow">http://www.averagejoeknows.com/automotive/aviation/kitplanes-magazine.html</a>: Connection time-out Error Loading ModulesMySQL server has gone away SQL=SELECT id, title, module, position, content, showtitle, control, params FROM jos_modules AS m LEFT JOIN jos_modules_menu AS mm ON mm.moduleid = m.id WHERE m.published = 1 AND m.access <= 2 AND m.client_id = 1 ORDER BY position, ordering Any help? I don't need help understanding the curl error, I just don't understand the Database error at all. The website is <a href="http://www.averagejoeknows.com" rel="nofollow">http://www.averagejoeknows.com</a> . EZS on "Allowed Memory Problem..." http://www.pixelschieber.ch/forum/topic/allowed-memory-problem#post-424 Fri, 08 Jan 2010 13:55:18 +0000 EZS 424@http://www.pixelschieber.ch/forum/ Hi, i have the Problem that i can´t crawl my site ant this error comes: Fatal error: Allowed memory size of 67108864 bytes exhausted (tried to allocate 198587 bytes) in /var/www/html/.../administrator/components/com_jcrawler/admin.jcrawler.php on line 777 Warning: (null)(): 370 is not a valid cURL handle resource in Unknown on line 0 Warning: (null)(): 371 is not a valid cURL handle resource in Unknown on line 0 Warning: (null)(): 372 is not a valid cURL handle resource in Unknown on line 0 Warning: (null)(): 373 is not a valid cURL handle resource in Unknown on line 0 Warning: (null)(): 374 is not a valid cURL handle resource in Unknown on line 0 Warning: (null)(): 375 is not a valid cURL handle resource in Unknown on line 0 Warning: (null)(): 376 is not a valid cURL handle resource in Unknown on line 0 Warning: (null)(): 377 is not a valid cURL handle resource in Unknown on line 0 Warning: (null)(): 378 is not a valid cURL handle resource in Unknown on line 0 Warning: (null)(): 379 is not a valid cURL handle resource in Unknown on line 0 Warning: (null)(): 380 is not a valid cURL handle resource in Unknown on line 0 Warning: (null)(): 381 is not a valid cURL handle resource in Unknown on line 0 Warning: (null)(): 382 is not a valid cURL handle resource in Unknown on line 0 Warning: (null)(): 383 is not a valid cURL handle resource in Unknown on line 0 Warning: (null)(): 384 is not a valid cURL handle resource in Unknown on line 0 Warning: (null)(): 385 is not a valid cURL handle resource in Unknown on line 0 Warning: (null)(): 386 is not a valid cURL handle resource in Unknown on line 0 Warning: (null)(): 387 is not a valid cURL handle resource in Unknown on line 0 Warning: (null)(): 388 is not a valid cURL handle resource in Unknown on line 0 Warning: (null)(): 389 is not a valid cURL handle resource in Unknown on line 0 Warning: (null)(): 390 is not a valid cURL handle resource in Unknown on line 0 Warning: (null)(): 391 is not a valid cURL handle resource in Unknown on line 0 Warning: (null)(): 392 is not a valid cURL handle resource in Unknown on line 0 Warning: (null)(): 393 is not a valid cURL handle resource in Unknown on line 0 Warning: (null)(): 394 is not a valid cURL handle resource in Unknown on line 0 Warning: (null)(): 395 is not a valid cURL handle resource in Unknown on line 0 Warning: (null)(): 396 is not a valid cURL handle resource in Unknown on line 0 Warning: (null)(): 397 is not a valid cURL handle resource in Unknown on line 0 Warning: (null)(): 398 is not a valid cURL handle resource in Unknown on line 0 Warning: (null)(): 399 is not a valid cURL handle resource in Unknown on line 0 Warning: (null)(): 400 is not a valid cURL handle resource in Unknown on line 0 Warning: (null)(): 401 is not a valid cURL handle resource in Unknown on line 0 Warning: (null)(): 402 is not a valid cURL handle resource in Unknown on line 0 Warning: (null)(): 403 is not a valid cURL handle resource in Unknown on line 0 Warning: (null)(): 404 is not a valid cURL handle resource in Unknown on line 0 Warning: (null)(): 405 is not a valid cURL handle resource in Unknown on line 0 Warning: (null)(): 406 is not a valid cURL handle resource in Unknown on line 0 Warning: (null)(): 407 is not a valid cURL handle resource in Unknown on line 0 Warning: (null)(): 408 is not a valid cURL handle resource in Unknown on line 0 Warning: (null)(): 409 is not a valid cURL handle resource in Unknown on line 0 Warning: (null)(): 410 is not a valid cURL handle resource in Unknown on line 0 Warning: (null)(): 411 is not a valid cURL handle resource in Unknown on line 0 Warning: (null)(): 412 is not a valid cURL handle resource in Unknown on line 0 Warning: (null)(): 413 is not a valid cURL handle resource in Unknown on line 0 Warning: (null)(): 414 is not a valid cURL handle resource in Unknown on line 0 Warning: (null)(): 415 is not a valid cURL handle resource in Unknown on line 0 Warning: (null)(): 416 is not a valid cURL handle resource in Unknown on line 0 Warning: (null)(): 417 is not a valid cURL handle resource in Unknown on line 0 Warning: (null)(): 418 is not a valid cURL handle resource in Unknown on line 0 I don´t know whats the problem and what i can do... james on "a little help" http://www.pixelschieber.ch/forum/topic/a-little-help#post-435 Fri, 22 Jan 2010 14:22:40 +0000 james 435@http://www.pixelschieber.ch/forum/ hello, I have tested this plugin with my joomla version: 1.5.15 I recommend putting in the following fields: levels parallels max connections timeout thank you very much for your help! I drop this error on page after crawling: Warning: Invalid argument supplied for foreach() in /homepages/43/d301128385/htdocs/plugins/system/rereplacer.php on line 939 * httpcode: 500 on url <a href="http://www.masmallorca.es/en/places-of-special-interest.html" rel="nofollow">http://www.masmallorca.es/en/places-of-special-interest.html</a> * httpcode: 500 on url <a href="http://www.masmallorca.es/en/culture.html" rel="nofollow">http://www.masmallorca.es/en/culture.html</a> * httpcode: 500 on url <a href="http://www.masmallorca.es/en/our-people.html" rel="nofollow">http://www.masmallorca.es/en/our-people.html</a> * httpcode: 500 on url <a href="http://www.masmallorca.es/en/gastronomy.html" rel="nofollow">http://www.masmallorca.es/en/gastronomy.html</a> * httpcode: 500 on url <a href="http://www.masmallorca.es/en/local-produce.html" rel="nofollow">http://www.masmallorca.es/en/local-produce.html</a> * httpcode: 500 on url <a href="http://www.masmallorca.es/en/fauna.html" rel="nofollow">http://www.masmallorca.es/en/fauna.html</a> * httpcode: 500 on url <a href="http://www.masmallorca.es/en/flora.html" rel="nofollow">http://www.masmallorca.es/en/flora.html</a> * httpcode: 500 on url <a href="http://www.masmallorca.es/en/excursions.html" rel="nofollow">http://www.masmallorca.es/en/excursions.html</a> * httpcode: 500 on url <a href="http://www.masmallorca.es/en/cycletourism.html" rel="nofollow">http://www.masmallorca.es/en/cycletourism.html</a> * httpcode: 500 on url <a href="http://www.masmallorca.es/ca.html" rel="nofollow">http://www.masmallorca.es/ca.html</a> * httpcode: 500 on url <a href="http://www.masmallorca.es/es.html" rel="nofollow">http://www.masmallorca.es/es.html</a> * httpcode: 500 on url <a href="http://www.masmallorca.es/en.html" rel="nofollow">http://www.masmallorca.es/en.html</a> * httpcode: 500 on url <a href="http://www.masmallorca.es/de.html" rel="nofollow">http://www.masmallorca.es/de.html</a> Etc Etc etc * Error Loading ModulesMySQL server has gone away SQL=SELECT id, title, module, position, content, showtitle, control, params FROM jos_modules AS m LEFT JOIN jos_modules_menu AS mm ON mm.moduleid = m.id WHERE m.published = 1 AND m.access <= 2 AND m.client_id = 1 ORDER BY position, ordering Mensaje * There are 427 links in your sitemap. * Success, wrote /homepages/43/d301128385/htdocs/sitemap.xml * Success, wrote /homepages/43/d301128385/htdocs//administrator/components/com_jcrawler/config.xml * total time: 82.4506 seconds * Success, wrote /homepages/43/d301128385/htdocs/components/com_jcrawler/sitemap.html rkasparek on "XML not passing validation" http://www.pixelschieber.ch/forum/topic/xml-not-passing-validation#post-420 Fri, 11 Dec 2009 22:27:58 +0000 rkasparek 420@http://www.pixelschieber.ch/forum/ Looks like it should pass but clicking on 'validate my sitemap" gives me the following errors.... # Target: <a href="http://mwguild.org/sitemap.xml" rel="nofollow">http://mwguild.org/sitemap.xml</a> (Real name: <a href="http://mwguild.org/sitemap.xml" rel="nofollow">http://mwguild.org/sitemap.xml</a> Length: 19284 bytes Last Modified: Fri, 11 Dec 2009 20:39:23 GMT Server: Apache) # docElt: {http://www.sitemaps.org/schemas/sitemap/0.9}urlset # Validation was strict, starting with type [Anonymous] # schemaLocs: <a href="http://www.sitemaps.org/schemas/sitemap/0.9" rel="nofollow">http://www.sitemaps.org/schemas/sitemap/0.9</a> -> <a href="http://www.sitemaps.org/schemas/sitemap/0.9/sitemap.xsd" rel="nofollow">http://www.sitemaps.org/schemas/sitemap/0.9/sitemap.xsd</a> # The schema(s) used for schema-validation had no errors # 95 schema-validity problems were found in the target with a bunch of these: Problems with the schema-validity of the target <a href="http://mwguild.org/sitemap.xml:7:6" rel="nofollow">http://mwguild.org/sitemap.xml:7:6</a>: Invalid per cvc-complex-type.1.2.4: element {http://www.sitemaps.org/schemas/sitemap/0.9}:changefreq not allowed here (5) in element {http://www.sitemaps.org/schemas/sitemap/0.9}:url, expecting [{Wildcard: ##other, strict},$]: Any ideas? itbc on "Not work Validate" http://www.pixelschieber.ch/forum/topic/not-work-validate#post-389 Fri, 23 Oct 2009 16:59:09 +0000 itbc 389@http://www.pixelschieber.ch/forum/ Validate my sitemap show this problem Schema validating with XSV 3.1-1 of 2007/12/11 16:20:05 Target: <a href="http://www.itbc.travel//sitemap.xml" rel="nofollow">http://www.itbc.travel//sitemap.xml</a> (Real name: <a href="http://www.itbc.travel//sitemap.xml" rel="nofollow">http://www.itbc.travel//sitemap.xml</a> Length: 573 bytes Last Modified: Fri, 23 Oct 2009 15:55:30 GMT Server: Apache) docElt: {http://www.sitemaps.org/schemas/sitemap/0.9}urlset Validation was strict, starting with type [Anonymous] schemaLocs: <a href="http://www.sitemaps.org/schemas/sitemap/0.9" rel="nofollow">http://www.sitemaps.org/schemas/sitemap/0.9</a> -> <a href="http://www.sitemaps.org/schemas/sitemap/0.9/sitemap.xsd" rel="nofollow">http://www.sitemaps.org/schemas/sitemap/0.9/sitemap.xsd</a> The schema(s) used for schema-validation had no errors 1 schema-validity problem was found in the target -------------------------------------------------------------------------------- Schema resources involved Attempt to load a schema document from <a href="http://www.sitemaps.org/schemas/sitemap/0.9/sitemap.xsd" rel="nofollow">http://www.sitemaps.org/schemas/sitemap/0.9/sitemap.xsd</a> (source: schemaLoc) for <a href="http://www.sitemaps.org/schemas/sitemap/0.9" rel="nofollow">http://www.sitemaps.org/schemas/sitemap/0.9</a>, succeeded -------------------------------------------------------------------------------- Problems with the schema-validity of the target <a href="http://www.itbc.travel//sitemap.xml:7:6" rel="nofollow">http://www.itbc.travel//sitemap.xml:7:6</a>: Invalid per cvc-complex-type.1.2.4: element {http://www.sitemaps.org/schemas/sitemap/0.9}:changefreq not allowed here (5) in element {http://www.sitemaps.org/schemas/sitemap/0.9}:url, expecting [{Wildcard: ##other, strict},$]: lucky_root on "Coding problem at creation sitemap.xml" http://www.pixelschieber.ch/forum/topic/coding-problem-at-creation-sitemapxml#post-425 Fri, 08 Jan 2010 19:07:26 +0000 lucky_root 425@http://www.pixelschieber.ch/forum/ I use ch404SEF, thus links are translated into Russian and look like <a href="http://www.pixelsblend.com/казань/web-дизайн/сайт-визитка.html" rel="nofollow">http://www.pixelsblend.com/казань/web-дизайн/сайт-визитка.html</a> It is clear that in sitemap.xml the link looks thus <a href="http://www.pixelsblend.com" rel="nofollow">http://www.pixelsblend.com</a> / % D0%BA%D0%B0%D0%B7%D0%B0%D0%BD%D1%8C/WEB - % D0%B4%D0%B8%D0%B7%D0%B0%D0%B9%D0%BD / % D1%81%D0%B0%D0%B9%D1%82 - % D0%B2%D0%B8%D0%B7%D0%B8%D1%82%D0%BA%D0%B0.html How to result it in correspondence ru-ru That and in sitemap.xml the link looked <a href="http://www.pixelsblend.com/казань/web-дизайн/сайт-визитка.html" rel="nofollow">http://www.pixelsblend.com/казань/web-дизайн/сайт-визитка.html</a> Yours faithfully Dmitry lextof on "public_htmlsitemap.xml is not writable" http://www.pixelschieber.ch/forum/topic/public_htmlsitemapxml-is-not-writable#post-421 Mon, 14 Dec 2009 13:51:23 +0000 lextof 421@http://www.pixelschieber.ch/forum/ Hi, At the end of the error list I see following error: /home/DOMAIN/domains/DOMAIN.nl/public_htmlsitemap.xml is not writable The file did not exist, so I created one by FTP. I set write permission to 777 (hoping it would overwrite it). After a new Crawl the error was still there. What can I do? Gr. Alex VReyes on "500 Internal Server Error" http://www.pixelschieber.ch/forum/topic/500-internal-server-error-1#post-419 Fri, 11 Dec 2009 22:02:46 +0000 VReyes 419@http://www.pixelschieber.ch/forum/ Hello, i am getting a 500 Internal Server Error with some details below. I am using 1.6 and tried the 1.7 version but caused too much resources that my hoster disabled my site. anyways i am back online and using the 1.6 ver but getting the 500 error. any help is appreciated, thank you, VR "The server encountered an internal error or misconfiguration and was unable to complete your request. Please contact the server administrator, <a href="mailto:webmaster@mygamelink.com">webmaster@mygamelink.com</a> and inform them of the time the error occurred, and anything you might have done that may have caused the error. More information about this error may be available in the server error log. Additionally, a 404 Not Found error was encountered while trying to use an ErrorDocument to handle the request." zanardi on "Virtuemart pagination and crawling levels" http://www.pixelschieber.ch/forum/topic/virtuemart-pagination-and-crawling-levels#post-418 Thu, 10 Dec 2009 13:41:10 +0000 zanardi 418@http://www.pixelschieber.ch/forum/ Hi, i'd like to tell all JCrawler users about an issue, not exactly a bug, with JCrawler and VirtueMart pagination. Well, it could be an issue with any pagination system, but my experience is about VirtueMart. Obviously this is an extreme case, which most VM shops will never experience at all, but... my did :-) When you browse a shop category with VirtueMart, in any given page you have links to: - the previous page - the next page - all the pages in the same "decade" (e.g. 1-10, or 11-20...) To see the next "decade" you have to go to the last one of this decade and then press "next page". So, to get to the 32nd page of a given category, your straightest path will be: 1. Home page -> click on "Shop" menu item 2. Shop -> click on category link 3. Category 1st page -> click on "10" page link 4. Category 10th page -> click on "next" page link 5. Category 11th page -> click on "20" page link 6. Category 20th page -> click on "next" page link 7. Category 21th page -> click on "30" page link 8. Category 30th page -> click on "32" page link Unless i'm wrong, this means 8 crawling levels. So not only awfully long to complete, but not available at all with JCrawler. A workaround is modify pageNavigation class in VirtueMart, so that it shows more pages links (e.g. 1 to 30 instead of 1 to 10). I thought i just shared this, to avoid headaching about why some product page are missing from my sitemap. Metal Wing on "Jcrawler exceptions" http://www.pixelschieber.ch/forum/topic/jcrawler-exceptions#post-414 Mon, 07 Dec 2009 21:33:30 +0000 Metal Wing 414@http://www.pixelschieber.ch/forum/ Hi, I have not been able to get JCrawler to avoid crawling certain areas of my site. I have Joomla SEF URLs enabled and also have JEvents installed, so when JCrawlers begins crawling it picks up every single calendar url for the past and future 10 years lol There are errors like # Curl error on url <a href="http://www.animewave.net/events/day.listevents/2009/11/06/-.html" rel="nofollow">http://www.animewave.net/events/day.listevents/2009/11/06/-.html</a>: Connection time-out # Curl error on url <a href="http://www.animewave.net/events/day.listevents/2009/11/07/-.html" rel="nofollow">http://www.animewave.net/events/day.listevents/2009/11/07/-.html</a>: Connection time-out # Curl error on url <a href="http://www.animewave.net/events/week.listevents/2009/11/8/-.html" rel="nofollow">http://www.animewave.net/events/week.listevents/2009/11/8/-.html</a>: Connection time-out And URLs that were indexed are <a href="http://www.animewave.net/events/day.listevents/2009/12/15/-.html" rel="nofollow">http://www.animewave.net/events/day.listevents/2009/12/15/-.html</a> <a href="http://www.animewave.net/events/day.listevents/2009/12/16/-.html" rel="nofollow">http://www.animewave.net/events/day.listevents/2009/12/16/-.html</a> What I haven't been able to do is to make it so JCrawler COMPLETELY avoids the calendar extension. I have tried telling it to avoid the SEF link <a href="http://www.animewave.net/events/" rel="nofollow">http://www.animewave.net/events/</a> I have tried telling it to avoid a component link <a href="http://animewave.net/index.php?option=com_jevents&task=month.calendar" rel="nofollow">http://animewave.net/index.php?option=com_jevents&task=month.calendar</a> Any help? Because I really would love to index my site with JCrawler, but I really don't want 10000 URLs just for the calendar... f.b. on "Crawling ..." http://www.pixelschieber.ch/forum/topic/crawling#post-409 Sat, 28 Nov 2009 10:44:31 +0000 f.b. 409@http://www.pixelschieber.ch/forum/ I start crawling, but crawling dont stop. JCrawler just say Crawling ... Any hint? Tnx mikeklimczak on "Are there no installation instructions?" http://www.pixelschieber.ch/forum/topic/are-there-no-installation-instructions#post-408 Wed, 25 Nov 2009 10:57:11 +0000 mikeklimczak 408@http://www.pixelschieber.ch/forum/ I am not sure if I have completed the installation properly, I cannot find an installation guide. I have simple performed a component installation in the Joomla backend. When I try to crawl my site, I get a progress bar that says "crawling..." but after twenty seconds or so I get a completely blank page. I have played with timeout settings and curl/fopen settings. Without instructions I am not really sure what these do. zoomlanski on "Generated Link Adds Extra Backslash - extra /" http://www.pixelschieber.ch/forum/topic/generated-link-adds-extra-backslash-extra#post-406 Sun, 22 Nov 2009 23:29:27 +0000 zoomlanski 406@http://www.pixelschieber.ch/forum/ When jcrawler 1.7b finishes it generates the link <a href="http://www.local277.com//sitemap.xml" rel="nofollow">http://www.local277.com//sitemap.xml</a> I know to remove the extra / but I don't know if it is affecting any aspects on link submission, robot rewrite. erturan on "Missing URLs" http://www.pixelschieber.ch/forum/topic/missing-urls-1#post-399 Sun, 15 Nov 2009 22:13:35 +0000 erturan 399@http://www.pixelschieber.ch/forum/ First of all, thanks for this great component. On my website, I use - joomla 1.5.14 - jcrawler 1.7 beta - seyret component - mighty extensions resources My website: <a href="http://www.muzikenstrumanlari.com/muzikdunyasi/" rel="nofollow">http://www.muzikenstrumanlari.com/muzikdunyasi/</a> It seems none of my pages (.../sarki-sozleri.html) which are created using mighty extensions resources are crawled/listed in sitemap. Jcrawler works great for all other URLs like seyret component (.../muzik-videolari/). Here is my sitemap: <a href="http://www.muzikenstrumanlari.com/muzikdunyasi/sitemap.xml" rel="nofollow">http://www.muzikenstrumanlari.com/muzikdunyasi/sitemap.xml</a> What may cause this? Thanks in advance. zoomlanski on "Redirect or Multiple Domain Websites" http://www.pixelschieber.ch/forum/topic/redirect-or-multiple-domain-websites#post-407 Mon, 23 Nov 2009 00:38:54 +0000 zoomlanski 407@http://www.pixelschieber.ch/forum/ Hello": Great extension. Thank you for continuting to develop it. I have Jcrawler 1.7b installed on my primary domain. It seems to crawl it perfectly. But have multiple domains pointing to the primary. When I access the other domains via the joomla admininistrator and run jcrawler, it stalls and stop working. This is despite that it does list the HTTP as whichever domain I am logged in with. Does this make sense? Should it be able to use whichever domain is the current HTTP, or must it only be the primary? Thanks Tim zszalbot on "blank page" http://www.pixelschieber.ch/forum/topic/blank-page#post-397 Thu, 12 Nov 2009 08:36:00 +0000 zszalbot 397@http://www.pixelschieber.ch/forum/ Hello, on my server I cannot use curl (not available) so I use fopen. Anyway, I am using the latest build version of JCrawler, it will generate the xml site map but it won't submit it - when I click submit, I always end up with a blank page. Is there anything that can be done to solve it? Thank you! omkar on "Issues with JCrawler" http://www.pixelschieber.ch/forum/topic/issues-with-jcrawler#post-342 Tue, 01 Sep 2009 14:01:57 +0000 omkar 342@http://www.pixelschieber.ch/forum/ First of all, thank you for making joomla life a bit easier ... I am currently testing your component and found this issues: - The downloaded version on joomla.org does not validate and creates a double slash before sitemap.xml when submitting to google. Entry looks like, sitemap: xy.com//sitemap.xml instead of xy.com/sitemap.xml ... Fixed this manually. - The latest build version downloaded here created just one link instead of some more with the former version. So, I`m a bit puzzled. Homepage where it is tested on: <a href="http://www.omkarmusic.com" rel="nofollow">http://www.omkarmusic.com</a> Thanks for your time RobMack on "getting a server error when trying to crawl site" http://www.pixelschieber.ch/forum/topic/getting-a-server-error-when-trying-to-crawl-site#post-390 Sat, 24 Oct 2009 16:47:02 +0000 RobMack 390@http://www.pixelschieber.ch/forum/ I just installed the crawler, and attempted to crawland I am getting the following error after about 30-40 seconds: ------------ "Internal Server Error The server encountered an internal error or misconfiguration and was unable to complete your request. Please contact the server administrator, <a href="mailto:support@supportwebsite.com">support@supportwebsite.com</a> and inform them of the time the error occurred, and anything you might have done that may have caused the error. More information about this error may be available in the server error log. Apache/1.3.33 Server at fcmponline.com Port 80" ---------------- I am a bit concerned about the first field -- "Document root" it doesn't look right to me because it points to only one file. The file looks like it could be one of mine by the name, but when I go into my root, I can't find that path of directories to follow, and it looks out of sequence. Am I supposed to overwrite this path? What is the meaning of "Document root" as it is needed for this crawl? I think of documents as the article I write in Joomla, which really have no path other than to the database. Help is needed here -- many thanks --Rob vburshteyn on "issues" http://www.pixelschieber.ch/forum/topic/issues#post-391 Mon, 02 Nov 2009 20:33:53 +0000 vburshteyn 391@http://www.pixelschieber.ch/forum/ Hi, thanks in advance to all. So i am using version 1.7 Every time i run this app it redirects me to index2.php any ideas? Anonymous on "JCrawler Sitemap 1 entry" http://www.pixelschieber.ch/forum/topic/jcrawler-sitemap-1-entry#post- Wed, 31 Dec 1969 22:59:59 +0000 Anonymous @http://www.pixelschieber.ch/forum/ dsided on "Upgrading to latest build and parse error" http://www.pixelschieber.ch/forum/topic/upgrading-to-latest-build-and-parse-error#post-370 Tue, 29 Sep 2009 23:30:59 +0000 dsided 370@http://www.pixelschieber.ch/forum/ I have uninstalled and reinstalled the new version of jcrawler (<a href="http://www.pixelschieber.ch/com_jcrawler_latestbuild.zip" rel="nofollow">http://www.pixelschieber.ch/com_jcrawler_latestbuild.zip</a>) but now when you try to access the component you get the following error Parse error: parse error, unexpected '&', expecting T_VARIABLE or '$' in /var/www/apache2-default/HOGGTRANS/administrator/components/com_jcrawler/admin.jcrawler.php on line 324 Any ideas? kenjoomla on "JCrawler Sitemap 1 entry" http://www.pixelschieber.ch/forum/topic/jcrawler-sitemap-1-entry#post-382 Sun, 11 Oct 2009 19:43:40 +0000 kenjoomla 382@http://www.pixelschieber.ch/forum/ I am new to Joomla and just installed JCrawler. The installation was easy and it appeared to make a sitemap, problem is it has only 1 entry which is the domain ending with a slash, the root. How do I get it to include the pages which are in the Joomla database? The way it is it really does nothing for me and I am pretty sure there is a method of getting it to include all of my pages. I guess I am missing something. I am testing on my localhost before I install it to my site. Thanks for your help, Ken