JCrawler Forum Topic: blank loc for some links

JCrawler Forum Topic: blank loc for some links http://www.pixelschieber.ch/forum/ Help forums for JCrawler en Fri, 10 Sep 2010 20:34:35 +0000 Rogier on "blank loc for some links" http://www.pixelschieber.ch/forum/topic/blank-loc-for-some-links#post-171 Mon, 30 Mar 2009 15:43:00 +0000 Rogier 171@http://www.pixelschieber.ch/forum/ Fixed Component: <a href="http://www.pixelschieber.ch/forum/topic/jcrawler-16b-beta#post-172" rel="nofollow">http://www.pixelschieber.ch/forum/topic/jcrawler-16b-beta#post-172</a> Rogier on "blank loc for some links" http://www.pixelschieber.ch/forum/topic/blank-loc-for-some-links#post-170 Mon, 30 Mar 2009 15:20:36 +0000 Rogier 170@http://www.pixelschieber.ch/forum/ This is the corrected code: (line 423) foreach ($urls as $loc){ /* urf-8 encoding */ //$loc=htmlentities($loc,ENT_QUOTES,\'UTF-8\'); //$loc=htmlspecialchars($loc,ENT_QUOTES,\'UTF-8\',false); $loc[\'url\']=htmlspecialchars($loc[\'url\']); if (strlen(trim($loc[\'url\'])) > 0){ $i++; $modified_at = date(\'Y-m-d\\Th:i:s\\Z\'); $xml_string .= \" <url> <loc>\".$loc[\'url\'].\"</loc> <lastmod>$modified_at</lastmod> <priority>\".$priority.\"</priority> <changefreq>\".$freq.\"</changefreq> </url>\"; } } Rogier on "blank loc for some links" http://www.pixelschieber.ch/forum/topic/blank-loc-for-some-links#post-168 Mon, 30 Mar 2009 14:29:05 +0000 Rogier 168@http://www.pixelschieber.ch/forum/ Tried to use that fix, but: Warning: Unexpected character in input: \'\\\' (ASCII=92) state=1 in /home/********/domains/********/public_html/administrator/components/com_jcrawler/admin.jcrawler.php on line 429 Parse error: syntax error, unexpected T_STRING, expecting \']\' in /home/********/domains/********/public_html/administrator/components/com_jcrawler/admin.jcrawler.php on line 527 Can somebody tell what goes wrong on line 429 and 527? FSGDAG on "blank loc for some links" http://www.pixelschieber.ch/forum/topic/blank-loc-for-some-links#post-125 Mon, 02 Mar 2009 17:23:23 +0000 FSGDAG 125@http://www.pixelschieber.ch/forum/ Forget my post above... :) I found what I was doing wrong and fixed it :) No more blank lines :) FSGDAG on "blank loc for some links" http://www.pixelschieber.ch/forum/topic/blank-loc-for-some-links#post-124 Mon, 02 Mar 2009 17:08:31 +0000 FSGDAG 124@http://www.pixelschieber.ch/forum/ I\'ve made the changes above, but now I\'m getting an error when trying to run jcrawler. Here is my code: _____________ foreach ($urls as $loc){ /* urf-8 encoding */ //$loc=htmlentities($loc,ENT_QUOTES,\\\'UTF-8\\\'); //$loc=htmlspecialchars($loc,ENT_QUOTES,\\\'UTF-8\\\',false); $loc[\\\'url\\\']=htmlspecialchars($loc[\\\'url\\\']); if (strlen(trim($loc[\\\'url\\\'])) > 0){ $i++; $modified_at = date(\\\'Y-m-d\\\\Th:i:s\\\\Z\\\'); $xml_string .= \\\" <url> <loc>\\\".$loc[\\\'url\\\'].\\\"</loc> <lastmod>$modified_at</lastmod> <priority>\\\".$priority.\\\"</priority> <changefreq>\\\".$freq.\\\"</changefreq> </url>\\\"; } } _________________ And here is the error messages I\'m getting when trying to run jcrawler: Warning: Unexpected character in input: \'\\\' (ASCII=92) state=1 in /home/xxxx/public_html/administrator/components/com_jcrawler/admin.jcrawler.php on line 428 Parse error: syntax error, unexpected T_STRING, expecting \']\' in /home/xxxx/public_html/administrator/components/com_jcrawler/admin.jcrawler.php on line 527 jerren on "blank loc for some links" http://www.pixelschieber.ch/forum/topic/blank-loc-for-some-links#post-116 Thu, 26 Feb 2009 03:00:43 +0000 jerren 116@http://www.pixelschieber.ch/forum/ What\'s the official problem/fix Patrik? I\'m seeing the same problem. patrick on "blank loc for some links" http://www.pixelschieber.ch/forum/topic/blank-loc-for-some-links#post-107 Tue, 24 Feb 2009 11:00:01 +0000 patrick 107@http://www.pixelschieber.ch/forum/ thanks, yeah thats a fix! but i found the true problem, that leads to the empty loc\'s and fixed it already! greets Patrick Jalby on "blank loc for some links" http://www.pixelschieber.ch/forum/topic/blank-loc-for-some-links#post-106 Tue, 24 Feb 2009 05:18:16 +0000 Jalby 106@http://www.pixelschieber.ch/forum/ This definitely cleared up my missing locs, the sitemap validates and I saved 300 MB of error log! Thanks mate. Does this now constitute 1.7 Beta? lumo on "blank loc for some links" http://www.pixelschieber.ch/forum/topic/blank-loc-for-some-links#post-103 Sat, 21 Feb 2009 13:43:17 +0000 lumo 103@http://www.pixelschieber.ch/forum/ Well done BHorst, this fixed my blank loc problem, Thanks BHorst on "blank loc for some links" http://www.pixelschieber.ch/forum/topic/blank-loc-for-some-links#post-98 Wed, 18 Feb 2009 15:49:13 +0000 BHorst 98@http://www.pixelschieber.ch/forum/ I changed the File /administrator/components/com_jcrawler/admin.jcrawler.php, to have no longer empty locs: Find in line 423: \"foreach ($urls as $loc){\" Delete the line with \"i++;\" Add \"if (strlen(trim($loc[\'url\'])) > 0){ i++;\" after \"$loc[\'url\']=htmlspecialchars($loc[\'url\']);\" Add \"}\" after \"</url>\";\" When you\'re finished it should look like this: foreach ($urls as $loc){ /* urf-8 encoding */ //$loc=htmlentities($loc,ENT_QUOTES,\'UTF-8\'); //$loc=htmlspecialchars($loc,ENT_QUOTES,\'UTF-8\',false); $loc[\'url\']=htmlspecialchars($loc[\'url\']); if (strlen(trim($loc[\'url\'])) > 0){ $i++; $modified_at = date(\'Y-m-d\\Th:i:s\\Z\'); $xml_string .= \" <url> <loc>\".$loc[\'url\'].\"</loc> <lastmod>$modified_at</lastmod> <priority>\".$priority.\"</priority> <changefreq>\".$freq.\"</changefreq> </url>\"; } } Now no more empty loc\'s BHorst on "blank loc for some links" http://www.pixelschieber.ch/forum/topic/blank-loc-for-some-links#post-97 Wed, 18 Feb 2009 15:30:00 +0000 BHorst 97@http://www.pixelschieber.ch/forum/ No errors on generation, but the same empty loc\'s... <url> <loc></loc> <lastmod>2009-02-18T10:53:18Z</lastmod> <priority>0.5</priority> <changefreq>daily</changefreq> </url> Very good component!! Thanks a lot! mohanarun on "blank loc for some links" http://www.pixelschieber.ch/forum/topic/blank-loc-for-some-links#post-96 Wed, 18 Feb 2009 09:06:29 +0000 mohanarun 96@http://www.pixelschieber.ch/forum/ Hi same problem here - other URLs have loc some urls not having loc but during generation it generates these curl errors and I have curl installed and properly working till now Curl error on url <a href="http://www.nimltdengineering.com/smoking-shelters/free-standing-smoking-shelter-1x25m.html" rel="nofollow">http://www.nimltdengineering.com/smoking-shelters/free-standing-smoking-shelter-1x25m.html</a>: couldn\'t connect to host Curl error on url <a href="http://www.nimltdengineering.com/smoking-shelters/free-standing-smoking-shelter-2x25m.html" rel="nofollow">http://www.nimltdengineering.com/smoking-shelters/free-standing-smoking-shelter-2x25m.html</a>: couldn\'t connect to host Curl error on url <a href="http://www.nimltdengineering.com/smoking-shelters/free-standing-smoking-shelter-3x25m.html" rel="nofollow">http://www.nimltdengineering.com/smoking-shelters/free-standing-smoking-shelter-3x25m.html</a>: couldn\'t connect to host Curl error on url <a href="http://www.nimltdengineering.com/smoking-shelters/free-standing-smoking-shelter-4x25m.html" rel="nofollow">http://www.nimltdengineering.com/smoking-shelters/free-standing-smoking-shelter-4x25m.html</a>: couldn\'t connect to host Curl error on url <a href="http://www.nimltdengineering.com/smoking-shelters/free-standing-smoking-shelter-9-x-25m.html" rel="nofollow">http://www.nimltdengineering.com/smoking-shelters/free-standing-smoking-shelter-9-x-25m.html</a>: couldn\'t connect to host Curl error on url <a href="http://www.nimltdengineering.com/smoking-shelters/premium-smoking-shelter-1x25m.html" rel="nofollow">http://www.nimltdengineering.com/smoking-shelters/premium-smoking-shelter-1x25m.html</a>: couldn\'t connect to host Curl error on url <a href="http://www.nimltdengineering.com/smoking-shelters/premium-smoking-shelter-2x25m.html" rel="nofollow">http://www.nimltdengineering.com/smoking-shelters/premium-smoking-shelter-2x25m.html</a>: couldn\'t connect to host Curl error on url <a href="http://www.nimltdengineering.com/smoking-shelters/premium-smoking-shelter-3x25m.html" rel="nofollow">http://www.nimltdengineering.com/smoking-shelters/premium-smoking-shelter-3x25m.html</a>: couldn\'t connect to host Curl error on url <a href="http://www.nimltdengineering.com/smoking-shelters/premium-smoking-shelter-4x25m.html" rel="nofollow">http://www.nimltdengineering.com/smoking-shelters/premium-smoking-shelter-4x25m.html</a>: couldn\'t connect to host amackie on "blank loc for some links" http://www.pixelschieber.ch/forum/topic/blank-loc-for-some-links#post-95 Wed, 18 Feb 2009 07:19:13 +0000 amackie 95@http://www.pixelschieber.ch/forum/ My generated sitemap has empty loc tags in the middle of the document and some page links are missing from the links that are displayed. Otherwise it works fine - the links before and after the blank section are good. The blanks look like this: <url> <loc></loc> <lastmod>2009-02-17T10:15:50Z</lastmod> <priority>0.5</priority> <changefreq>daily</changefreq> </url> Any ideas? (And thanks for the great component.)