http://www.pixelschieber.ch/forum/ Help forums for JCrawler en Fri, 10 Sep 2010 20:10:31 +0000 http://www.pixelschieber.ch/forum/topic/jcrawler-not-crawling-site-error-403-one-link-found#post-294 Sun, 21 Jun 2009 23:35:36 +0000 patrick 294@http://www.pixelschieber.ch/forum/ <p>Hey Josh,</p> <p>can you send me an email of your rewrite\&#39;s?<br /> or maybe you can try the latest release?:</p> <p><a href="http://www.pixelschieber.ch/com_jcrawler_latestbuild.zip" rel="nofollow">http://www.pixelschieber.ch/com_jcrawler_latestbuild.zip</a></p> <p>Greets Patrick </p> http://www.pixelschieber.ch/forum/topic/jcrawler-not-crawling-site-error-403-one-link-found#post-286 Sun, 14 Jun 2009 04:51:10 +0000 passmaster16 286@http://www.pixelschieber.ch/forum/ <p>Hi Patrick,</p> <p>My actual site is located at <a href="http://www.lebanonpc.org/Joomla_lpc" rel="nofollow">http://www.lebanonpc.org/Joomla_lpc</a> but I use modrewrite to do 301 redirects to <a href="http://www.lebanonpc.org" rel="nofollow">http://www.lebanonpc.org</a> to eliminate confusion and make it easier for visitors to find us. I don\&#39;t have any additional SEF components installed. I am using the built-in SEO options for Joomla. HTTP Host (readonly) has <a href="http://www.lebanonpc.org" rel="nofollow">http://www.lebanonpc.org</a> listed so maybe the modrewrite is still causing a problem for the crawler when installed locally? I did not modify the .htaccess in the Joomla directory but I do have a modified .htaccess in the root of my public directory to handle the modrewrite redirection.</p> <p>Thanks<br /> Josh </p> http://www.pixelschieber.ch/forum/topic/jcrawler-not-crawling-site-error-403-one-link-found#post-282 Sat, 13 Jun 2009 18:26:58 +0000 patrick 282@http://www.pixelschieber.ch/forum/ <p>hmm it seems to be an rewrite-error. is there a SEF component installed?</p> <p>i crawled your site and got </p> <p>There are 729 links in your sitemap.<br /> total time: 163.5603 seconds</p> <p>what is written in the \&quot;HTTP host (readonly)\&quot; field? did you modify your .htaccess?</p> <p>greets Patrick </p> http://www.pixelschieber.ch/forum/topic/jcrawler-not-crawling-site-error-403-one-link-found#post-281 Sat, 13 Jun 2009 06:06:53 +0000 passmaster16 281@http://www.pixelschieber.ch/forum/ <p>Still having issues with Jcrawler 1.7. In fact Jcrawler has not worked for me since 1.4. I think it\\&#39;s due to me using modrewrite. I posted the information from the last message I posted on here back in Oct 2008 when I upgraded from 1.4 to 1.5. Jcrawler has not worked for me since. I even tried the latest 1.7 version which you modified a few days ago to fix relative paths...still same thing :(</p> <p>Thanks</p> <p>Here is the current error I get with 1.7:</p> <p> * httpcode: 403 on url <a href="http://www.lebanonpc.org/" rel="nofollow">http://www.lebanonpc.org/</a></p> <p>Message</p> <p> * There are 1 links in your sitemap.<br /> * Success, wrote /home/lebanonp/public_html/Joomla_lpc/sitemap.xml<br /> * Success, wrote /home/lebanonp/public_html/Joomla_lpc//administrator/components/com_jcrawler/config.xml<br /> * total time: 0.0213 seconds</p> <p>****************************************************************<br /> Here is my post from a while ago that you responded to.</p> <p># Josh B. posted the following on 19. October 2008 at 21:00.</p> <p>Hi, thanks for this tool. I am using modrewrite to point requests to a subdirectory. This appears to confuse Jcrawler 1.5. When I go into the configuration, HTTP host is set to the actual subdirectory where the Joomla install resides. However, crawling fails because modrewrite is hiding that directory. The live_site variable is set to the URL without the subdirectory yet 1.5 must not check this. I did not have this problem with 1.4 beta. Did something change in 1.5 in how you determine the site’s URL?</p> <p> 1. patrick posted the following on 21. October 2008 at 15:37.</p> <p> Hi Josh,</p> <p> yes, i changed the method, it takes the website from the php variable $_SERVER[\\&#39;HTTP_HOST\\&#39;],</p> <p> but i found a clear solution now, i’ll change it back in the next release. If you want to change it by yourself please write me an email.</p> <p> Greets Patrick</p> <p> PS: Sorry for the delayed answer.<br /> 1. Josh. B. posted the following on 21. October 2008 at 17:12.</p> <p> Hi Patrick. Thanks for your reply. I’ve just reverted back to 1.4 beta for now. I’ll wait for your next release for the URL fix. Thanks again for this helpful component!Josh </p>