1. 

   scb31
   Member

   Just tried JCrawler 1.7 Beta on my Joomla 1.5.10 website at http://www.grovetavern.co.uk but only get this 1 link returned with following message:

   * There are 1 links in your sitemap.
   * Success, wrote /home/sites/grovetavern.co.uk/public_html/sitemap.xml
   * Success, wrote /home/sites/grovetavern.co.uk/public_html//administrator/components/com_jcrawler/config.xml
   * total time: 3.0411 seconds
   * robots.txt contains already sitemap location

   Just tested my site with xml-sitemaps.com and exceeded the maximum of 500 links. What am I doing wrong?

   My site is running php5 - could this be the problem (as read elsewhere)?

   Posted 1 year ago #
2. 

   patrick
   Key Master

   hey, i found the problem,
   JCrawler 1.7 has a problem with relative links :(

   I\'ll fix this!

   Greets Patrick

   Posted 1 year ago #
3. 

   scb31
   Member

   Thanx Patrick

   Any idea when fix may be available?

   Keep up excellent work.

   Steve

   Posted 1 year ago #
4. 

   patrick
   Key Master

   Hey Steve,

   My Mac\'s LCD Crashed, So im back to Windows with no PHP envirement.
   My Mac is back in 2 weeks they said, so it will be, (I hope) at the end of May :|

   Greets Patrick

   Posted 1 year ago #
5. 

   scb31
   Member

   Sorry to hear about your Mac but can you not download php for Windows http://www.php.net?

   Look forward to fix regardless.

   Steve

   Posted 1 year ago #
6. 

   ssnobben
   Member

   Thanks I have this problem too and wondered if it any problem with another extension I have but hope for a solution soon then!

   http://www.pixelschieber.ch/forum/topic/jdefender-and-jcrawler-17beta-working?replies=1#post-256

   Rgds!

   Posted 1 year ago #
7. 

   scb31
   Member

   Any news on this yet Patrick?

   Best Rgds

   Steve

   Posted 1 year ago #
8. 

   patrick
   Key Master

   hey steve, thanks for asking :)

   my mac has his new Display and I could fix this issue!

   i just crawled your site:

   There are 268 links in your sitemap.
   total time: 36.6961 seconds

   you can try out the latest build:
   http://joomlacode.org/gf/project/jcrawler/scmsvn/?action=browse&path=%2F%2Acheckout%2A%2Fjcrawler%2Freleases%2Fcom_jcrawler_latestbuild.zip&revision=17

   Greets Patrick

   Posted 1 year ago #
9. 

   scb31
   Member

   Sorry to be a pain Patrick!!

   First of all, couldn\'t get the above link to work but managed to download via SVN. Installed but still get same output.

   What am I missing?

   Thanks for your help.

   Steve

   Posted 1 year ago #
10. 

    patrick
    Key Master

    Hey Steve,

    not sure if you have realy the the latest build, can you tell me if your problem
    persists with this release:

    http://www.pixelschieber.ch/com_jcrawler_latestbuild.zip

    Thank you!

    Greets Patrick

    Posted 1 year ago #
11. 

    scb31
    Member

    Thanks for reply Patrick.

    Installed that version (still says 1.7 Beta, dated 20/4/2009) but no better. I get the following result:

    * There are 1 links in your sitemap.
    * Success, wrote /home/sites/grovetavern.co.uk/public_html/sitemap.xml
    * Success, wrote /home/sites/grovetavern.co.uk/public_html//administrator/components/com_jcrawler/config.xml
    * total time: 3.0267 seconds
    * robots.txt contains already sitemap location

    Error

    * /home/sites/grovetavern.co.uk/public_html/components/com_jcrawler/sitemap.html is not writable

    Posted 1 year ago #
12. 

    patrick
    Key Master

    hey scb31,

    hmm I dont see any problems!

    its possible to get an account for testing on your site?
    so I could login in your backend and I would resolve the problem more quickly?

    Greets Patrick

    Posted 1 year ago #
13. 

    scb31
    Member

    Please can you forward your email address to me at steve.baxter@grovetavern.co.uk and I will send you a username & password (rather than post it publically on forum).

    Thanks Patrick

    Posted 1 year ago #
14. 

    scb31
    Member

    Any progress on this Patrick?

    Posted 1 year ago #
15. 

    patrick
    Key Master

    ...I did a lot of testing, it seems that you can\'t connect with curl to your own site.
    When you try to crawl with fopen, you recieve a \"couldn\'t connect\" message.

    I will implement an other connection methond for testing.

    During that, maybe you can ask your provider if he has a firewall or something like that on the host?

    Greets Patrick

    Posted 1 year ago #
16. 

    scb31
    Member

    Hi Patrick

    Thanks for testing. Received the following answer when raised query with hosts support:

    Thanks for contacting us. Yes, that is correct. Our servers firewall out http requests back to the same server so this would not function by calling a script/file from your own site using the full URL, this is prevented to stop infinite loops from being accidentally created that could bring down the server.

    The search engine submission within your control panel submits to ten search engines, these are Google, Yahoo, Altavista, Submit Me, Excite, Lycos, AOL, Alexa, EuroSeek and MSN, though be aware that the list does change over time.

    Where does this leave us?

    Posted 1 year ago #
17. 

    patrick
    Key Master

    hey steve,

    perhaps you can ask your hosts support if they open the channel through your site in the firewall, if not you can't use JCrawler.

    I'm sorry, but this is a key feature of JCrwler!

    I can do nothing else :(

    greets Patrick

    Posted 1 year ago #

RSS feed for this topic

Reply

You must log in to post.