Jiglu: Jiglu support: Discussion: Re: Spider error

Hi Leigh.

What has happened here is that we have encountered a bug when spidering your site, so the process is failing when it shouldn't. The widget is indeed on every one of your pages, and this is entirely our fault. Sorry about that.

We have come up with a fix for this, which we will install on Jiglu within the next two days after testing, then if you can bear with us, I will tell the system to re-spider your site.

Once again, sorry about this, but thankyou for letting us know.

Best regards,

Graham.

----- Original Message -----
From: Leigh Jamgochian
To: Jiglu Support
Sent: Tuesday, October 23, 2007 4:15 PM
Subject: Re: [Support] Spider error

I'm having the same problem
Connection code: 200 OK
Spider connected successfully.
There were too many permalink pages downloaded without the widget. Has the widget been added to all permalink pages in the site? Attempted to download 56 pages.
Successful: 52
Non-html: 4
Created 20 external contributions.
I have the widget on every page I placed it into the right sidebar on every page but on some pages it just says no tags and on others it says that I can view the tag map AND there are no tags.
Am I not waiting long enough?
Andrew Baisley <...> said:
Hrm… now it seems to be working. Must have been a cache issue on my
part for not seeing it. Nevermind to my question below. I'll go run the
spider again.
Thanks again for the help.
Andrew
Andrew Baisley <...> said:
Ah, yes, I see the problem now. Thank you Graham.
Does anyone on this board know how to add, in Blogger, widgets to the
sidebar that will show across all pages? I notice that my BuzzFeed
widget does, but I don't see any special tags around it. I moved the
Jiglu widget right below BuzzFeed – both are outside the
<MainOrArchivePage> tag.
Any ideas? I tried Googling the answer, but haven't come up with
anything yet.
Thanks,
Andrew
Graham Uphill <...> said:
Spider errorHi Andrew.
The downloading process requires that the widget be added to all individual permalink pages that are to have their content analysed. If too many of these pages are downloaded without the widget being present, it means we will not have enough content to generate any useful tags, so we halt the download process and flag the error you saw until the problem can be fixed.
In your case, while the widget is on the home page, it has not yet been added to the individual permalink pages. For example: http://www.andrewbaisley.com/2007/10/mac-vs-pc-on-web-20-websites.html does not have the Jiglu widget on it.
If you can put the widget on these pages, then log into Jiglu and click on the link to "Change the site details", then click Save, the download process will try again.
I can see how the error message you got hasn't made things very clear, and we will look into phrasing that better. The 5 is a bit of a red herring in this case, it is actually 5 non-html pages which the process will completely ignore anyway. The only important bit about the log in your case is the bit about the fact it couldn't find the widget on the permalink pages.
Hope this has helped. Please let us know if you have any further problems or questions.
Best regards,
Graham.
----- Original Message -----
From: Andrew Baisley
To: Jiglu Support
Sent: Tuesday, October 16, 2007 6:51 PM
Subject: [Support] Spider error
Hi,
I am getting the following message:
Status: Spider error
Connection code: 200 OK
Spider connected successfully.
There were too many permalink pages downloaded without the widget. Has the widget been added to all permalink pages in the site? Attempted to download 37 pages.
Successful: 32
Non-html: 5
Created 0 external contributions.
I put the widget in my sidebar, which is on all pages, so maybe the spider is finding pages on the server that aren't actually part of the site? It doesn't even tell me which pages so I can check…
The site is http://www.andrewbaisley.com
Any suggestions?
On a side note, how is 5 out of 37 pages "too many permalink pages downloaded without the widget"? It's not that many…. this is a cryptic error message.
Thanks,
Andrew
www.jiglu.com – communities that think for themselves
www.jiglu.com – communities that think for themselves