Flags and Lollipops

Sunday, December 03, 2006

Rating bookmarks on Connotea

I've taken up knitting. The first few hours were pretty frustrating but I think that I've gotten the hang of it now. The nice thing about it is that it gives you time to think while you're working.

So, anyway, during my new found thinking time I was wondering:

Would it be useful to have ratings attached to your del.icio.us or Connotea bookmarks?

Rather than doing any kind of 'proper' research I figured that I'd tackle things in an agile, web 2.0 stylee and (a) go ahead and implement something and (b) ask questions of potential users later.

Whoever supplies the best set of answers / opinions in the comments gets a free hand knitted mouse cosy (possibly, eventually).

An implementation

connotea-ratings.user.js is a Greasemonkey script that adds AJAX ratings to bookmarks on Connotea. A "rate this link" prompt will appear under every Connotea bookmark along with five stars that light up when you mouse over them. Click to assign bookmarks ratings.



If you rate an item that isn't already in your library then it will be added for you automatically. Ratings are stored as tags ("gm_rating_1" for 1 star, "gm_rating_3" for 3 stars, etc.)

Unfortunately as everything is done client side you can't, say, sort all bookmarks by rating, though you can use the gm_rating tags in the tag cabinet on the left hand side to view only those bookmarks rated with one, two, three ... etc. stars.

To get ratings for items programmatically you could use the Connotea API.

Originally I was going to write a script that worked for del.icio.us too but it took a lot longer than I anticipated just to get Connotea working. Feel free to alter or extend the script if you are so inclined.

Some questions...

Any thoughts or opinions on ratings? Does anybody already rate their bookmarks on sites like CiteULike or Faculty of 1000? How and why? Is it for your own benefit or for others (or both)?

What kind of rating would be most useful?

Thumbs up, thumbs down? Five stars? A more complex system with different ratings for different intentions?

If I rate one of my bookmarks I could be saying that...
  • I found it interesting / boring
  • I thought that it was well / badly written
  • I recommend / don't recommend it to other people
... or all of the above, or none of the above, or some subset of the above. Do people need to know what your intention is, or is that just making things too complex?

What kind of things would you use ratings for?

Within groups? To maintain reading lists? For social networking (A and B like many of the same links, so A might also like some of B's other links)? As a very basic version of LibraryThing...?

Comments and trackbacks Feel free to post your comments Blogger Bill Blogger Pedro Beltrão Blogger Luke Goodsell Anonymous Maxine Blogger Jogi Anonymous Anonymous . This post has trackbacks.

Trackbacks:

6 Comments:

At December 03, 2006 8:33 PM, Blogger Bill said...

I don't rate bookmarks, I think mainly because I grab papers into Connotea before I read them, and when (OK, if) I do read them I don't go back to Connotea and add comments or ratings or whatever.

It does occur to me that an "I believe this"/"I don't believe this" system might be useful. So many papers are such utter crap that a way of gathering consensus opinion might be handy. I think you'd need an "I've actually read this" tag as a quality filter, and beyond that it could be quite informative to know that lots of people like or hate a given paper.

This would work best with a large, web-savvy user base, of course. How many users does Connotea have?

 
At December 03, 2006 9:12 PM, Blogger Pedro Beltrão said...

I also don't rate papers but I would do it if this was in place. Unfortunately I also only read papers after I tag them (when I actually do) so I could rate them before reading based on abstract and quick look but it is not the same.
I also tend to print papers for reading so after I read them it would take some effort to go back to my connotea library to rate it.
So, I can't see an easy way to enable people to rate papers after reading. As for rating papers before reading I think I would prefer a 5 star system. Having a way to mark if I read or not the paper would also be nice.
Maybe there could be an option for sending an email some time latter to ask for ratings, or have a special box in connotea for papers I said I would read for easy access to add the ratings. I think I would not mind for example of receiving once a week a small email with a random subset of papers I have tagged one month ago asking me if I read the paper and what rating would I give it. The same could be done within connotea.
Well, that is probably enough of random thoughts :)

 
At December 13, 2006 4:36 PM, Blogger Luke Goodsell said...

I don't think a rating system would be of much use if it was just for myself. For Connotea, what I would find most useful is a list of supportive and unsupportive comments. ie, users provide sensible discussion of the article and state whether their comments are supportive or not. you could then provide a count of the number of users who have posted supportive comments and the number of users who have posted unsupportive comments.

I don't think a score or thumbs up/down approach suits academic tools such as connotea, since readers should be basing their decisions on the merit of the arguments, rather than the number of arguments.

 
At March 02, 2007 2:30 PM, Anonymous Maxine said...

I think it would be very useful to have a black-mark system of some kind, though, as one of the problems with ISI-style of citation quality indicators is you don't distinguish the articles that are being cited becuase they are wrong or controversial, eg the article is being cited a lot becuase the data are suspect. This ability to discriminate is where systems like connotea can come into their own -- once a majority of scientists are using them. Have to wean them off "citation analysis 1.0" first, though, as at present they all head off to ISI for everything.

 
At July 05, 2007 11:20 AM, Blogger Jogi said...

actually I was looking for a system similar, than in citeulike where you can rate the articles importance before reading them and it will create a reading-list for you and when (if) you read the article you can mark it as read.

 
At August 01, 2007 10:00 AM, Anonymous Anonymous said...

thats the tool i was looking for - just installed it but it seems to have problems with the new connotea?

 

Post a Comment

<< Home


See all posts from: July 2005 August 2005 September 2005 October 2005 November 2005 December 2005 January 2006 February 2006 March 2006 April 2006 May 2006 June 2006 July 2006 September 2006 October 2006 November 2006 December 2006 January 2007 February 2007 March 2007 April 2007 May 2007 June 2007 July 2007 August 2007 October 2007 November 2007 December 2007 January 2008 February 2008 March 2008 April 2008 May 2008