Flags and Lollipops

Friday, March 20, 2009

Postgenomic hiatus

A couple of weeks ago I switched off the Postgenomic aggregation pipeline.

This is mainly because the pipeline scripts were hogging disk / memory resources on the server which it shares with a bunch of other applications. I'm not sure exactly where the process is sticking; but to be honest it's not a complete surprise.

Writing a blog aggregator is actually pretty easy; the hard part is dealing with all the weird edge cases. I haven't been paying close attention to the Postgenomic pipeline recently; I think what's currently going wrong is a combination of slow queries across what's now a very large database and one or more odd posts or blogs clogging up the pipeline (I'd post more details if I had them).

NPG doesn't officially support Postgenomic any more, though it does host it ably. Patching the code is something I do 'on the side', which is why it hasn't been fixed yet - I'm really pushed for time with other projects that need to take priority and will be for at least another three or four weeks.

In the meantime, no new blogs will be picked up and posts won't be aggregated at postgenomic.com. The site itself and the API will continue to work.

If you use postgenomic.com for any mashups or scripts then I apologise for the outage - sorry! It will be fixed, it's just the timing that's an issue.

In the meantime, please consider switching to Nature.com Blogs - the user facing features aren't as complete but the backend is. What's more it's fully supported by NPG developers and IT staff.

Comments and trackbacks Feel free to post your comments Anonymous Anonymous . This post has trackbacks.

Trackbacks:

1 Comments:

At August 27, 2009 3:24 PM, Anonymous Anonymous said...

Hi Stew, do you think you will fire up that engine soon?

 

Post a Comment

<< Home


See all posts from: July 2005 August 2005 September 2005 October 2005 November 2005 December 2005 January 2006 February 2006 March 2006 April 2006 May 2006 June 2006 July 2006 September 2006 October 2006 November 2006 December 2006 January 2007 February 2007 March 2007 April 2007 May 2007 June 2007 July 2007 August 2007 October 2007 November 2007 December 2007 January 2008 February 2008 March 2008 April 2008 May 2008 October 2008 December 2008 January 2009 February 2009 March 2009 June 2009