Archive for the ‘Acushare’ Category

Related categories

Wednesday, January 13th, 2010

You might have noticed that in the last week the related categories area has gotten a lot more relevant. I'm now using the OpenCalais api to scan content items for the semantically relevant bits. The system has a rate limit, so I can't scan every item that ReadPath pulls in. ...

Link graph roll back

Wednesday, January 13th, 2010

ReadPath needs a way to keep track of which items link to other items. To accomplish this there is some code that builds up a link graph between the items. The original implementation of this was based on java bdb and worked quite well for a long time. After awhile, ...

Hadoop reduce method reuses objects

Monday, December 28th, 2009

Over the holiday break I was playing around with creating a Map/Reduce job that would scan through all of the content items and then create a link graph. It was a fairly straightforward job. I would scan each content item for all of the hrefs and for each one would ...

Hadoop and HBase in production

Monday, December 28th, 2009

At the beginning of December, I ported several portions of the ReadPath infrastructure from MySQL to HBase with Hadoop. So far it's been a complete success. At first I had focused most of my attention on HBase, seeing it as a way to scale systems beyond a single MySQL instance without ...

Search Update

Saturday, September 19th, 2009

I haven't had a chance to write much about it, but a couple weeks ago, I moved ReadPath's search from a straight Lucene install with hand managed indices to Solr. I was a little hesitant at first because I though that since Solr was primarily an interface on top of ...

DB Update

Saturday, September 19th, 2009

There was a bit of downtime tonight for some database maintenance. Unfortunately the size of the database has been growing  by leaps and bounds due to the hundreds of thousands of feeds being tracked and with daddy duty, I had not been staying on top of it. This afternoon I ...

Feedburner Issue

Sunday, June 14th, 2009

With the increasing number of subscriptions by users of ReadPath we've gone over a limit for Feedburner. This has caused them to block us temporarily. We're trying to get access restored to Feedburner feeds, but you may notice that certain subscriptions are not updating temporarily. We thank you for your patience ...

Search Updates

Saturday, January 24th, 2009

There are three types of search on ReadPath. You can search for: Subscriptions News Items Users Subscription search has just gotten an update that adds relevant items to each subscription result that you were searching for. So if you were searching for "Barack Obama inauguration" you would have gotten a list of the most ...

Personal News Filtering

Friday, October 3rd, 2008

With the explosion of information sources on the internet, it's becoming more and more important to have good filters in place. If you don't, you can quickly become overwhelmed with the increasing volume of information. ReadPath has taken several different approaches to providing the best environment for reading and sharing ...

Private comments now available

Friday, October 3rd, 2008

ReadPath now supports commenting on shared items. This is a quick and easy way to bounce ideas around and discuss the latest news. Commenting on ReadPath is protected by groups though, so that when you share an item and later participate in comments, you determine the group or people that ...