I have been playing around with Storm which was opensourced by Twitter recently.(Checkout the github code). It is dubbed as a realtime map reduce system but it is very generic to perform a variety of operations.

I explored Storm-Starter which has some examples storm topologies to help get your feet wet. Most java examples worked fine for me but I got issues in running the WordCountTopology. The WordCountTopology example uses the python language to write its bolt. I kept getting the error below:

Cannot run program “python” (in directory “/tmp/cf2bf9a …

The problem was solved by adding the “multilang” directory in Storm-Starter project to the class path.