Wednesday, December 27, 2006

StreamCruncher 1.02 Beta is out!

While I was trying to implement a Use Case (Top-Selling-Items), I realized that an important and useful feature was missing in the "Highest/Lowest Events Window". This new option allows you to update the highest/lowest entries in the Window instead of treating them (updates) as unrelated rows. Without this, you might end up with the old and the updated Event in the same Window.

There are also 4 new examples that demonstrate some nice uses of the Kernel - ReStockAlertTest, SLAAlertTest, TopSellingItemsTest and ShipmentAggregatorTest. I'll be writing about these in more detail soon.

Tuesday, December 26, 2006

I'm on the lookout for more Embedded and/or In-memory Databases. I had an eye on SQLite for a while. Even though it does not support concurrent access (similar to H2), it has been around for a while now. And quite stable too, I guess. The only problem was the lack of (functioning) JDBC Drivers. Today I bumped into this project - sqlitejdbc.

And ANTs DB recently announced version 3.6 with full support for Embedded mode.

I'm looking forward to add support for both of these Databases in SC. The closer to the DB, the better.

The wider the range of DBs that SC can support, the better; to suit different technical requirements and the all important budget limit.

Thursday, December 21, 2006

A small discussion on why I used In-Memory Databases as the underlying Data tier for StreamCruncher - Marco's Blog.

Monday, December 18, 2006

SC 1.0.1 Beta is out! The first minor release after the One-Oh Beta release of StreamCruncher.

This release includes a demonstration of a Co-related Sub-Query with Partitions and pre-Filters - an interesting SLA failure alert. I was pleasantly surprised to see all 5 DBs support co-related Sub-Queries. Of course, I never really doublted Oracle TimesTen and MySQL.

Ah well, in the next few weeks I hope to get a few real world examples together and present it as an article, maybe. It's quite hard to make people understand the benefits of Event Processing. The whole concept is still mostly academic with a few companies making some very high-end Stacks. It's not widespread yet. "Yet" - the operative word.

Friday, December 15, 2006

I'm pleased to announce the initial availability (1.0 Beta) of StreamCruncher -, a lightweight Event Processing Kernel.

It's a multi-threaded Java program that provides an extention to the SQL language with Event processing constructs. It supports Sliding Windows, Time based Windows, Partitions and Aggregates. It also provides a feature similar to Materialized Views. Joins and Sub- queries are also supported to allow Event Co-relation.

StreamCruncher requires a Database underneath, to do the heavy-lifting. Several Databases (5 DBs) are supported. In-Memory Databases like - MySQL with Memory/Heap Engine, Oracle TimesTen and H2 are favored. It also supports Derby and Firebird, although with slight modifications to the Page Cache and Disk Flush settings etc to make them run faster.

It is Free, with a commercial-friendly License.

I hope you'll give it a shot. I'd love to hear your feedback. full year. Weekends, weekdays, late nights, holidays - oh man! Why would anyone do it? Well, why do people spend hours and hours at the Gym, sculpting their bodies? Back breaking work, but the sense of accomplishment you get at the end of it is something one can only understand if one goes through it, first hand.

Saturday, September 09, 2006

Yes, I'm still around. Alive and kicking, but not blogging :-) Living in Singapore for the past 1.5 years.

Monday, January 30, 2006

My friend's (B V Srinivas) blog -, where he reviews Hollywood movies. Take a look.