New Hazelcast Jet 0.6 offers third generation big data processing engine to improve job management capabilities



Hazelcast, an open source in-memory data management company, announced this week 0.6 release of Hazelcast Jet – its ultra fast, application embeddable, stream and batch processing engine. New functionality in Hazelcast Jet 0.6 includes a simplified high-level Java API, enhanced job management capabilities which enable computation elasticity and Spring integration.

Hazelcast Jet is a third generation big data processing engine, the first two generations being Hadoop and Spark. With performance up to 15 times faster than Spark combined with great simplicity, Hazelcast Jet is setting a new standard.

The new elasticity features of Hazelcast Jet 0.6 allow for elastic scale out and scale in, perfect for the cloud. Executing jobs can be rescaled to make use of new nodes as they added – meaning running production jobs will scale to utilize computational resources as and when it’s made available, even while in mid-production. When a node is removed, computations are resized to the smaller cluster without interruption.

Hazelcast Jet 0.6 is easier than ever to use. Anyone who is a Java 8 programmer will find it very natural and simple.

Headquartered in Silicon Valley’s Palo Alto, Hazelcast addresses the growing demand for enhanced application performance, data processing speed and scalability. The company has two products – Hazelcast IMDG, an operational, in-memory computing platform which enables enterprises to manage their data and distribute processing using in-memory storage and parallel execution to achieve application speed and scale; and Hazelcast Jet, the ultra fast, application embeddable, Stream and Batch Processing Engine.

To accommodate the large audience of Spring users, Spring integrations are added. In Hazelcast Jet 0.6, a Jet client or Jet instance can be configured as a Spring Bean and developers are now able to autowire them with their applications. Also, the Spring Context of the Jet cluster can be injected directly into a Jet job.

Hazelcast Jet 0.6 also includes updated Hazelcast Jet connectors such as Kafka v1.0 and HDFS v2.8.3; embedded Hazelcast IMDG updated to v3.10; entry Processor Sink when writing to IMap, Hazelcast IMDG users can now update just a part of the entry instead of rewriting the complete entry; and Java 9 so that Hazelcast Jet builds and runs on Java 9 and supports the new Java module system.

In its 0.5 release, Hazelcast Jet launched its Pipeline API. In Hazelcast Jet 0.6, the Pipeline API has been expanded to fully cover all Hazelcast Jet features. In 0.6, it is even more straightforward to define sliding, tumbling and session windows or to deal with late events.

The API was streamlined to provide convenience for integrating third party libraries such as predictive analytics tools or enrichment, users will find it easy to write a custom sink to output data to any system of record. Stream processing has overtaken batch processing as the preferred method of processing big data sets and these new features are designed to satisfy the needs of companies that require immediate insight into their data.

“Jet is being adopted rapidly by the Global 200. The deployment and programming simplicity, its embeddability, and the validated performance advantage of Jet are driving this,” said Greg Luck, CEO of Hazelcast. “Hazelcast Jet 0.6 gains valuable features for even broader deployment.”

To enable users to fully understand the current capabilities of Hazelcast Jet, 8 new demo applications have been developed which illustrate how to use Hazelcast Jet to solve real-world problems. Examples include applications for real-time image recognition, Twitter cryptocurrency sentiment analysis, real-time road traffic analysis and prediction, real-time sports betting engine, flight telemetry, Markov Chain generation and market data ingest.

Hazelcast Jet is simple to program and deploy – and can be fully embedded for OEMs and microservices – making it simpler and easier to build next generation systems.

 

Leave a Reply

WWPI – Covering the best in IT since 1980