kafka - 63 orders of magnitude

kafka

Using Avro In kafka Streams: the hard way

In this fourth part we will see how to use avro in kafka, and we will try to do it withhout using any extra help, the old way. This way we will experience the pain of not having a good integration ecosystem (e.g. a native library and the schema

kafka

Producing JSON data to a Kafka topic

The first big step to work with Kafka is to put data in a topic, and so is the purpose of this post. Being JSON the most common way to intercomunicate, and having the schema with the data, we will explore how we build a producer in scala to start

kafka

Kafka streams and HBase as de-duplicator

In this second part of the Kafka in MapR series we are going to de-duplicate identical messages using HBase. > NOTE I am using MapR so not all configurations are the same in its Open Source counterparts (e.g. I don't need to add the ZooKeeper nodes) This

kafka

Simple kafka streams app in MapR environment

While Spark continues to thrive as the main big data processing framework for batch and streaming, alternatives emerging from the 1970s actor model and the reactive manifesto are gaining notoriety. Akka is widely known in the Scala community and on March 2016 Confluent released its library Kafka Streams. One of