travel Madagascar: Animals Some pictures taken in Madagascar. Use them as you please with only one restriction: if used in public (blog, presentation , news article...), cite me or this web/post. Yep, the
travel Madagascar: humans Some pictures taken in Madagascar. Use them as you please with only one restriction: if used in public (blog, presentation , news article...), cite me or this web/post.
travel Madagascar: Landscapes Some pictures taken in Madagascar. Use them as you please with only one restriction: if used in public (blog, presentation , news article...), cite me or this web/post. Politics
kafka Using Avro In kafka Streams: the hard way In this fourth part we will see how to use avro in kafka, and we will try to do it withhout using any extra help, the old way. This way
kafka Producing JSON data to a Kafka topic The first big step to work with Kafka is to put data in a topic, and so is the purpose of this post. Being JSON the most common way to
travel Norway: winter is coming Some pictures taken in Norway: Trondheim, Bodø and Oslo. Use them as you please with only one restriction: if used in public (blog, presentation , news article...), cite me or this
Spark Finding latest non-null values in columns Imagine we have a table with a sort of primary key where information is added or updated partially: not all the columns for a key are updated each time, but
kafka Kafka streams and HBase as de-duplicator In this second part of the Kafka in MapR series we are going to de-duplicate identical messages using HBase. NOTE I am using MapR so not all configurations are the
kafka Simple kafka streams app in MapR environment While Spark continues to thrive as the main big data processing framework for batch and streaming, alternatives emerging from the 1970s actor model and the reactive manifesto are gaining notoriety.
Spark Brief history of concatenating nulls So today I was trying to use the handy function sha1() provided by Spark and I needed to concatenate all my columns in just one, since it did not supported
scala Using Timestamp in Play Framework's JSON Similar to the previous post Reading Sequences of Scala classes in Play JSON, I found some issues when trying to parse and write Timestamp using the JSON module from Play
scala Reading Sequences of Scala classes in Play JSON One wise man said once: "Try to improve 1% every day so you will be an expert without you noticing". Following this advise, in my personal projects I
travel New York: always under construction Some pictures taken in New York, US. Use them as you please with only one restriction: if used in public (blog, presentation , news article...), cite me or this web/post.
travel Boston: a city to live in Some pictures taken in Boston and Cambridge, US. Use them as you please with only one restriction: if used in public (blog, presentation , news article...), cite me or this web/
Spark Spark SQL and Type-safe (1): Quill Recently I have been discussing with some colleagues the advantages of type-safe languages, the main reason I ditched python for Scala. Scala provides, for me the best of both worlds:
travel Indonesia: Yogyakarta Some pictures taken in Yogyakarta, Indonesia. Use them as you please with only one restriction: if used in public (blog, presentation , news article...), cite me or this web/post. Borobudur
travel Rome: ancient history Some pictures taken in Rome. Use them as you please with only one restriction: if used in public (blog, presentation , news article...), cite me or this web/post. Ostia Antica
scala Banking Kata - Scala Developers Barcelona Some weeks ago I co-organized a Scala BCN meetup where we implemented a Bank account class in pairs and TDD. Easy for any of you that are starting with Scala.
Bitcoin La biblioteca de Babel: el malson del Bitcoin La certidumbre de que todo está escrito nos anula o nos afantasma. --- Jorge Luis Borges, La biblioteca de Babel La biblioteca de Babel és un concepte simple però profund:
Spark Present and future of graph processing with Spark Graphs have been around quite a while. In fact, the first paper in the history of graph theory was written by Euler himself in 1736! However, it wasn't until 142
ghost Prepare your blog: TeX-like equations and syntax highlighting As a person comming from physics and with interest in coding, the two things I value the most are \(\LaTeX\) equations and syntax highlithing. Here I present you the two
Spark Pivoting a table with Spark A pivot table is an old friend of Business Intelligence: it allows to summarize the data of another table, usually by performing aggregations (sum, mean, max, ...) on aggregated data. They
Setting Jupyter kernel with latest version of Spark: the nightmare of versions Recently I have tried to use Jupyter notebook to test some data science pipelines in Spark. This project turned out to be more difficult than the expected, with a couple
Spark Spark tricks For running a spark local cluster (one machine is represented by one threads). The * is to match the number of cores available on the machine. Put a number to force
BTC Solution to trezor-agent installation problems on Ubuntu I just found a couple of nasty errors that didn't allowed me to install trezor-agent via pip. A couple of examples are: Failed building wheel for hidapi /usr/bin/ld:
