Physicist, data engineer working with data processing tools like spark and pandas. Contributor of @opendevstack I love to travel, so some posts might be about it.
kafka
While Spark continues to thrive as the main big data processing framework for batch and streaming, alternatives emerging from the 1970s actor model and the reactive manifesto are gaining notoriety. Akka is widely known in the Scala community and on March 2016 Confluent released its library Kafka Streams. One of
Spark
So today I was trying to use the handy function sha1() provided by Spark and I needed to concatenate all my columns in just one, since it did not supported multiple ones. The solution seemed easy at first: use concat(), however, something odd was happening. It turns out I had
scala
Similar to the previous post Reading Sequences of Scala classes in Play JSON [https://8vi.cat/sequences-of-classes-in-play-json/], I found some issues when trying to parse and write Timestamp using the JSON module from Play Framework. The objective I want to be able to write and read Timestamp format. I have
scala
One wise man said once: "Try to improve 1% every day so you will be an expert without you noticing". Following this advise, in my personal projects I try to use new libraries and this time the time has come for JSON with Play Framework. The objective of
travel
Some pictures taken in New York, US. Use them as you please with only one restriction: if used in public (blog, presentation , news article...), cite me or this web/post. Can't be used to train AI/ML algorithms. Pollution everywhere A gothic catedral in the heart of NY
travel
Some pictures taken in Boston and Cambridge, US. Use them as you please with only one restriction: if used in public (blog, presentation , news article...), cite me or this web/post. Can't be used to train AI/ML algorithms.
Spark
Recently I have been discussing with some colleagues the advantages of type-safe languages, the main reason I ditched python for Scala. Scala provides, for me the best of both worlds: the compiler is smart enough to determine variable types, and in the most cases it even can infer return types
travel
Some pictures taken in Yogyakarta, Indonesia. Use them as you please with only one restriction: if used in public (blog, presentation , news article...), cite me or this web/post. Can't be used to train AI/ML algorithms. Borobudur Amazing temple. I heavily recomend to do a tour with
travel
Some pictures taken in Rome. Use them as you please with only one restriction: if used in public (blog, presentation , news article...), cite me or this web/post. Can't be used to train AI/ML algorithms. Ostia Antica Ostia was the port of Rome. Beautiful place next to
scala
Some weeks ago I co-organized a Scala BCN meetup where we implemented a Bank account class in pairs and TDD. Easy for any of you that are starting with Scala. Here you have the github link [https://github.com/martsec/bankingKata] to try it by yourself! Copy from the README.
Bitcoin
> La certidumbre de que todo está escrito nos anula o nos afantasma. --- Jorge Luis Borges, La biblioteca de Babel La biblioteca de Babel és un concepte simple però profund: un espai on tota combinació possible de caràcters està escrita, guardada i pot ser trobada per qualsevol persona. On
Spark
Graphs have been around quite a while. In fact, the first paper in the history of graph theory was written by Euler himself in 1736! However, it wasn't until 142 years later when the term graph was introduced in a paper published in Nature. Despite those shiny names,