rust
Those last months I decided to learn this new fancy and hipster language, so let me share a couple of links I would now recommend. I'm coming from mostly python, but a bit of functional experience with scala, so I'm comfortable with the typing system (and
rust
Leptos is a production-ready full stack server written in rust that brings component reactivity, server functions and rust's type safety without needing to know Javascript
data
Idempotentity is not only useful in the design of data pipelines, but also as a system-wide concern, since if one step is not idempotent, the entire quality of the results will be affected. Let's look at a practical example.
ghost
So the people that know me might remember that I have a sort of obsession with diagrams. It helps me think and evolve my thoughts. I also love how git works and the importance of having code that can see its changes across time. So it's no surprise
data
DBT is valuable but lacking. SQLMesh promises enhancements like unit tests, environments, airflow support, change plans, and CI/CD automation, providing a better development experience. Let's see its features.
python
Fibonacci sequence is commonly used to show recursion, but may not be the best algorithm to compare languages and performance, since the recursive implementation is not the optimal one and languages like python will outperform rust or C.
Spark
How to use one of the best AI/ML libraries (hugginface) with Spark? Let's try it
Some pictures taken in Scotland. Use them as you please under CC BY-NC-SA and if used in public (blog, presentation , news article...), cite me or this web/post. Can't be used to train AI/ML algorithms.
The pyspark library communicates to a spark driver. If the driver dies, we'll obtain some odd error messages that will not directly indicate the root cause.
After 4 years owning two reMarkable, it's time I write the good, bad an ugly things of it.
Some pictures taken in Scotland. Use them as you please under CC BY-NC-SA and if used in public (blog, presentation , news article...), cite me or this web/post. Can't be used to train AI/ML algorithms.
Just a quick post on an error you might find when using apache spark and Avro due to a version mismatch. Software Version Spark 3.3.2, 3.3 spark-avro 2.12:3.4.0 I've you have an older version of spark (latest as of now is
If you write code and you are bored when someone mentions PowerPoint, this asciidoctor slide template is for you. Write code and get animations for free!
I've been a long time looking for an excuse to really use asciidoctor to build presentations. Now that I have the opportunities, I've been enjoying it like a child. For my memory, and for yoy, if you want to use it, here are my tips. This
Des de fa un parell de mesos he estat interessat en les dades del transport aeri, i he descobert tot un món d'aficionats (en el bon sentit) i apassionats per les dades. Sobretot, de les dades obertes en les que cada persona hi contribueix altruísticament. En voleu ser
It's sometimes difficult to access s3 files in Apache Spark if you don't use a prebuilt environment like Zepelin, Glue Notebooks, HUE, Databriks Notebooks or other alternatives. And googling around might get you half working solutions. But do not worry, I'll show you how
Using spark in an interactive way it's a bit cumbersome sometimes if you don't want to go to the good old terminal and you decide something like a jupyter notebook better suits you. Or you are doing a more complex analysis also. If that is the
This post aims to centralize the information on how to use your Nvidia GPUs on debian using WSL2 in order to train and run your AI/ML models.
In physics or biology you sometimes simulate processes in a 2 dimensional lattice, or discrete space. In those cases you usually compute some local interactions of "cells", and with that, calculate a result. An example of this could be the Ising model which was proposed in 1920 for