Spark and HugginFace: Named Entity Recognition for aircraft ownership

How to use one of the best AI/ML libraries (hugginface) with Spark? Let's try it

Scotland structure

Some pictures taken in Scotland. Use them as you please under CC BY-NC-SA and if used in public (blog, presentation , news article...), cite me or this web/post. Can't be used to train AI/ML algorithms.

Troubleshoot pyspark Py4JNetworkError: Answer from Java side is empty

The pyspark library communicates to a spark driver. If the driver dies, we'll obtain some odd error messages that will not directly indicate the root cause.

reMarkable: a paper tablet still in beta

After 4 years owning two reMarkable, it's time I write the good, bad an ugly things of it.

Scottish landscapes

Some pictures taken in Scotland. Use them as you please under CC BY-NC-SA and if used in public (blog, presentation , news article...), cite me or this web/post. Can't be used to train AI/ML algorithms.

Troubleshoot: NoClassDefFoundError when reading with Spark Avro

Just a quick post on an error you  might find when using apache spark and Avro due to a version mismatch. Software Version Spark 3.3.2, 3.3 spark-avro 2.12:3.4.0 I've you have an older version of spark (latest as of now is

Asciidoctor: the best way of writing technical presentations

If you write code and you are bored when someone mentions PowerPoint, this asciidoctor slide template is for you. Write code and get animations for free!

Build beautiful presentations with asciidoctor and reveal.js

I've been a long time looking for an excuse to really use asciidoctor to build presentations. Now that I have the opportunities, I've been enjoying it like a child. For my memory, and for yoy, if you want to use it, here are my tips. This

Com saber quins avions passen damunt (i contribuir a les dades obertes)

Des de fa un parell de mesos he estat interessat en les dades del transport aeri, i he descobert tot un món d'aficionats (en el bon sentit)  i apassionats per les dades.  Sobretot, de les dades obertes en les que cada persona hi contribueix altruísticament. En voleu ser

Easy way to accessing s3 buckets with spark

It's sometimes difficult to access s3 files in Apache Spark if you don't use a prebuilt environment like Zepelin, Glue Notebooks, HUE, Databriks Notebooks or other alternatives. And googling around might get you half working solutions. But do not worry, I'll show you how

Loading packages in pyspark jupyter notebook/lab

Using spark in an interactive way it's a bit cumbersome sometimes if you don't want to go to the good old terminal and you decide something like a jupyter notebook better suits you. Or you are doing a more complex analysis also. If that is the

Enable GPU access to WSL2 debian for your AI workloads

This post aims to centralize the information on how to use your Nvidia GPUs on debian using WSL2 in order to train and run your AI/ML models.