Full stack with Rust: axum + leptos + tailwind.css
Leptos is a production-ready full stack server written in rust that brings component reactivity, server functions and rust's type safety without needing to know Javascript
Leptos is a production-ready full stack server written in rust that brings component reactivity, server functions and rust's type safety without needing to know Javascript
Idempotentity is not only useful in the design of data pipelines, but also as a system-wide concern, since if one step is not idempotent, the entire quality of the results will be affected. Let's look at a practical example.
So the people that know me might remember that I have a sort of obsession with diagrams. It helps me think and evolve my thoughts. I also love how git works and the importance of having code that can see its changes across time. So it's no surprise
DBT is valuable but lacking. SQLMesh promises enhancements like unit tests, environments, airflow support, change plans, and CI/CD automation, providing a better development experience. Let's see its features.
Fibonacci sequence is commonly used to show recursion, but may not be the best algorithm to compare languages and performance, since the recursive implementation is not the optimal one and languages like python will outperform rust or C.
How to use one of the best AI/ML libraries (hugginface) with Spark? Let's try it
Some pictures taken in Scotland. Use them as you please under CC BY-NC-SA and if used in public (blog, presentation , news article...), cite me or this web/post. Can't be used to train AI/ML algorithms.
The pyspark library communicates to a spark driver. If the driver dies, we'll obtain some odd error messages that will not directly indicate the root cause.
After 4 years owning two reMarkable, it's time I write the good, bad an ugly things of it.
Some pictures taken in Scotland. Use them as you please under CC BY-NC-SA and if used in public (blog, presentation , news article...), cite me or this web/post. Can't be used to train AI/ML algorithms.
Just a quick post on an error you might find when using apache spark and Avro due to a version mismatch. Software Version Spark 3.3.2, 3.3 spark-avro 2.12:3.4.0 I've you have an older version of spark (latest as of now is
If you write code and you are bored when someone mentions PowerPoint, this asciidoctor slide template is for you. Write code and get animations for free!
I've been a long time looking for an excuse to really use asciidoctor to build presentations. Now that I have the opportunities, I've been enjoying it like a child. For my memory, and for yoy, if you want to use it, here are my tips. This
Des de fa un parell de mesos he estat interessat en les dades del transport aeri, i he descobert tot un món d'aficionats (en el bon sentit) i apassionats per les dades. Sobretot, de les dades obertes en les que cada persona hi contribueix altruísticament. En voleu ser
It's sometimes difficult to access s3 files in Apache Spark if you don't use a prebuilt environment like Zepelin, Glue Notebooks, HUE, Databriks Notebooks or other alternatives. And googling around might get you half working solutions. But do not worry, I'll show you how
Using spark in an interactive way it's a bit cumbersome sometimes if you don't want to go to the good old terminal and you decide something like a jupyter notebook better suits you. Or you are doing a more complex analysis also. If that is the
ai
This post aims to centralize the information on how to use your Nvidia GPUs on debian using WSL2 in order to train and run your AI/ML models.
Spark
In physics or biology you sometimes simulate processes in a 2 dimensional lattice, or discrete space. In those cases you usually compute some local interactions of "cells", and with that, calculate a result. An example of this could be the Ising model which was proposed in 1920 for
travel
Some pictures taken in Fuerteventura, Canary Islands. Use them as you please with only one restriction: if used in public (blog, presentation , news article...), cite me or this web/post. Can't be used to train AI/ML algorithms.
privacy
Fa uns quants anys haviem de mirar mapes o fins i tot preguntar a desconeguts (on s'ha vist!) per poder arribar a llocs nous o que no recordàvem on eren, i ara només hem de buscar el nom del lloc i automàticament ens diuen on és i quina
travel
Some pictures taken in Gran Canaria, Canary Islands. Use them as you please with only one restriction: if used in public (blog, presentation , news article...), cite me or this web/post. Can't be used to train AI/ML algorithms.
ai
Recently the European Commission released their proposal for a regulation laying down harmonized rules on Artificial Intelligence. After a review, I've tried to summarize its contents and explain what is considered an AI system, its classification, measures and finally give my opinion on the proposal. Fist we need
travel
Some pictures taken in La Gomera, Canary Islands. Use them as you please with only one restriction: if used in public (blog, presentation , news article...), cite me or this web/post. Can't be used to train AI/ML algorithms.
travel
Some pictures taken in Tenerife, Canary Islands. Use them as you please with only one restriction: if used in public (blog, presentation , news article...), cite me or this web/post. Can't be used to train AI/ML algorithms.
python
For a personal project I've recently spend 3 days learning and coding a website+API with flask. Those have been some of the more enjoyable days I've had in a while (referring to coding). In this post, I explain you my takeaways on how to build
wsl
Often WSL2 does not work well anymore, and those commands have saved me some time and headaches. If you have messed-up something (e.g. sudo), login to the WSL as root (from windows CMD) C:\>wsl -u root Restart WSL2, sometimes needed when you can't connect from
datascience
I've recently finished the IBM's Avanced data science specialization [https://www.coursera.org/specializations/advanced-data-science-ibm] and as capstone project I thought about being able identify the architectural elements present in an image: is it a column? A vault? Or a bell tower? Let's see
tensorflow
This post will provide some troubleshooting resources if you find yourself with this UnknownError when training an algorithm: Failed to get convolution algorithm. This is probably because cuDNN failed to initialize, so try looking to see if a warning log message was printed above. Environment: * Windows 10 * Nvidia RTX GPU
Spark
After reading this, you will be able to execute python files and jupyter notebooks that execute Apache Spark code in your local environment. This tutorial applies to OS X and Linux systems. We assume you already have knowledge on python and a console environment. 1. Download Apache Spark We will
opinion
Artificial Intelligence systems are every day more present in our lives. Despite interacting continuously with them we are usually not conscious about how they work or what are the consequences of using this. In our mind, it's just a black box.
Spark
Spark has a way to compute the histogram, however, it is kept under low level and sometimes obscure classes. In this post I'll give you a function that provides you with the desired values passing a dataframe. In the official documentation the only mention [https://spark.apache.org/
Spark
This is one of the things it makes sense when you stop to think about it. When you are performing the same aggregation over a window in more than one column, it is recommended to execute only once that windowing. Lets dive in with an example: I am working with