Hello Readers! It’s a sunny Saturday morning and I just finished baking an apple pie, so I’m in a good mood. To break the normal cycle of weekly editions, I figured I would dip my toe into the waters of Weekend Editions.
I wanted to update you on a few non-Substack pieces of content I’ve done lately … give you something to do while you lay around on the couch all day.
Angry People Of The Internet.
I broke the internet with an argument I had with a Databricks Architect this week about putting “Notebooks in Production.”
You can read more here and here. I assure you, you will be entertained.
To be fair, I’ve read none of the comments, not a one. After you’ve been doing what I’ve been doing for as long as I have … you learn to ride the waves and keep chugging along never looking back.
I couldn’t help doing a YouTube video on it though.
I also found out DuckDB has MAJOR memory issues, that seemed to deserve a YouTube video as well. Maybe it will become a habit.
I also wrote two other pieces …
The Best Piece of Software Engineering Advice https://www.confessionsofadataguy.com/the-best-piece-of-software-engineering-advice/
Why I Love Rust, but Deploy Python https://www.confessionsofadataguy.com/why-i-love-rust-but-deploy-python/
I also dipped my other toe in the waters of producing paid coding exercises. I always get people asking me to do various Data Engineering courses … but can’t seem to muster the strength to do it.
It was a reasonable experience. I am working on similar Polars Practice Exercises that will be double the size, shooting for 100 problems.
We shall see.
%40 OFF paid subscriptions this weekend
For all you free-riders … here is a link to %40 OFF a paid subscription.
Nice article! I also agree that the best way to deploy in production is through a Python package. Even Databricks is investing in tooling for that (see Databricks Asset Bundles). You can find a comprehensive template on my GitHub repo:
https://github.com/andre-salvati/databricks-template