#python

Articles tagged with #python

waylonwalker.com/kedro-silence
Kedro can have a chatty logger. While this is super nice in production so see everything that happened during a pipeline run. This can be troublesome
May 21, 20213 min read247
Minimal Kedro Pipeline
How small can a minimum kedro pipeline ready to package be? I made one within 4 files that you can pip install. It's only a total of 35 lines of python, 8 in setup.py and 27 in mini_kedro_pipeline.py. Minimal Kedro Pipeline I have everything for th...
Jan 20, 20215 min read98
📄 Kedro - My Data Is Not A Table
In python data science/engineering most of our data is in the form of some sort of table, typically a DataFrame from a library like pandas, spark, or dask. DataFrames are the heart of most pipelines These containers for data contain many convenient m...
Jan 15, 20213 min read100
Minimal Python Package
cover: /static/minimal-python-package-xmas2020.png cover_image: https://waylonwalker.com//static/minimal-python-package.png published: true status: published tags: python templateKey: blog-post title: Minimal Python Package What does it take to cr...
Jan 14, 20214 min read41
Expand One Line Links 🔗
I wanted a super simple way to cross-link blog posts that require as little effort as possible, yet still looks good in vanilla markdown in GitHub. I have been using a snippet that puts HTML into the markdown. While this works, it's more manual/dif...
Jan 14, 202112 min read81
Quickly Change Conda Env With Fzf
Changing conda environments is a bit verbose, I use a function with fzf that both lists environments and selects the one I want in one go. Conda I have used conda as a virtual environment tool for years now. I started using conda for its simplicity ...
Jan 11, 20216 min read74