Hey! I'm Kishan (KP). š
I'm a software developer.
I build apps and data pipelines.
Watch me nerd out š¤
YAML vs JSON - Config File Formats for Your Project
All apps have config files. But should you use YAML or JSON? (Please don't say XML.)
We'll see the advantages YAML has over JSON when using a config file in your app.
How to Schedule Airflow DAGs - 4 Modern Ways
Enjoy life and let Airflow handle the boring stuff. We're talking about how you can schedule those tasks to run for you.
We'll see 4 ways to schedule your Airflow pipelines: Cron, Timedelta, Dataset, Timetable.
Or read my tech guides šļø
Mental Math Drill
Two things are true in life: Your email is filled with junk and your mental math stinks. What if you had a custom email to sharpen your arithmetic?
Let's use AWS to fill your inbox with something that sharpens your mind.
Airflow Params
Want to make friends? Design your Airflow DAGs with Params. Your co-workers (or you 6 months from now) will thank you.
Check out how Params let you pass runtime configuration, boosting user experience.
And here are some personal projects š
Snipster
Here's the tool you've always wanted to manange your code snippets.
It features a CLI, API, and GUI. It can work with multiple backend databases. and it has great test coverage, of course.
Letterboxd Pipeline
This project presents data engineering principles by developing a pipeline for movie data.
The pipeline extracts, processes, and loads data sourced from Letterboxd. A cloud data warehouse is implemented in Snowflake with analytics data processing handled by dbt.