PinnedPublished inDev GeniusIntroduction to Kestra, a Declarative Orchestration Alternative to Apache AirflowEvent-driven open-source data orchestrator with a built-in code editor and a rich plugin ecosystemMay 15, 2023May 15, 2023
Published inLevel Up Coding2025 Data Engineering & AI TrendsHow GenAI, new data regulations, Postgres, DuckDB, and open table formats affect data engineering in 2025 and beyondJan 242Jan 242
Published inLevel Up CodingBuild Interactive Data Workflows Using Kestra and ModalRun interactive workflows that adapt to user inputs with Kestra’s open-source orchestration platform and Modal’s serverless infrastructure.Oct 21, 2024Oct 21, 2024
Published inLevel Up Coding2024 Data Engineering TrendsTrends and the impact of AI on data tooling and data job marketJan 28, 20249Jan 28, 20249
Published inLevel Up CodingWhy data integration will never be fully solved, and what Fivetran, Airbyte, Singer, dlt and…How Fivetran, Airbyte, Singer, dltHub and CloudQuery approached data ingestion and why it will never be fully solvedOct 11, 20232Oct 11, 20232
Published inLevel Up CodingPolars, DuckDB, Pandas, Modin, Ponder, Fugue, Daft — which one is the best dataframe and SQL tool?Comparison of open-source dataframe and SQL frameworks for data engineering, machine learning, and analyticsAug 11, 20239Aug 11, 20239
Published inAWS in Plain EnglishApache Iceberg Crash Course for AWS users: Amazon S3, Athena & AWS Glue ❤️ IcebergHow to turn AWS data lake into a data lakehouse using Iceberg, the open table formatAug 4, 20232Aug 4, 20232
Published inLevel Up CodingDuckDB vs. MotherDuck — should you switch to the Cloud version?Why and when to use MotherDuck over local DuckDBJul 30, 2023Jul 30, 2023
Published inLevel Up CodingProgrammable Data Infrastructure is Finally Within ReachEverything as Code for Data InfrastructureJul 5, 2023Jul 5, 2023
Published inLevel Up CodingEnd-to-End Data Ingestion, Transformation and Orchestration with Airbyte, dbt and KestraHow you can use open-source tools to ingest, transform and orchestrate data pipelines without vendor lock-in.Jun 28, 2023Jun 28, 2023