PinnedPublished inDev GeniusIntroduction to Kestra, a Declarative Orchestration Alternative to Apache AirflowEvent-driven open-source data orchestrator with a built-in code editor and a rich plugin ecosystemMay 15, 2023May 15, 2023
Published inLevel Up CodingBuild Interactive Data Workflows Using Kestra and ModalRun interactive workflows that adapt to user inputs with Kestra’s open-source orchestration platform and Modal’s serverless infrastructure.Oct 21Oct 21
Published inLevel Up Coding2024 Data Engineering TrendsTrends and the impact of AI on data tooling and data job marketJan 289Jan 289
Published inLevel Up CodingWhy data integration will never be fully solved, and what Fivetran, Airbyte, Singer, dlt and…How Fivetran, Airbyte, Singer, dltHub and CloudQuery approached data ingestion and why it will never be fully solvedOct 11, 20232Oct 11, 20232
Published inLevel Up CodingPolars, DuckDB, Pandas, Modin, Ponder, Fugue, Daft — which one is the best dataframe and SQL tool?Comparison of open-source dataframe and SQL frameworks for data engineering, machine learning, and analyticsAug 11, 20239Aug 11, 20239
Published inAWS in Plain EnglishApache Iceberg Crash Course for AWS users: Amazon S3, Athena & AWS Glue ❤️ IcebergHow to turn AWS data lake into a data lakehouse using Iceberg, the open table formatAug 4, 20232Aug 4, 20232
Published inLevel Up CodingDuckDB vs. MotherDuck — should you switch to the Cloud version?Why and when to use MotherDuck over local DuckDBJul 30, 2023Jul 30, 2023
Published inLevel Up CodingProgrammable Data Infrastructure is Finally Within ReachEverything as Code for Data InfrastructureJul 5, 2023Jul 5, 2023
Published inLevel Up CodingEnd-to-End Data Ingestion, Transformation and Orchestration with Airbyte, dbt and KestraHow you can use open-source tools to ingest, transform and orchestrate data pipelines without vendor lock-in.Jun 28, 2023Jun 28, 2023
Published inDev GeniusFrom Data Pipeline Purgatory to Production HeavenGet rid of manual deployments using Infrastructure as CodeJun 21, 2023Jun 21, 2023