PinnedPublished inDev GeniusIntroduction to Kestra, a Declarative Orchestration Alternative to Apache AirflowEvent-driven open-source data orchestrator with a built-in code editor and a rich plugin ecosystemMay 15, 2023May 15, 2023
Published inLevel Up Coding2025 Data Engineering & AI TrendsHow GenAI, new data regulations, Postgres, DuckDB, and open table formats affect data engineering in 2025 and beyondJan 24A response icon9Jan 24A response icon9
Published inLevel Up CodingBuild Interactive Data Workflows Using Kestra and ModalRun interactive workflows that adapt to user inputs with Kestra’s open-source orchestration platform and Modal’s serverless infrastructure.Oct 21, 2024Oct 21, 2024
Published inLevel Up Coding2024 Data Engineering TrendsTrends and the impact of AI on data tooling and data job marketJan 28, 2024A response icon9Jan 28, 2024A response icon9
Published inLevel Up CodingWhy data integration will never be fully solved, and what Fivetran, Airbyte, Singer, dlt and…How Fivetran, Airbyte, Singer, dltHub and CloudQuery approached data ingestion and why it will never be fully solvedOct 11, 2023A response icon2Oct 11, 2023A response icon2
Published inLevel Up CodingPolars, DuckDB, Pandas, Modin, Ponder, Fugue, Daft — which one is the best dataframe and SQL tool?Comparison of open-source dataframe and SQL frameworks for data engineering, machine learning, and analyticsAug 11, 2023A response icon9Aug 11, 2023A response icon9
Published inAWS in Plain EnglishApache Iceberg Crash Course for AWS users: Amazon S3, Athena & AWS Glue ❤️ IcebergHow to turn AWS data lake into a data lakehouse using Iceberg, the open table formatAug 4, 2023A response icon2Aug 4, 2023A response icon2
Published inLevel Up CodingDuckDB vs. MotherDuck — should you switch to the Cloud version?Why and when to use MotherDuck over local DuckDBJul 30, 2023Jul 30, 2023
Published inLevel Up CodingProgrammable Data Infrastructure is Finally Within ReachEverything as Code for Data InfrastructureJul 5, 2023Jul 5, 2023
Published inLevel Up CodingEnd-to-End Data Ingestion, Transformation and Orchestration with Airbyte, dbt and KestraHow you can use open-source tools to ingest, transform and orchestrate data pipelines without vendor lock-in.Jun 28, 2023Jun 28, 2023