Recent Articles

Data Lineage,

Master Snowflake Data Lineage – Features, Tools & Best Practices

What is Snowflake data lineage? Imagine you’ve just touched down in a bustling, unfamiliar city you’re eager to explore. You step outside your hotel and realise you have no idea…

Uli Bethke November 27, 2024

Snowflake,

Iceberg Ahead! All you need to know about Snowflake’s Polaris Catalog

What is the Polaris Catalog? At the Snowflake Summit 2024 Snowflake’s CEO Sridhar Ramaswamy announced the Polaris Catalog during the main keynote speech. The announcement around the Polaris Catalog has…

Uli Bethke June 21, 2024

Snowflake, flexter,

How to Parse & Flatten XML in Snowflake with Examples

In this post we cover every detail of parsing XML in Snowflake including storing, loading, querying, and parsing XML. Very few cloud data platforms have native support for parsing XML.…

Uli Bethke June 3, 2024

Data Pipeline,

Data Orchestration Deep Dive Snowflake Tasks. An Airflow replacement?

What are Snowflake Tasks Snowflake introduced Tasks for scheduling and orchestrating data pipelines and workflows in late 2019. The first release of Tasks only offered the option to schedule SQL…

Uli Bethke May 3, 2024

Snowflake,

Benchmarking Snowflake Native Apps

As a long time user of Snowflake we are impressed with the near unlimited scalability of the Snowflake Data Cloud. We were wondering if the same scalability and performance magic…

Uli Bethke November 20, 2023

Snowflake,

Optimal Usage of Snowflake Virtual Warehouses: Breaking Down Parallelism & Concurrency

If you aim to harness the full potential of Snowflake's virtual warehouses, it's crucial to grasp how Snowflake datalake architecture handles concurrency and parallelism. Here's a simplified rundown: 🔍 Basics…

Uli Bethke September 29, 2023