Top Articles

Data Lineage,

SQL Visualisation Guide – Query Diagrams, Lineage & ERD

Have you ever inherited the SQL codebase from someone else where it is in a “bit of a mess”? 😁 Sound familiar? Most data engineers and SQL developers have been there including myself—staring at a spaghetti-like web of queries, trying to untangle a chaotic SQL codebase. It’s a common nightmare. Traditionally, you had to fight …
Uli Bethke November 3, 2024
SQL,

SQL Challenge: Tackling the Island Problem in Time Series Data

Jump into our SQL Challenge! Today, we're exploring customer loyalty trends. Are you prepared to show off your SQL skills? About the quiz In this SQL pop quiz, we're challenging…
Uli Bethke November 7, 2023
XML,

XML Converters & Conversion – Ultimate Guide (2024)

“Urgent XML Conversion Project – Need by End of Week”. “Just Convert this XML to SQL Tables. Should be Simple!” Sound familiar?  From my experience, XML conversion projects follow the…
Maciek October 4, 2023
Snowflake,

7 guardrails against common mistakes that inflate Snowflake credit usage 

Dodge costly pitfalls Snowflake implementation has pioneered dozens of innovations in the data platform space. The long list includes separation of compute and storage, physical workload separation, data sharing, data…
Uli Bethke September 13, 2023
SQL,

Automatically detect bad SQL. Static and dynamic analysis of SQL code

Preventing Query Catastrophe with FlowHigh SQL Analyser Does the following sound familiar? As the wizard EsQuEl delved deep into the SQL code, he stumbled upon multiple instances where tables were…
Uli Bethke September 8, 2023

Recent Articles

All JSON Snowflake XML
Snowflake, Snowflake,

Querying hierarchical data in Snowflake

Overview Having the right tools for the job makes the life of a data engineer a lot easier. It is also more fun to work with a platform that has…
Uli Bethke July 4, 2020
Snowflake, Snowflake,

Medvault Success Story – Primary Healthcare Analytics on the Snowflake Cloud Data Platform

Overview: MedVault, an organization offering data management services in primary healthcare, identified the need for a platform which would help their clients to really unlock the value of their data.…
Uli Bethke June 29, 2020
Snowflake, Snowflake,

Snowflake for real time streaming. Change Data Capture with Qlik Replicate

Overview In this two part series on streaming with the Snowflake Data Platform, we use Snowflake for real time analytics.In part one, we use Qlik Replicate to identify changes to…
Uli Bethke June 12, 2020
Data Pipeline,

To hell and back with ETL. The unstoppable rise of data warehouse automation.

A brief history of ETL The rise of ETL and the rise of the data warehouse are tightly coupled. It’s like the chicken and the egg. There would be no…
Uli Bethke May 22, 2020
XML, flexter, XML,

Re-use algorithms for converting XML and JSON to a relational format

In our previous post Optimisation algorithms for converting XML and JSON to a relational format, we explained that Flexter ships with two optimisation algorithms. These algorithms make the life of…
Maciek May 5, 2020
XML, flexter, XML,

Converting GDTF XML standard to MySQL

In this post we will guide you through the easiest way of processing your XML data to a relational format on MySQL . We will be using Flexter to process…
Maciek May 3, 2020