Top Articles

Data Lineage,

SQL Visualisation Guide – Query Diagrams, Lineage & ERD

Have you ever inherited the SQL codebase from someone else where it is in a “bit of a mess”? 😁 Sound familiar? Most data engineers and SQL developers have been there including myself—staring at a spaghetti-like web of queries, trying to untangle a chaotic SQL codebase. It’s a common nightmare. Traditionally, you had to fight …
Uli Bethke November 3, 2024
SQL,

SQL Challenge: Tackling the Island Problem in Time Series Data

Jump into our SQL Challenge! Today, we're exploring customer loyalty trends. Are you prepared to show off your SQL skills? About the quiz In this SQL pop quiz, we're challenging…
Uli Bethke November 7, 2023
XML,

XML Converters & Conversion – Ultimate Guide (2024)

“Urgent XML Conversion Project – Need by End of Week”. “Just Convert this XML to SQL Tables. Should be Simple!” Sound familiar?  From my experience, XML conversion projects follow the…
Maciek October 4, 2023
Snowflake,

7 guardrails against common mistakes that inflate Snowflake credit usage 

Dodge costly pitfalls Snowflake implementation has pioneered dozens of innovations in the data platform space. The long list includes separation of compute and storage, physical workload separation, data sharing, data…
Uli Bethke September 13, 2023
SQL,

Automatically detect bad SQL. Static and dynamic analysis of SQL code

Preventing Query Catastrophe with FlowHigh SQL Analyser Does the following sound familiar? As the wizard EsQuEl delved deep into the SQL code, he stumbled upon multiple instances where tables were…
Uli Bethke September 8, 2023

Recent Articles

All JSON Snowflake XML
XML,

No Code XML Conversion to Oracle

In a previous post we demonstrated how to use Flexter to convert XML data into TSV files.This was just an introduction demonstrating some basic features of Flexter including concepts around…
Maciek December 16, 2016
XML,

Converting Complex XML to CSV: A Practical Guide

Have you ever tried to process data in XML? Did you have to load its values into a relational database or simply convert the XML to plain CSV? What if…
Maciek November 28, 2016
XML,

A brief history of XML – From hype to useful data format

Is XML really dead? When it first became popular about 20 years ago, XML was meant to be the one and only format to serialize, encapsulate, and exchange data. The…
Maciek October 18, 2016
XML,

Take the pain out of XML processing on Spark.

Note: We have written an updated version of this post that shows XML conversion on Spark to Parquet with code samples.Did you ever have to process XML files? Complex and…
Maciek September 8, 2016
Data Warehouse,

Using parameters and variables in Hive CLI

In this blog post we look at how we can address a shortcoming in the Hive ALTER TABLE statement using parameters and variables in the Hive CLI (Hive 0.13 was…
Uli Bethke February 19, 2015
Oracle Data Integrator (ODI),

ODI 11g Repository Book Out Now

Get our e-books Discover the Oracle Data Integrator 11g Repository Data Model and Oracle Data Integrator Snippets and Recipes The book is for free. All you need to do is contact us. We will…
Uli Bethke December 12, 2013