Converting SDMX XML to BigQuery
Uli Bethke
You don’t have many options for processing XML on BigQuery. If our data is in Avro, JSON, Parquet, etc. then you can load it easily to BigQuery. But what about XML? BigQuery does not provide any native support to deal with XML documents. Converting XML to BigQuery is a manual, time consuming and error prone ...
Read MoreSnowflake vs. Redshift – Support for Handling JSON
ANSI SQL 2016 introduced support for querying JSON data directly from SQL. This is a common use case nowadays. JSON is everywhere in web based applications, IOT, NoSQL databases, and when querying APIs. In this document we compare Amazon Redshift and Snowflake features to handle JSON documents. Loading JSON data In this section, we will ...
Read MoreUsing Virtual Data Marts the right way
Virtual data marts can be a useful design pattern but there are a few things you should know before you use them. Virtual data marts are logical views modeled dimensionally on top of an integration layer or a persisted staging area. Don’t confuse them with data virtualisation or data federation. Virtual data marts are built ...
Read MoreConverting XML to Snowflake, Redshift, BigQuery, Azure Synapse. A comparison
Today, with the rise of the data and cloud-computing applications, the need of storing and analyzing the growing number of semi-structured data is increased. The data originating from a wide range of sources such as sensors, IOT devices, application logs, etc. use semi-structured data formats such as XML, JSON, Avro, etc. because of their flexibility. ...
Read More