Converting XML and JSON to a Data Lake
Uli Bethke
Data lakes are a popular design pattern in data analytics. A data lake is used to store a copy of data coming from operational source systems such as relational databases. You can choose from dozens of tools to populate a data lake from relational and structured data sources. However, it gets tricky when you want ...
Read MoreConverting SDMX XML to BigQuery
You don’t have many options for processing XML on BigQuery. If our data is in Avro, JSON, Parquet, etc. then you can load it easily to BigQuery. But what about XML? BigQuery does not provide any native support to deal with XML documents. Converting XML to BigQuery is a manual, time consuming and error prone ...
Read MoreConverting XML to Snowflake, Redshift, BigQuery, Azure Synapse. A comparison
Today, with the rise of the data and cloud-computing applications, the need of storing and analyzing the growing number of semi-structured data is increased. The data originating from a wide range of sources such as sensors, IOT devices, application logs, etc. use semi-structured data formats such as XML, JSON, Avro, etc. because of their flexibility. ...
Read MoreThe 6 Factors You Need to Get Right to Make Your XML Conversion Project a Success
A successful XML conversion project makes data: Intelligible Readable, and Analysable Achieve that and decisions can be made quickly on accurate and reliable data. Unfortunately, many projects fail because of time, resource, or budget restrictions. This is both frustrating and expensive. Get the following elements right to ensure that you see your project through to ...
Read More