Converting CRS XML to AWS Athena

Uli Bethke October 29, 2021

AWS Athena does not have native support for XML. Processing XML files on AWS Athena is slow, manual, and error prone. One option is to use AWS Glue and convert your XML to CSV, TSV or Parquet. You would need to have technical knowledge to use AWS Glue and to do a lot of manual ...

Read More

Converting XML and JSON to a Data Lake

Uli Bethke September 30, 2021

Data lakes are a popular design pattern in data analytics. A data lake is used to store a copy of data coming from operational source systems such as relational databases. You can choose from dozens of tools to populate a data lake from relational and structured data sources. However, it gets tricky when you want ...

Read More

Converting SDMX XML to BigQuery

Uli Bethke June 22, 2021

You don’t have many options for processing XML on BigQuery. If our data is in Avro, JSON, Parquet, etc. then you can load it easily to BigQuery. But what about XML? BigQuery does not provide any native support to deal with XML documents. Converting XML to BigQuery is a manual, time consuming and error prone ...

Read More

Converting XML to Snowflake, Redshift, BigQuery, Azure Synapse. A comparison

Uli Bethke May 24, 2021

Today, with the rise of the data and cloud-computing applications, the need of storing and analyzing the growing number of semi-structured data is increased. The data originating from a wide range of sources such as sensors, IOT devices, application logs, etc. use semi-structured data formats such as XML, JSON, Avro, etc. because of their flexibility. ...

Read More
1 2 3 19