In this post we will show you how to use Flexter, Sonra’s data warehouse automation solution for complex XML and JSON documents. We will use Flexter in combination with Paranoid, Sonra’s open source tool for masking and obfuscating XML and JSON documents. We will first mask a Sabre XML document with Paranoid and then convert the data to Snowflake, a ...
In this article we will show you how to use Sonra’s data warehouse automation solution for complex XML and JSON documents, Flexter. We will process Asana JSON that we got from Asana’s API and convert the data to TSV text files on AWS S3 object storage. Flexter is a Spark application written in Scala. For this blog post we will ...
What is data warehouse automation? I have been struggling to find a good article or post that explains data warehouse automation. To address this gap I have decide to write up my own post. I hope it helps. As always, feedback is welcome. Data warehouse automation is not some sort of wizardry. It does not automagically build, model, and load ...
In this blog post we will show case Flexter, Sonra’s data warehouse automation solution for complex XML and JSON documents. We will process Trello JSON for this showcase. Flexter is a Spark application written in Scala. For this blog post we will use the managed cloud version of Flexter. Flexter SaaS is built on top of container technology. You ...
Redshift offers limited support to work with JSON documents. We have two options to load JSON data into Redshift. We can convert JSON to a relational model when loading the data to Redshift (COPY JSON functions). This requires us to pre-create the relational target data model and to manually map the JSON elements to the target table columns. There are ...
