Converting clinical trials XML data to Snowflake and Quicksight with Flexter

Uli Bethke Flexter, Snowflake

In this blog post we will show case Flexter, Sonra’s ETL tool for complex XML/JSON data standards. We will convert a large number of XML documents into a relational data warehouse. The documents contain information about clinical trials. The XML files are publicly available on ClinicalTrials.gov. As of March 2019, 299,015 XML documents are available for download. This translates to ...

Big Data, Data Warehouses, Business Intelligence, Data Analytics Intern

Uli Bethke Big Data

Interested in Big Data, Data Warehouses, Business Intelligence, Data Analytics? Want to learn more about data warehousing, data analytics, and cloud computing (AWS, Google, Azure)? Sonra Intelligence is looking for a computer science intern to join our growing team based in Dublin 7 Grangegorman DIT campus Starting asap The position is full time. Working remotely is an option. Duration: 3-6 ...

The evolution of cloud data warehousing

Uli Bethke Data Warehouse

Let’s have a look at the evolution of cloud data warehousing. It’s hard to believe, but just a few years ago all data warehouses were run on-premise. Some of them on expensive and highly engineered MPP appliances. Very fast. Not cheap. Smaller data warehouses would run on relational databases such as Oracle or SQL Server, which had been originally engineered ...

Snowflake date and time dimension

Uli Bethke Uncategorized

Here is a simple SQL script that will generate a date dimension in Snowflake. We are using the built-in GENERATOR and SEQ function. Start date for the dimension is 2017-01-01.