Overview In this two part series on streaming with the Snowflake Data Platform, we use Snowflake for real time analytics. In part one, we use Qlik Replicate to identify changes to source data and replicate the changes to Snowflake in real time including change data for an audit trail. In part two, we show how you can use the change ...
From time to time you need data that does not exist in your own organisation. Enriching an e-mail address with demographic information or validating a postal address are two such examples. In the past you could buy this data from third parties, but Snowflake’s Data Marketplace makes this task much easier and more transparent by bringing together providers and consumers ...
Overview Did you know that the Snowflake data platform is the perfect fit for ETL, data integration, and data preparation tasks? In this blog post we will give you some hands-on advice on how you can use Snowflake as an ETL engine for data preparation. Let’s take this common scenario as an example: Your company has built a data lake ...
A brief history of ETL The rise of ETL and the rise of the data warehouse are tightly coupled. It’s like the chicken and the egg. There would be no data warehouse without ETL and no ETL without data warehouse. Once in a while non-sense such as data virtualisation or NoETL will pop up. However, if you want success with ...
In our previous post Optimisation algorithms for converting XML and JSON to a relational format, we explained that Flexter ships with two optimisation algorithms. These algorithms make the life of downstream consumers of the output of Flexter easier as they simplify the relational target schema that Flexter auto-generates. In this post we will be showing you a second optimisation called ...
