In this post we will explain the clever caching strategies Snowflake uses for performance optimization. In the process we will also cover related internals of Snowflake. A lot of information is from the official research paper created by the Snowflake authors which explains the architecture of Snowflake in depth. Caching in virtual warehouses Snowflake strictly separates the storage layer from ...
Big Data, ETL, Data Warehouse Intern Interested in Big Data, Data Warehouses, ETL, Business Intelligence, Data Analytics? Sonra Intelligence is looking for a computer science intern to join our team based in our office (Dublin 7 Grangegorman DIT campus) or remotely. Duration Starting asap The position is either full time or part time. Working remotely is an option. 3-6 months ...
Flexter Data Liberator Earns Key Business Intelligence Software Recognitions from Reputed Business Software Directory We are proud to announce that our XML/JSON converter Flexter Data Liberator received two awards - Great User Experience award 2018 and Rising Star award 2018. These awards, together with the great review, were granted by software directory FinancesOnline. The Great User Experience award is given ...
We have release Flexter 1.2.0 this week. We have added some significant new features and improvements. Flexter now supports conversion of JSON to a database, text (CSV/TSV), and Hadoop/Spark (ORC, Parquet, Avro). We now support the conversion of very large XML files of multi-GB sizes without any pre-processing. We have made performance improvements to the core parser. Flexter has always ...
In this blog post we liberate data and metadata from the shackles of Excel. We convert all of the content of an Excel file to a relational database and then query the output to determine data lineage, formulas used, formatting used, tables and pivot tables inside Excel, errors in formulas and their dependencies etc. Few people are aware that Excel ...
