Big Data News: Convergence with Mapr and Faster Stateful Streaming Processes with Spark

Uli Bethke Big Data, DFS, HUG Ireland, MapR, Spark

Mapr on Impedance Mismatch and how convergence is achieved for layered architecture along with Databricks on using the new Spark API “mapWithState” for faster Stateful Spark Streaming As our big data world comes to the end of another week, the team at Sonra have been once again impressed by the weeks highlights in big data. Mapr has shared its insights ...

Big Data News - Innovative Innovations on Hadoop by Twitter & LinkedIn...

Uli Bethke Big Data, DFS, Hadoop

From Twitter’s innovative Namespace Design to LinkedIn’s Gobblin 0.5.0 release, which now includes Apache Kafka integration The team at Sonra have been impressed by the innovative developments reviewed through the week and the Social Media giants once again come to the forefront for their innovative developments on Hadoop that bear mention for their insightful design responses to problems experienced at ...

Big Data News - Apache Ignite™, High Fashion PCA’s and Bloom Filters… tailoring your big data approach!

Uli Bethke Big Data, Data Science, Data Science, DFS, Distributed Computing

Significantly reduce your storage requirements using PCA and exponentially ignite your processing speed on Spark   An innovative use case for principal component analysis from Eigen Style was delivered in a blog post by Grace Avery. The objects in question are pictures of models modelling womenswear and how components of the pictures can be "modelled" across many pictures using principle ...