WHY IT MATTERS: Digital Transformation
214.8K views | +3 today
Follow
WHY IT MATTERS: Digital Transformation
Get weekly or monthly digest of all posts in your inbox: https://fmcs.digital/wim-subscribe
Curated by Farid Mheir
Your new post is loading...

Popular Tags for this blog

Current selected tags: 'CloudComputing', 'Software Engineering', 'Big Data'. Clear
Scooped by Farid Mheir
Scoop.it!

AWS Data Lakes: Architecture Examples and Diagrams #referenceArchitecture via @upSolver #AWS #BI

AWS Data Lakes: Architecture Examples and Diagrams #referenceArchitecture via @upSolver #AWS #BI | WHY IT MATTERS: Digital Transformation | Scoop.it

This frequently-updated page contains real-life examples and diagrams from Upsolver customers who are using AWS data lakes. While the Upsolver platform itself is a key component in all of these architectures, we hope even non-customers can learn from these examples when it comes to the use cases, considerations, and design patterns that go into a typical cloud data lake.

Farid Mheir's insight:

WHY IT MATTERS: you don't see this often these days. A useful compilation of data lake reference architectures - of coursed biased by software vendor upsolver and AWS, but still very useful - with links to the original engineering blogs. Bravo!

ChikkTinny's comment, January 12, 2022 11:17 PM
hloo
Scooped by Farid Mheir
Scoop.it!

7 Best Practices for High-performance #DataLakes

7 Best Practices for High-performance #DataLakes | WHY IT MATTERS: Digital Transformation | Scoop.it

In this article, we’ll present seven of the key best practices you should adhere to when designing, implementing and operationalizing your data lake. These are things that will mostly be automatically implemented if you’re using Upsolver, but if you’re building your data lake ‘manually’ you’ll need to ensure they’re done correctly if you want to get the most value out of your data lake architecture.
While we will mostly be referring to Amazon S3 as the storage layer, these best practices would also apply for a data lake built on a different cloud or using Hadoop on-premise.

Farid Mheir's insight:

WHY IT MATTERS: an obviously biased post form upsolver that nonetheless highlights interesting optimizations that you still need to perform when building data lakes.

Curated by Farid Mheir
Get every post weekly in your inbox by registering here: http://fmcs.digital/newsletter-signup/