WHY IT MATTERS: Digital Transformation

Data lakes are key to scalable, open data architectures – but they can pose challenges to data engineering teams. Efficient data integration is the difference between a bunch of log files sitting in Amazon S3 or Azure Storage and a high-performance data lake that provides real value to analytics, data science and engineering teams.
In this guide we will cover some of the essential best practices and guidelines on how to make your data lake analytics-ready using cloud data processing and integration tools.

While CDP vendors may claim to do everything, the fact is they can’t.

We need to be able to fit new concepts and components neatly into existing architecture—to adapt to changes without disruption.

At first glance, the data fabric and the data mesh concepts sound quite similar. Meshes are often made from a type of fabric, after all, and they are both malleable items that can be lain atop things–in this case, your IT systems that are subject to the ever-growing data crush.

But there are fundamental differences to these two approaches, so it’s worth taking some time to learn their differences.

There are many tools available for doing large-scale data analysis, and picking the right one for a given job is critical. Here, we take an in-depth analysis of the architecture and performance characteristics of a completely serverless data processing platform. While the approach isn’t applicable for every use case, it has a very low total cost of ownership (TCO) and because AWS Lambda allows us to run arbitrary code easily, this approach provides the flexibility to handle non-standard data formats easily.

Where should I run my stuff on Google Cloud? #GCPSketchnote

Emerging Technology Roadmap benchmark adoption plan, risk factors, and value drivers. Use this roadmap to help you make technology investment decisions for the coming 12- to 24-month time period.

Performance chapter of the 2021 Web Almanac covering Core Web Vitals (Largest Contentful Paint, Cumulative Layout Shift, First Input Delay) as well as First Contentful Paint and Time to First Byte

The goal of the Web Almanac’s Structured Data chapter is to explore how structured data is currently being used across the web. We hope that this will provide insight into the landscape, the challenges, and the opportunities at hand.

Fluency on the command line is a skill often neglected or considered arcane, but it improves your flexibility and productivity as an engineer in both obvious and subtle ways. This is a selection of notes and tips on using the command-line that we've found useful when working on Linux. Some tips are elementary, and some are fairly specific, sophisticated, or obscure. This page is not long, but if you can use and recall all the items here, you know a lot.

Within a matter of hours of each day beginning, we ingest tens of billions of records from online sources to HDFS, aggregated across 50+ offline data flows, and visualize 40+ metrics across our business lines to support a dashboard providing company leaders with timely and critical business insights. Dubbed the Daily Executive Dashboard (DED), this dashboard contains critical growth, engagement, and bookings metrics that indicate the health of LinkedIn’s business. In this blog post, we’ll spotlight the challenges to DED’s delivery and performance posed by the growing complexity of computing and aggregating these metrics, and how this dashboard transformed our approach to data pipelines across the company.

This year's State of the API report covers the largest and most comprehensive survey on APIs, ever. More than 28,000 developers and API professionals shared their thoughts on a range of topics, including their organizations' development priorities, how they get their work done, and where they see the industry going. We combined this data with data we've observed on the Postman API Platform to build a robust picture of the current state—and the future—of APIs.

Choose more than one vendor solution, if necessary. Vendors in the enterprise search functionality segment have cognitive search solutions that apply to the widest number of use cases and include website search and digital commerce. However, the actual features offered by these vendors vary greatly and may not be the best choice for digital commerce. For example, some vendors in the digital commerce functionality segment have sophisticated tools for merchandising that many more general-purpose solutions lack. It is reasonable and not uncommon for enterprises to have more than one cognitive search solution depending on use cases, data sources, content types, and other factors.

Demand for APIs, fueled by new business models, application development trends and the urgency of modernization, is directing software engineering leaders to the diverse, evolving market for full life cycle API management products. This research assesses 17 vendors to help you make the right choice.

The CNCF Cloud Native Landscape Project is intended to be a resource map to help enterprises and developers through the previously uncharted terrain of cloud native technologies.

The cloud native landscape (png, pdf), serverless landscape (png, pdf), and member landscape (png, pdf) are dynamically generated from github repositories.

The Technology Radar is an opinionated guide to technology frontiers.

The 23rd edition of World Energy Markets Observatory (WEMO) research report reveals a world struggling to balance the critical need to accelerate energy transition while maintaining energy affordability.

Explore how advances in enabling technologies, new investments, and industry transformation have the potential to help mitigate the effects of climate change – and the steps that must be taken to turn possibility into impact.

There are problems with the centralized data lake. A future data mesh needs domains, self-service platforms, and product thinking.

Uncover emerging trends and practices from the world’s most innovative software professionals.

AI Québec is a tech-enabled coffee-table book featuring the champions of Québec, the well-established and the disruptors alike. Its 300+ pages feature stories by the companies who are shaping the Québec of today and tomorrow and include exclusive Thought Leader pieces by the province’s most recognizable advocates. With AR video canvases on most features, images on the book’s pages come to life when scanned with the free Global Village Publishing app.

Gartner have released their Hype Cycle for Digital Marketing, 2021 edition and here we will break down the key takeaways

The internet has ingrained itself into every aspect of our lives, but there’s one aspect of the digital world that I bet you take for granted. Did you ever notice that many links, specifically hyperlinks, are blue?

The CPaaS segment has progressed beyond the provision of a few voice and messaging APIs. Developers and enterprises demand a high level of reliability for phone numbers and messaging delivery, as well as vertical use case templates and tools for rapid onboarding and deployment.

Key attributes enterprises should consider when seeking a CPaaS provider:

• Carrier-grade network infrastructure
• Demonstrable use cases
• Software integrations
• Ancillary services