TWIL: June 26, 2022
Have you heard about Data Mesh? It’s a hot topic in the data and analytics area, so I decided to give it a look as well and recommend a few articles, including a great video by Zhamak Dehghani, in case you’re interested too. Also, a cool website that aggregates multiple content feeds about Azure, and the very interesting C4 visualization model for software architecture. Enjoy!
Episode 1799: WebRTC with Liz Moi
What is WebRTC, and why do you want to use it? While at NDC London, Carl and Richard talk to Liz Moy about WebRTC, the open-source library that is used by many of your favorite video chat applications. Liz talks about taking advantage of the hard work already done to control video and audio devices through the browser, as well as the various strategies for actually connecting to other people through firewalls and NAT routers. The conversation also explores where and when you would want to have integrated video, audio, screensharing, and data transfer capabilities.
The Azure Podcast
Episode 427: Software for Open Networking in the Cloud
The team catches up with Sarah Novotny and Xin Liu to learn about both the network switch SONiC and why Microsoft recently transferred control of it to the Linux Foundation.
The Stack Overflow Podcast
Episode 455: Experts from Stripe and Waymo explain how to craft great documentation
We chat with Jared Bhatti and Zachary Sarah Corleissen, two technical writers with deep experience at major tech companies and open source projects, about their approach to documentation and the new book they helped co-author, Doc For Devs.
Episode 846: Enabled Play for everyone with Alex Dunn
Enabled Play helps people turn anything into a new input for their computers, game consoles, and more. Powered by offline, private, and personalized Artificial Intelligence and distributed services – all packed into affordable devices and apps. Imagine playing Elden Ring with just your facial expressions! Or enabling keyboards, mice, and game pads with whatever devices will best set you up for success. Enabled Play enable folks with disabilities, different levels of abilities, basically everyone to be their best selves on any device. Scott talks to Alex Dunn about the ideas and goals behind his company, how he built it, and how Enabled Play is about Work, Life, and Play for everyone.
Kasper On BI
What is Data Mesh on Azure with Power BI with Paul Andrew
In this episode of Kasper On BI we are talking about Data Mesh. It is something that we have been hearing more and more about in the last year. Data Mesh is an interesting data management solution that is a new approach to sourcing, sharing, accessing, and managing analytical data at scale. In this episode we will investigate what it is? How is it different than traditional DWH (Kimbal\Imnon?). What are the benefits? How to build and set it up? What about governance? What role does Power BI play?
Website that aggregates feeds about Azure from multiple sources, including Microsoft official websites and content published by experts.
The C4 Model for visualizing software architecture
The C4 model was created as a way to help software development teams describe and communicate software architecture, both during up-front design sessions and when retrospectively documenting an existing codebase. It’s a way to create maps of your code, at various levels of detail, in the same way you would use something like Google Maps to zoom in and out of an area you are interested in.
K8s – DNS
DNS is one of the core features of K8s, providing naming services through kube-dns or CoreDNS as a must-have extension for K8s cluster. Since K8s master stores all service definitions and updates, when client pod needs to communicate with backend pods which behind a load balancer, it needs to know where to send the request. K8s DNS system is designed to solve this problem.
Data Lineage Concepts, Hierarchies, Visualizations and Roles in the Age of Big Data
As a very important part of data governance, the data lineage relationship needs to be paid special attention. In this article, let’s take a closer look at the concepts, hierarchies, visualizations and roles of data lineage.
Data Mesh: Get value from data at scale
Data Mesh is an analytical data architecture and operating model where data is treated as a product and owned by teams that most intimately know and consume the data. Data Mesh applies the principles of modern software engineering and the learnings from building robust, internet-scale solutions to unlock the true potential of enterprise data.
Building a Data Mesh Architecture in Azure
The concepts and principals of a data mesh architecture have been around for a while now and I’ve yet to see anyone else apply/deliver such a solution in Azure. I’m wondering if the concepts are so abstract that it’s hard to translate the principals into real world requirements, and maybe even harder to think about what technology you might actually need to deploy in your Azure environment.
The hub-and-spoke model: An alternative to data mesh
Data mesh is a hot topic in the data and analytics community. Introduced in 2020 by Zhamak Dehghani in her paper “Data Mesh Principles and Logical Architecture”, data mesh is a new distributed model for organizing analytics teams to deliver data products and is meant to address the challenges of both centralized and decentralized data. But is this approach truly the best approach for today’s enterprises?
With glass buried under ice, Microsoft plans to preserve music for 10,000 years
Nothing is forever. By Microsoft’s estimation, hard drives protect data for five years before they can go bad. Tape lasts about a decade, while CDs and DVDs can make it as long as 15 years before their contents are at risk of becoming illegible. This is the core challenge behind the Global Music Vault. Located in Norway, it’s part of a cold-storage facility drilled into the very same mountain as the Svalbard Global Seed Vault. While the seed vault protects the earth’s cache of seeds, the Global Music Vault aims to preserve the sonic arts for generations to come.
Your words are wasted
You are not blogging enough. You are pouring your words into increasingly closed and often walled gardens. You are giving control – and sometimes ownership – of your content to social media companies that will SURELY fail. These companies are profoundly overvalued, don’t care about permalinks, don’t make your content portable, and have terms of service that are so complex and obtuse that there are entire websites dedicate to explaining them.
GitHub Copilot is generally available to all developers
With GitHub Copilot, for the first time in the history of software, AI can be broadly harnessed by developers to write and complete code. Just like the rise of compilers and open source, we believe AI-assisted coding will fundamentally change the nature of software development, giving developers a new tool to write code easier and faster so they can be happier in their lives.
Have an awesome learning week!
Photo by Clint Adair on Unsplash