Episode 285: Who Is Using Microsoft Fabric
SQL Data Partners Podcast
Fabric personas were originally designed to break down the various functional roles within Microsoft Fabric—such as Power BI, Data Factory, Data Activator, Data Engineering, Data Science, Data Warehouse, and Real-time Analytics—into more manageable, bite-sized sections. The goal was to prevent users from feeling overwhelmed by the platform’s breadth. However, this feature has since been discontinued, as it did not effectively communicate the seamless integration between these roles. Still, the underlying concepts can be useful when thinking about how you might approach Fabric from a...
info_outline
Episode 284: The Four-Letter Word ETL - Data Movement
SQL Data Partners Podcast
Once you have your data stored in OneLake, you'll be ready to start transforming it to improve it's usability, accuracy, and efficiency. In this episode of the podcast, Belinda Allen takes us on a delightful journey through Data Flows, Power Query, Azure Data Factory (Pipelines), and discusses the merits of shortcuts. We also learn about a handy way to manually upload a table if you have some static data you need to update. There are many tools and techniques that can be used for data ingestion and transformations. And while some of these options we discuss will be up to...
info_outline
Episode 283: Data Lakehouse vs Data Warehouse vs My House
SQL Data Partners Podcast
Microsoft Fabric offers two enterprise-scale, open-standard format workloads for data storage: Warehouse and Lakehouse. Which service should you choose? In this episode, we dive into the technical components of OneLake, along with some of the decisions you’ll be asked to make as you start to build out your data infrastructure. These are two good articles we mention in the podcast that could help inform your decision on the services to implement in your OneLake. We hope you enjoyed this conversation on the nuances of data storage within Microsoft OneLake! If you have questions or...
info_outline
Episode 282: OneLake - A Deep Dive
SQL Data Partners Podcast
In Episode 281, we introduced Microsoft OneLake with a high-level overview. Now we're going deeper with a discussion on the Parquet format, why Microsoft went with the Delta Lake variation, and what Delta Lake format brings to the table (no pun intended). We'll also examine some "behind the scenes" aspects of file management, and why you'll still be using the GUI to create most of your objects. Onelake is Microsoft's solution to the demand for centralizing all data in one location, eliminating the need to transfer it across multiple systems. We expect this to play out further however, when we...
info_outline
Episode 281: OneLake - The OneDrive for Data
SQL Data Partners Podcast
As you start using Fabric, having a central location for your data is crucial. OneLake acts as this unified destination, offering a single, consolidated repository for all your data. In this podcast episode, we explore the core features of OneLake and its benefits with our guest, Mariano Kovo, and discuss how it efficiently handles large amounts of data from diverse sources. We'll also dive into the importance of how your data is presented to Azure services, focusing on the Delta Parquet format. Did you know you can explore OneLake data directly through Windows Explorer? Microsoft aims to make...
info_outline
Episode 280: A Focus on Microsoft Fabric
SQL Data Partners Podcast
At the Microsoft Build Conference in May 2023, Microsoft announced the new Fabric, where you could slice and dice all your data harmoniously within the environment. A few months later, Kevin, Eugene, and I discussed this evolution of the Azure Data platform in , and our thoughts on the vision for it's future, our expectations, and predictions. Now, more than a year later, we decided it's a good time to take an in-depth look at the platform to see what goals have come to fruition, what predictions have come true, and what may have changed. In this introduction to Season 8, we'll get the...
info_outline
Episode 279: SQL Server Migrations Demystified
SQL Data Partners Podcast
If you use SQL Server, you will eventually have to migrate that instance somewhere – to a new version, a new server, the cloud . . . somewhere. Or perhaps you'll find yourself migrating from another database into SQL Server. No matter which way you slice it, SQL Server migrations can be daunting, not to mention complex and time-consuming. While we know there are risks and many things that can go wrong, the "new" Microsoft continues to put time and effort towards making successful SQL Server migrations attainable for everyone. In this episode of the podcast, we chat with Tejas Shah and Sudhir...
info_outline
Episode 278: Running SQL Server on Azure VMs
SQL Data Partners Podcast
Can you run SQL Server on Azure VM? Which VM is best? Is running SQL Server on a VM in Azure the right choice? Find out in this insightful episode with Anders Pedersen! With over 10 different SQL Server services now offered in Microsoft Azure, it can be difficult to know how you want to run your environment. Sometimes, the old ways are the best ways for an organization, and running SQL Server on a VM in Azure is the right fit. In this episode of the SQL Data Partners Podcast, we chat with Anders Pedersen about his experience moving their systems to Azure VMs. We discuss some of...
info_outline
Episode 277: PostgreSQL for the SQL Server Crowd
SQL Data Partners Podcast
Is testing out pgAdmin on your to-do list? In this episode of the podcast, we chat with Ryan Booz, a PostgreSQL advocate at Redgate, about how a SQL Server professional might begin a dive into PostgreSQL, one of the most popular open source databases in the world. Ryan came from a career background in SQL Server, but after experiencing his accidental "jump-into-the-deep-end" PostgreSQL moment, he hasn’t looked back. Naturally, open source presents DBAs and their organizations with many desirable features, but there are certain drawbacks as well. Ryan shares how he navigated his transition...
info_outline
Episode 276: Dynamic SQL and Testing in Isolation
SQL Data Partners Podcast
Listener beware! This episode is full of danger as we tackle an interesting use case for Dynamic SQL. Dynamic SQL generally has a bad reputation in SQL Server circles, and with good reason. Dynamic SQL can open the door to many undesirable results - SQL Injection attacks being the most frightening of these. It can also be difficult to read, making maintenance problematic; however, in this episode one brave soul - Marathon's own Laura Moss - explains how she uses Dynamic SQL to help refresh a subset of production data to be used in their development environments. You know we are always suckers...
info_outlineWe love hearing from our listeners!!! In this episode, a long-time listener asked about the future of AI in the data platform space. We thought this was a very interesting topic as Microsoft has been including Artificial Intelligence or AI in more and more of its marketing material. In this episode we'll dive into the definition of AI, what features are currently available, how we can leverage those technologies, and where we think this might go in the future. One of the challenges we currently face is all the buzz and excitement around AI. From a data platform vantage point, we started with analytics and training models to analyze the data. Microsoft has suddenly slapped Artificial Intelligence on some of the feature sets and confuses the issue a bit.
We are excited to have Mike Chrestensen from Duke Health as our episode guest to help us sort it all out. Mike has begun leveraging AI in his work and I think he gives some interesting thoughts on how he has used it to help his team go faster. We hope you enjoy the episode. As always, we welcome your feedback and thoughts.
The show notes for today's episode can be found at Episode 268: AI and the Future of the DBA. Have fun on the SQL Trail!