loader from loading.io

Migrating a Large Database

Voice of the DBA

Release Date: 04/26/2022

Eight Minutes show art Eight Minutes

Voice of the DBA

When I was at the , one of the speakers was talking about their work with AI technologies. This person uses it a lot in their day job, often to complete tasks that they would have struggled to work on in the past, mostly because of time constraints, but also a lack of resources. Sometimes this person has an idea, but doesn't want to distract themselves or others by having them work on a side project. During a recent ride in a (self-driving car), this person had their laptop out and running Claude Code. They gave it a prompt, asking it to build a small app for some data analysis. During the...

info_outline
JSON Has a Cost show art JSON Has a Cost

Voice of the DBA

JSON seems to be everywhere these days. Many application developers like it across all sorts of languages, C#, JAVA, Python, and more. They use it for transferring information between systems, and are comfortable serializing hierarchical object data into JSON from text and de-serializing it back into its various elements. For those of us working in relational databases, JSON seems like a blob of information that isn't easily queried, indexed, or stored. We prefer working with a relational set of data, which brings us into conflict with software developers. We'd like them to convert their...

info_outline
An SSIS Upgrade show art An SSIS Upgrade

Voice of the DBA

I came across a post recently on the Microsoft Fabric blog about ..I hadn't heard much about SSIS in SQL Server 2025, so I thought this might provide some info on the investments that Microsoft is still making in Integration Services. I've run into a few people in the past year who are still heavily invested in SSIS and run packages daily. SSIS seems to be a technology that isn't even close to dying for many organizations. The blog starts well, delving into the security investments with the change to the SqlClient and TLS 1.3, as well as supporting Strict Encryption. I don't know many people...

info_outline
Where Your Value Separates You from Others show art Where Your Value Separates You from Others

Voice of the DBA

I ran across a post that discusses (via ). The main point of the post is that there is a core skill that separates senior engineers from others, which is reducing ambiguity. When a senior engineer gets an ill-defined (or ill-communicated) request, they can deliver a solid, or even great, result. When someone says "performance is poor," what do you do with that? Can you build a plan to identify the issues and solve them? Or do you expect the customer to explain what is slow and why it's slow? What metrics do they have showing things are slow? A senior engineer can ask questions to find the...

info_outline
Your AI Successes show art Your AI Successes

Voice of the DBA

Recently, I was discussing AI with a friend, and they asked me to name a great success of using AI to build software. I've tried a few things, and I've worked with customers who are using AI tech. However, most of the things I've seen built with AI are small tasks; they're utilities or quick wins that change a minor part of the software. The items tend to be tactical and focused in a narrow band of fixes, and they might save a programmer time, but I'm not seeing large-scale team improvements in productivity. Yet. Read the rest of

info_outline
Minimally Viable Security show art Minimally Viable Security

Voice of the DBA

Security has been a constant concern for many IT professionals over the years. Many of us are trying to implement better security controls, and yet at the same time, we try to avoid anything that slows us down. Security clearly hasn't been a big enough concern, as we've had more than our share of SQL Injection issues. These often come about from poor practices, lack of education, and too many people not learning to adopt better habits across time. We've also had no shortage of , , and more over the years. While security (or cybersecurity) is listed as , they are quick to avoid slowing down any...

info_outline
The North Star for the Year show art The North Star for the Year

Voice of the DBA

It's the beginning of the year, and some of you likely have today off. But plenty of you are at work, moving slowly through this Friday at the start of the year—handling busywork, catching up on maintenance you've let slide, or preparing for the tasks you know will start coming Monday. At Redgate, most engineering teams work toward a North Star goal: a high-level direction that guides your various tasks. Perhaps it's growing a customer base or achieving an overarching product specification. For example (this is completely made up), one North Star might be achieving feature parity across all...

info_outline
Finding Motivation show art Finding Motivation

Voice of the DBA

I ran across a tweet (are they still tweets?) on X/Twitter that was titled: . It had these items, which seem to be coming from a young person. Either a student or in their first job. Stay on your phone all day. Feel sad for no clear reason. Stop eating well and ignore your studies. Sleep super late and wake up in the afternoon. Let sadness take over everything. Always look at others' lives and feel yours isn't enough. Keep blaming yourself for the past but never try to let it go. Compare your progress with people who started years before you. Get stuck imagining outcomes instead of creating...

info_outline
The Side Job show art The Side Job

Voice of the DBA

Most of you reading this are likely technology professionals of some sort. You might be a software developer in C# or a DBA or a manager of those teams. Maybe you're an analyst working with data and reporting. You have made this a career choice and (hopefully) are growing and learning more about your craft. I also expect that you want to continue working in the area you are now, or maybe want to move into a related area. Maybe a report writer wants to move into more warehousing/lake housing. Maybe a DBA wants to be a Reliability Engineer. You have a career and you're working in that area. Read...

info_outline
Your Value from a Conference show art Your Value from a Conference

Voice of the DBA

The PASS Data Community Summit 2025 was held in Seattle last month, and it was an interesting event for me. I wrote a , but a few things stood out. The event was a little smaller, with over 50% first-time attendees, but seemed to be a bit more vibrant. Perhaps people coming for the first time added something that I hadn't expected. I was a bit over-committed, so I didn't spend a lot of time in the public spaces, but things felt a little different the few times I was in the expo hall or the hallway track. I ran across on the value of conferences, and it got me thinking. What is the value that...

info_outline
 
More Episodes

I have upgraded lots of SQL Servers from one version to the next, and for the most part, the process has been smooth. That's not always the case, and there have been some long nights where the Operations staff had to scramble to fix things, script out old logins, call Microsoft support, and perform various data exports and imports to get a new instance running. I've been a part of quite a few of those teams.

Most of my upgrades were with relatively small databases, at least small for that time period. However, I have upgraded a few "large" databases in the past. We had a 400GB database on SQL Server 6.5 in 1999 that was a challenge to move to SQL Server 7. I also upgraded an 800GB database in 2001 from 6.5 to 2000 for our Financial team, which involved a lot of stress.

Read the rest of Migrating a Large Database