Tom Willwerth

To move millions of rows or GBs of data from one SQL Server to another, try using Copy-DbaDbTableDataCopy from dbatools! I ran a quick demo comparing two commands: 🔹 Write-DbaDbTableData 🔹 Copy-DbaDbTableData Both use SQL Bulk Copy under the hood, but here’s what surprised me: 🔹 Copying 1000 rows: Write-DbaDbTableData: 4.5 seconds Copy-DbaDbTableData: 0.067 second The big difference is because Write-DbaDbTableData buffers data in the memory of the machine running the command, while Copy-DbaDbTableData doesn’t, and that makes it way faster and more efficient for large datasets. Also these functions can auto-create destination tables! Details on how to use these functions - https://lnkd.in/eQ6G6B9T #SQLServer #dbatools #PowerShell #DatabasePerformance #SQLTips #DataEngineering #PerformanceMatters #SQLCommunity

258

37 Comments

SSMS 21 Solves a major Blocking Issues!!!  Exciting news for SQL Server DBA's and users ! The team behind SSMS is continuously improving the most popular SQL tool in the world, based on feedback from customers - and this time, it's my turn! DBA's often faced an issue in SSMS when attempting to DROP a database or execute ALTER DATABASE, only to be stopped by idle sessions caused by connection pooling. Despite the GUI providing an option to close active connections when dropping a database, there was no simple way to do this via script, resulting in unexpected blockages. Thanks to Microsoft, this problem has been addressed. The game-changing feature in SSMS 21 is a new option that addresses this issue. Additional features such as incorporating Git and enabling Dark Mode... Download it and experiment with the below link https://lnkd.in/g4JSCbmx

383

27 Comments

SQL Server 2016 has officially reached End of Life (EOL). Staying on it isn’t just risky, it’s costly.   → No more security updates. → No compliance guarantees. → And no room for delay without consequences.   The smart move? Understand the financial and operational risks of doing nothing and start planning before risk turns into reality. Read our full blog: https://lnkd.in/gXKWAQSf   #SQLServer #SQL2016EOL #DatabaseManagement #AtlasSystems

15

Introducing SQL Stored Procedures in Databricks SQL: store and run complex logic once, run it whenever you need, and keep it governed under Unity Catalog! If you’re moving from an EDW, easily migrate your existing stored procedures without rewriting. SQL Stored Procedures follows the ANSI/PSM SQL standard and is interoperable with open source. Learn more: https://lnkd.in/gMpBwVwz

884

23 Comments

🛠️ Every DBA needs a toolkit—this one feels like having a whole team of experts on call. One of the most impressive community contributions in the SQL Server world is Brent Ozar’s First Responder Kit. 👉 What it does: sp_Blitz → instantly tells you what’s wrong with your SQL Server. sp_BlitzCache → shows why queries are slow. sp_BlitzIndex → helps you understand and fix indexing problems. sp_WhoIsActive (included) lets you see what’s happening right now. Instead of spending hours digging through logs, you can run a procedure and get a clear, prioritized report—like having a first responder on the scene of a database emergency. ⚡ I’ve used it, and it’s not just helpful—it’s impressive. It saves time, reduces stress, and makes you look like the calmest person in the room when systems are on fire. 💡 The best part? It’s free and open-source: 🔗 GitHub: https://lnkd.in/dNjR4kqU 🌐 Website: https://www.brentozar.com/ Huge respect to Brent Ozar Unlimited Brent Ozar and the team for creating something that helps DBAs worldwide. 🙌 Brent, your First Responder Kit has saved my career more times than my backups ever did.” 😅 DBAs—have you tried the First Responder Kit? If yes, what’s the biggest win it’s given you? #SQLServer #DBA #PerformanceTuning #Community #OpenSource

190

16 Comments

Yesterday, I received an alert: Database CPU usage was at 95%. The immediate reaction from the team? "We need to scale the server." But as a DBA, I've learned that throwing hardware at a problem is the most expensive way to fix a bad query. I dug into the Top 5 Wait Events and found the real culprit: db file scattered read. The CPU wasn't working on complex calculations. It was working overtime just to manage massive Full Table Scans. A critical report was missing a single index on a JOIN column, forcing Oracle to read 10 million rows instead of 10. I added the missing index, and the CPU usage dropped from 95% to 15% instantly. High CPU is usually a symptom, not the disease. Before you ask for a hardware upgrade, check your execution plans. Tuning a single SQL statement can often save the company more money than a server upgrade ever could #Oracle #dba

78

4 Comments

SQL Challenge (Day-6): Fix the Flawed Schema You're consulting for Retaillytics Inc., an e-commerce startup. They've created a test orders table, but the data types are inconsistent and need to be corrected. #SQLChallenge #DataCleaning #DatabaseDesign #SQLSchema #EcommerceData #TechConsulting #DataTypes #RetailAnalytics #SQLFix #DataEngineering #SQLPractice #LearnSQL #360DigiTMG

57

41 Comments

🚀 Introducing pgtools: Battle-Tested PostgreSQL Scripts for the DBA Community I'm excited to share pgtools—an open-source collection of SQL scripts and utilities I've been collecting and building for PostgreSQL monitoring, troubleshooting, and optimization. What's Inside This toolkit includes 40+ production-ready scripts organized into 12 categories: Monitoring: Lock analysis, replication lag, bloat detection, connection pooling efficiency Performance: Query profiling, wait event analysis, resource monitoring Security: Permission audits and compliance checks Automation: Intelligent maintenance scheduling with parallel processing Integration: Grafana dashboards and Prometheus exporters From identifying missing indexes to preventing transaction wraparound, these scripts handle real-world database challenges I've encountered across 13+ years of PostgreSQL administration. The Vision: pgtools + iqtoolkit-analyzer Here's where it gets interesting—I'm planning to integrate pgtools directly into iqtoolkit-analyzer, creating an AI-powered database analysis platform that combines: ✅ Battle-tested diagnostic queries from pgtools ✅ Automated analysis and pattern recognition ✅ AI-driven recommendations and remediation guidance The goal? Transform raw diagnostic data into actionable intelligence. Instead of running scripts manually and interpreting results, iqtoolkit-analyzer will execute these queries, correlate findings across multiple data sources, and provide context-aware recommendations. This integration represents the evolution from traditional DBA tooling to AI-enabled database architecture—where automation meets expertise. Get Started 🔗 Repository: https://lnkd.in/gSZQEeSk 📖 Documentation: Complete beginner's guide included 🤝 Contributions welcome! If you're working with PostgreSQL or interested in AI-database tooling, I'd love to hear your thoughts. What database challenges are you facing that could benefit from intelligent automation? #PostgreSQL #DatabaseAdministration #OpenSource #DevOps #iqtoolkit #AIEngineering #DatabaseOptimization

128

4 Comments

When you make a small SQL change, you shouldn’t have to rerun your entire project. The dbt Fusion engine changes that. It understands your SQL before it runs, validates code instantly, and only executes what’s actually changed. In this on-demand demo, Sara Gawlinski walks through how the Fusion engine transforms the development process. You’ll see how: • Real-time validation in VS Code catches issues before they hit production • State-aware orchestration intelligently skips unchanged models • Fusion’s Rust-based architecture speeds up performance across Snowflake, Databricks, BigQuery, and Redshift • dbt Studio brings it all together for a faster, safer path from local dev to production Watch the full demo https://lnkd.in/ghbxiRgq

242

6 Comments

Hi! I'd like to share a simple script that helps visualize database growth over time. It uses data from the "msdb.dbo.backupfile" table, where SQL Server stores information about a database's data and log files at the time each backup is taken. To use this script, you just need to have regular backups configured for your databases. I believe every company has that in place! :) Note:  - zero resultset means that db files are not growing - negative growth means a decrease of file size (shrink?) Query: ---------------------------------- declare @db sysname = N'DBA'; WITH t1 AS ( SELECT row_number() OVER ( PARTITION BY bs.database_name ORDER BY bs.database_name ,CONVERT(VARCHAR(20), bs.backup_start_date, 112) ) [id] ,bs.database_name ,CONVERT(VARCHAR(20), bs.backup_start_date, 106) [dt] ,sum(bf.file_size / 1024 / 1024) [DBSizeMB] ,sum(iif(bf.file_type = 'D', bf.file_size, 0)) / 1024. / 1024. [DataMB] ,sum(iif(bf.file_type = 'L', bf.file_size, 0)) / 1024. / 1024. [LogMB] ,max(bs.backup_set_id) [bsid] ,bs.type FROM msdb..backupset bs JOIN msdb..backupfile bf ON bs.backup_set_id = bf.backup_set_id WHERE bs.database_name = @db GROUP BY bs.backup_start_date ,bs.backup_set_id ,bs.database_name ,bs.type ) SELECT     t1.database_name [Database] ,t1.dt + ' - ' + t2.dt [Period] ,t1.type + ' - ' + t2.type [Backups] ,convert(NUMERIC(10, 1), t2.DBSizeMB - t1.DBSizeMB) [DBGrowthMB] ,convert(NUMERIC(10, 1), t2.DataMB - t1.DataMB) [DataFileGrowthMB] ,convert(NUMERIC(10, 1), t2.LogMB - t1.LogMB) [LogFileGrowthMB] ,convert(NUMERIC(10, 1), t1.DBSizeMB) [FirstSize] ,convert(NUMERIC(10, 1), t2.DBSizeMB) [LastSize] FROM t1 JOIN t1 t2 ON t1.database_name = t2.database_name AND t1.id + 1 = t2.id WHERE t2.DBSizeMB - t1.DBSizeMB <> 0 ORDER BY t1.bsid DESC ---------------------------- Sample:

215

27 Comments

For developers who live in the terminal, Snowflake CLI is the essential command-line tool for your workflow. Join Lead Developer Advocate, Gilberto Hernandez, for a quick demo on Snowflake CLI. Learn how to configure a default connection and test it, run SQL commands, and even deploy a Streamlit app directly from the command line. Snowflake CLI enables powerful automation, streamlined development workflows, and remote connections. It's the essential tool for working with features like Streamlit, Snowflake Notebooks, and Snowflake Cortex. Learn more: https://lnkd.in/gPMdpc6n Watch the demo: https://lnkd.in/gZhh5BSX

110

1 Comment

Got a Sizable SQL Server Estate? Automation is your best friend. If your DBA is still manually connecting to each instance to check backups, migrations, or health... stop them before they develop a permanent coffee dependency :) I've been using dbatools for a few years now, and it's a powerhouse toolkit for SQL Server. Whether you have an on-prem, cloud, or hybrid environment, dbatools lets you automate repetitive tasks so you can focus on driving real impact. Pro tip: Start with one small task, automate it, and watch your stress levels drop faster than a long-running query. download here: https://dbatools.io/ Install in powershell: Install-Module dbatools

117

7 Comments