Optimize Azure Fabric Pipelines with This Key Spark Setting

July 23, 2025 Daniel Janik

Boost Your Azure Fabric Pipelines: Don’t Overlook This Crucial Spark Setting

Are your Azure Fabric pipelines with multiple notebooks running slower than you’d like? Are you paying for more Spark compute time than you should be? The culprit might be a simple setting that’s easy to miss. In this blog post, we’ll dive into the “For pipeline running multiple notebooks” setting in Azure Fabric and explain why enabling it can significantly improve your pipeline’s performance and reduce your costs.

Using AI to create test data

January 8, 2024January 8, 2024 Daniel Janik2 Comments

Have you ever been tasked with creating test data for an application and then ran into performance problems once the application moves to production?

SQL 2019 UDF (User defined function) inlining

June 9, 2020June 24, 2020 Daniel Janik

SQL Server 2019 brings a lot of great new features. Many are introduced by the IQP (Intelligent Query Processing) features and greatly improve query performance.

May the forced be with you?

May 4, 2020May 5, 2020 Daniel Janik

Today is May the fourth and I’ll start by saying: Happy Star Wars day to all. Since it is May the fourth I figured a Star Wars themed post would be nice.

Why is the XLOCK table hint broken?

February 11, 2020February 12, 2020 Daniel Janik1 Comment

Let’s talk about what XLOCK is supposed to do. XLOCK is a table hint that can be applied to a query to place an exclusive lock on the resources that the query accesses. This can be very dangerous because an exclusive lock on a table or partition could cause significant performance concerns.

Free SQL tuning tool: How’s My Database?

February 13, 2019February 13, 2019 Daniel Janik1 Comment

It’s taken longer than I thought it may and I’ve run into several problems along the way but had a few people in the MVP community swing some homeruns to help me complete the BETA of this new SQL Server community query tuning tool.

Hello Denver! I’m speaking this weekend

September 11, 2018September 10, 2018 Daniel JanikLeave a comment

For those of you in the Denver area, SQL Saturday is this weekend! I’m speaking and hope to see you there.

If you haven’t registered yet, no problem. The details are here:

http://www.sqlsaturday.com/774/eventhome.aspx

There’s a ton of great speakers and you don’t want to miss this one.

Are scalar functions really a bad thing?

September 10, 2018September 10, 2018 Daniel Janik6 Comments

I’ve read a lot of things lately pointing to scalar functions as if they were the devil. In this blog I’m going to explore if that’s the case. Let’s have a look.

SQL Tuning: Finding statements for missing indexes

April 20, 2018April 20, 2018 Daniel Janik1 Comment

Missing indexes are an important part of the indexing strategy. I usually start with sys.dm_db_index_usage_stats to find both inefficient and unused indexes and then supplement with missing indexes.

The missing index DMVs are great but they’ve always been missing something.

Query tuning: Apply yourself

April 6, 2018 Daniel Janik1 Comment

It’s Friday and I’m ready for the weekend as I’m sure everyone else is. This weekend I’m looking forward to getting yard work done and browsing through the whoisactive SQL Ops Studio extension code.

SQL TECH BLOG

Category: Performance