How to create a Case Insensitive Warehouse in Microsoft Fabric
This is a quick blog post to show you how to use a Microsoft Fabric Notebook to quickly and easily create a Case Insensitive Warehouse. Just a quick note when I talk about a Case Insensitive Warehouse, what that means is that the upper casing and lower casing of column names and text are ignored. By default, Warehouses and Lakehouse’s…
How to read and write to different Lakehouse’s in different App Workspaces when using a Fabric Notebook
With the new Schema’s in a Lakehouse, it now is possible to read from Lakehouse A (In Workspace A) and write to Lakehouse B (In Workspace B). Here are more details about the Schema preview: Lakehouse schemas (Preview) – Microsoft Fabric | Microsoft Learn This opens a whole new world of possibilities. I also really like the fact that I…
View all your Storage consumed in Microsoft Fabric – Lakehouse Files, Tables and Warehouses
One of the things I have found when working with my customers in Microsoft Fabric is that there is currently no way to easily view the total storage for the entire tenant. Not only that, but it would also be time consuming and quite a challenge to then find out what is consuming the storage. Could it be large files…
How to view or track the progress of Notebook while it is running in Microsoft Fabric
How to view or track the progress of Notebook while it is running in Microsoft Fabric I was recently working with a Notebook in Microsoft Fabric that was started via a Data Pipeline. The challenge I had was that I had no idea how far the notebook had gone (as there were quite a lot of cells in this particular…
Using a Service Principal to get all Entra ID Group Members into JSON File using a Python Notebook
Using a Service Principal to get all Entra ID Group Members into JSON File using a Python Notebook Sometimes it is useful to get all Group Members into a JSON file so that this could be used for reporting purposes. Reference Notebook: Get Entra ID Group Members – Power BI In the steps below I will show you how I…
Downloading Scanner API data using a Microsoft Fabric Notebook
Downloading Scanner API data using a Microsoft Fabric Notebook I was recently working with a customer where they had more then 100 app workspaces and I was running into some challenges when using the Scanner API in Power Automate. I then discovered this blog post where they detailed how to download the Scanner API data (DataXbi – admin-scan.py), it was…
How to read a Lakehouse table in another App Workspace – Microsoft Fabric
I was doing some work recently for a customer and they had data stored in different Lakehouse’s which was in a different App Workspace. I was pleasantly surprised that this can be quite easy to do. In my example below I am going to show you how in my notebook I can read a table in a Lakehouse table when…
Semantic-Link-Labs – Automate updating your Incremental Refresh Policy for your Semantic Model
The scenario here is that quite often there is a requirement to only keep data from a specific start date, or where it should be keeping data for the last N number of years (which is the first day in January). Currently in Power BI using the default Incremental refresh settings this is not possible. Typically, you must keep more…
Loading Fabric Lakehouse Tables with partitions
When loading data, it is always important to load the data with performance and scalability in mind. For lakehouse tables to return queries quickly and to scale it is essential to load your lakehouse tables with partitions. What I am going to show you in my blog post today is how to load data into a Lakehouse table where the…
How to get the TopN rows using Python in Fabric Notebooks
How to get the TopN rows using Python in Fabric Notebooks When working with data there are sometimes weird and wonderful requirements which must be created in order to get to the desired solution. In today’s blog post I had a situation where I wanted to get a single row with the highest duration. This is how I did it…