Below is a quick blog post on how to stream the data immediately when using the On-Premise Data Gateway.

Currently as far as I understand it the On-Premise Data Gateway will wait and buffer some data before sending it through to the Power BI Service. By changing the setting below in the On-Premise Data Gateway, it will start streaming the data almost immediately.

I am fortunate enough to be really good mates with Phil Seamark who so part of the Power BI CAT team and he gave me a little nugget of gold that I would like to share with you.

To enable this, I did the following below:

  • I went to the folder where I had my On-Premise Data Gateway installed
    • The default location is here: C:\Program Files\On-premises data gateway
  • I always recommend making a backup copy of anything before making a change.
    • I made a copy of the config file below before making the change.

      Microsoft.PowerBI.DataMovement.Pipeline.GatewayCore.dll.config

    • I know it is not a great name, but I know I have a working copy before I made any change.
  • I then opened the file Microsoft.PowerBI.DataMovement.Pipeline.GatewayCore.dll.config
  • I then went to the section called StreamBeforeRequestCompletes
    • This is what it looked like in its default state
  • I then made the change and set it to True as shown below.
  • I then saved and closed the file.
  • My final step was to restart the On-Premise Data Gateway.

I then tested running the refreshing of the data and it started loading the data almost instantly (I did notice that it did depend on the underlying data source)

Conclusion

This quick blog post has shown how I have enabled the On-Premise Data Gateway to start streaming data almost immediately.

As always, any comments or suggestions are most welcome.

Thanks for reading!