[0:00]Refreshing data sets in Power BI. Hi, I'm M Asif Hussein from Nohaw Academy. What are we going to learn in this video? We are going to see how many different types of refreshes, data refreshes we have in Power BI. What are those refreshes in Power BI? How to use the refresh in Power BI desktop? So if I would like to talk about a refresh, what exactly is the word refresh? Refresh is nothing but whenever we are doing some work, let us consider you are doing a work in a hospital. You are doing a work in a supermarket, you are doing a work in a, in your business. So you need to refresh yourself in order to the better performance in your work culture. So in the same way, we have a refresh option in the data set as well. So what is this refresh option in data set? So the refresh option in data set is nothing but whenever you are doing the transformation, data modeling part or creating data visualization and so on, there might be the possibilities that the data in the backend might be updated or upgraded. A new data might have come up or some changes or modifications might have happened in the data. All right? So that you might be aware of or you might not be aware of that will purely depends upon the client side, that will happen it. So now you need to do a refresh. So for example, if we are searching something in Google Chrome, Okay? When we are not getting it, what we do? We refresh the page. It means that the page will be reloaded so that it starts again from, you know, in a fresh and we get it as speed as possible. So in the same way, we have a data refresh option here. So there are three types of data refreshes in Power BI. What are those types of data refreshes? Here I am going to show it to you. So we have three types of refreshes. One is we have manual refresh. Number two, we have scheduled refresh. Number three, we have incremental refresh. So for this incremental refresh, we need only premium per capacity license and for schedule refresh, this will happen in a Power BI service where you can have a premium or pro license for this one. So what is a manual refresh? So let me show it to you. So in this Power BI desktop, I have loaded one data and I have data which is in a import mode, okay? Which is in a import mode. So what's happening here? In this particular data, for example, if I am using some DAX functions and if I am doing some data modeling part or creating data visualization and so on, I can manually refresh the data. So how can I refresh, we can see the refresh option here, okay? So get the latest data by refreshing all the visuals in this report. So in this power view, whenever we are creating some visuals, okay, if I want to refresh it, yeah, I can go with the manual refresh option here. That is first thing. Now, when I talk about the schedule refresh, what is meant by schedule refresh? If many of you, if you are aware of the manufacturing industries or if you are aware of the pharmaceutical industries, okay? So what happens is that in a conveyor belt where the process of manufacturing or production is going on, okay? So a machine or a setup has been done in such a way that, okay, so every update of the data or every report how many vehicles have come out in this hour from a conveyor belt or so on, So they have a time setup, okay? They have scheduled a time, okay? And they have scheduled the report also. So how the report will come up? Okay. So in this particular time, in this particular date and in this particular hours and minutes, okay? So this is the data. These many vehicles have come out, these many so like that they have scheduled in the same way, we can schedule a time for refreshing the data. As simple as such. What we can do? We can set up, we can schedule a time in order to refresh the data, which happens in Power BI service, okay? So what is that? If you see it here in Power BI, in a semantic model, if I come, after we create a data gateway connection, so we can configure a schedule refresh. So schedule refresh, you can configure it in two ways. Either you can configure the schedule refresh on daily basis, or you can configure the schedule refresh on a weekly basis, okay? So in a weekly basis, if I talk about, you can you can set up the days when and where, on which day, which time you would like to do the schedule refresh, including the time. So if you see here, starting from Sunday till Saturday, every day is selected to do the schedule refresh. And the time you can set it up. By default, Power BI will give 1:00 AM. You set it of your choice. So how many times I can do that? That I'll show it to you. One, two, three, four, five, six, seven, eight. Up to eight times you can create a schedule refresh. Why only eight times? Because for a pro user, a schedule refresh will be accessible only for eight times. Only for eight times. Okay. So now you can change the time. Whatever the time you want, you can change it. It is up to you. Okay. So starting from Sunday to Saturday till eight times you can schedule a time frame in order to refresh the data in a backend part. So what happens? Though you do that, though you don't do that, everyday at every times which you have set up, okay? So Power BI in a backend part will be automatically creating a data refresh because you have scheduled the time and the day and the date. All right? So this is how a schedule refresh will work in Power BI.
[7:13]Now, if I talk to you about the next type of refresh, which is incremental refresh. So for incremental refresh, we need premium per capacity. Now, what is this incremental refresh? For a manual refresh, your whole visualizations and all will get refreshed, right? For a schedule refresh, the whole data will be refreshed. For example, if you have seven years or 10 years of data, all 10 years of data will be refreshed, but incremental refresh is something different. Though you have seven years or 10 years of data, whatever the data which is updated recently, for example, last 30 days or last one month of data got updated in the backend part. So that specific newly updated data plus the old data that we have, which is of seven years of 10 years, both will be done as a incremental refresh in Power BI. So before directly doing the incremental refresh, there are some conditions. What is the conditions? We need to create some parameters, then we should work on the incremental refresh. So what are the parameters, how should we do that parameters? I'm going to show it to you. So in order to set up the parameters, we need to come to the transform data section and we need to open up our Power Query as simple as such if I want to talk about. And always remember, whenever we want to do a incremental refresh, one column with date related information should be there for sure. So as we can see that we have order date here, okay? There are two dates, order date and ship date. So let me choose the order date column here. So in this order date column, what I'm doing it here, if you see, let me do some filtering part, okay? So what is the first date that we have, which is 61 2016. 6th August 2016. If I do it in a descending order, I get from a last value or last date that I have that I'll get it. So 30 12 2019, 30th December 2019. That I'm having it here, okay? So it's still loading it because we have lot more data in it. Okay? So if you see 30 12 2019, okay? So if we are let me show you this one, we have all the data starting from 1st December to 30th December 2019, okay? Now the point coming up here is that I have to create an incremental refresh. So what I will do? Rather than selecting my whole data from 2016 to 2019, let me choose the dates only from 1st December 2019 to 30th December 2019, which is our last date that we have it here. So now what I'm going to do? First, we need to set up the parameter. How should we do that? In here, we have manage parameters. We need to click on new parameters. We do not have any parameters existing, we need to create a new parameter. I'll click on new parameters here, and in this new parameter, let me give the parameter name as start date. I'll give it here as start date. Okay? So now start date, I'll choose it as a date data type, okay? Now, the current value, what I will give? I will give 0112 2019. Okay? First December 2019. This is my start date. I'll click on okay. So what I will do again? I'll create another parameter, new parameter. Now, I will choose it as my end date. What I'm going to do? I'm going to choose it as my end date. So now I'm writing the same thing. Nothing. I'm just doing with the end date. End date. Okay. So I'm choosing it here as a date data type, and the value, I'll give it as 3012 2019. All right? So now I am clicking on okay. So what happened? I have created two parameters. First parameter is for my start date, and the second parameter is for my end date. So now coming to the point, I'll come here to my query. I'll select it here, and I have date filters. All right? We have date filters in that. I'll come to custom filter and in this custom filter, let me assign the time frame, the date frame for this particular rows. So what I'm going to do? I'm just selecting my parameter here, and the start date, which is the parameter. And let me choose another parameter, which is my end date. Okay? So now I will choose this one as is after or equal to, and this one I'll choose it before or equal to. So after my start date, before my end date. So that is what I want to refresh it. Incremental refresh. That is only the specific time frame. Last 30 days data, I want to refresh it in the year of 2019. So that's where I have selected it. Now, what I'm going to do? I'm going to click on okay. So what happened? I have created a parameter and I have assigned that parameter to the, I mean, I have filtered the rows based upon my parameters with the start date and end date. Okay? So now this is completed in Power Query editor. I'm clicking on close and apply and this is getting applicable in my Power BI Desktop. All right? So once we have created a parameter, now we need to create that parameter incremental refresh in Power BI desktop. As simple as such. So the changes that we have done in Power Query editor, it got loaded up in our Power BI desktop. So as you can see, near my table name, okay, we have these options. There we have an option called incremental refresh. So I will click on this incremental refresh. And just we need to enable this one, and we have to give the option that I need to create the schedule refresh for last 30 days or last one month or last one quarter or last one year, something like that. And click on apply depending upon your requirement. So this is how an incremental refresh can be done. So if you are having a premium user, you can try it out without any hesitation, it's up to you. And whenever you are working in a company, the company decides whether depending upon your role and depending upon your seniority, the company decides to give you either a premium license or a pro license. It purely depends upon the company's perspective. So these are the three types of different refreshing dataset options we have in Power BI, manual refresh, schedule refresh, and incremental refresh. Thank you for choosing Nohaw Academy as your source for IT knowledge. We are always here to help you to navigate the tech world. If you have any questions, do not hesitate to reach out. It's been a pleasure sharing this information with you. Stay curious and keep learning.
