welcome to XRM blog

Keep in touch with latest CRM/ERP articles

To remain competitive your organisation must be efficient across the business process spectrum. To do so you need to take sound decisions based on a balance between the cost and risk. To do so you will be heavily dependent on your content management in itself needs...

image
Blog

Retrieve and update bulk records using Power Automate

By Anurag on 10/16/2023

The scenario here is to retrieve all the connections with the Plaintiff role and update them to the Plain Plaintiff role. Power Automate flow returns only the first 5000 records in the ‘List rows’ action by default. 

Since there are almost 100,000 records in my scenario.

For this, we are going to use the Pagination technique. Here are two ways to use Pagination:

1. By enabling the Pagination feature from settings, set the threshold as the number of rows you want to retrieve.

2. When using fetch XML query to retrieve rows then Pagination feature will not work. So, we must disable this. I have implemented this using the steps shown below:

Step 1: Create a cloud flow and set the trigger point. The trigger can be based on a schedule, a manual action, or an event from your data source. In my case, I’m using a manual trigger.

Step 2: Initialize the variables Count, PagingCookie, and PagingCookieOnly as strings and RawJSON as Object.

Step 3: Next, I retrieved the Plaintiff and Plain Plaintiff roles using fetchXML query and set the respective variables with their role ID retrieved.

Similarly, retrieved Plain Plaintiff role.

Step 4: Now add Do Until and set the condition to retrieve the rows until the Paging Cookie variable is empty.

Step 5: Now select action ‘List rows’ inside the Do Until block to retrieve connections using fetch XML query.

Paste the fetch XML query and add an additional Page attribute then increment this to retrieve all the pages.

Step 6: Increment the variable Count.

Expression: length(outputs('List_rows')?['body/value'])

 

Step 7: Set the PagingCookie variable as shown. Below is the expression given:

Expression:

if(empty(outputs('List_rows')?['body']?['@Microsoft.Dynamics.CRM.fetchxmlpagingcookie']),'',decodeUriComponent(decodeUriComponent(outputs('List_rows')?['body']?['@Microsoft.Dynamics.CRM.fetchxmlpagingcookie'])))

Expression for PagingCookieOnly variable:

if(empty(variables('PagingCookie')),'',replace(substring(variables('PagingCookie'),add(indexOf(variables('PagingCookie'),'pagingcookie="'),14)),

'" istracking="False" />',''))

Step 8: Add an "Apply to Each" control to loop through each record we retrieved in the previous step. This is where we will iterate through the bulk records. Now we will update the roles in all the retrieved connections.

Step 9: I have added compose to check the number of records retrieved.

Step 10: Now save the flow and run it manually.

Here, we got all 100000 records. This is how we can retrieve and update bulk records using Power Automate.

 

D365
Power Automate
Power Automate Cloud Flow
Retrieve Bulk Records
Author
Blog Calendar
Blog Calendar List
2023 Dec  2  2
2023 Nov  17  7
2023 Oct  58  16
2023 Sep  50  9
2023 Aug  45  7
2023 Jul  31  5
2023 Jun  20  4
2023 May  43  5
2023 Apr  23  5
2023 Mar  66  6
2023 Feb  64  5
2023 Jan  31  4
2022 Dec  94  7
2022 Nov  222  2
2022 Sep  13  1
2022 Aug  26  2
2022 Jun  7  2
2022 May  3  2
2022 Apr  5  2
2022 Mar  1  1
2022 Feb  2  1
2022 Jan  1  1
2021 Dec  3  1
2021 Nov  2  1
2021 Oct  1  1
2021 Sep  11  1
2021 Aug  37  5
2021 Jul  36  4
2021 Jun  1034  5
2021 May  30  3
2021 Apr  1806  3
2021 Mar  176  5
2021 Feb  1733  7
2021 Jan  2359  9
2020 Dec  381  7
2020 Sep  72  3
2020 Aug  616  3
2020 Jul  120  1
2020 Jun  65  3
2020 Apr  58  3
2020 Mar  12  2
2020 Feb  27  5
2020 Jan  34  7
2019 Dec  17  4
2019 Nov  23  1
2019 Jan  23  2
2018 Dec  48  4
2018 Nov  68  3
2018 Oct  18  3
2018 Sep  1066  11
2018 Aug  7  2
2018 Jun  12  1
2018 Jan  68  2
2017 Sep  583  5
2017 Aug  17  1
2017 Jul  17  2
2017 Jun  62  2
2017 May  21  1
2017 Apr  35  2
2017 Mar  129  4
2017 Feb  740  4
2016 Dec  200  3
2016 Nov  760  8
2016 Oct  297  10
2016 Sep  616  6
2016 Aug  39  1
2016 Jun  1855  6
2016 May  109  3
2016 Jan  71  2
2015 Dec  421  6
2015 Nov  4  1
2015 Oct  13  1
2015 Sep  1459  6
2015 Aug  14  1
2015 Jul  128  2
2015 Jun  10  1
2015 May  20  1
2015 Apr  30  3
2015 Mar  80  3
2015 Jan  5329  4
2014 Dec  17  1
2014 Nov  2257  4
2014 Oct  67  1
2014 Sep  107  2
2014 Aug  5224  1
2014 Jul  48  2
2014 Apr  2566  12
2014 Mar  298  17
2014 Feb  219  6
2014 Jan  1510  16
2013 Dec  21  2
2013 Nov  688  2
2013 Oct  256  3
2013 Sep  11  1
2013 Aug  40  3
2013 Jul  214  1
2013 Apr  57  6
2013 Mar  2255  10
2013 Feb  127  3
2013 Jan  328  2
2012 Nov  56  2
2012 Oct  496  10
Tag Cloud
Interested in our services? Still not sure about project details? get a quote