Azure Data Factory (ADF): Nested ForEach Activity

In some cases i need to loop folders and files in Azure Data Lake Storage in order to import data in the destination.

The file structure can look like:

ADLS - Folder/File Structure

That means that i need to loop this stricture with two nested ForEach Activities in ADF pipeline – one for the folders and one for the files.

The first loop:

Inside ForEach Folder i have Execute Pipeline activity:

And here is the second loop ForEach File:

Keep it simple :-)

About Peter Lalovsky

I am Microsoft SQL Server certified professional, creating with T-SQL, SSRS, SSIS, ASP.NET/C#, Azure, Python, PowerShell and more on a daily basis since year 2006. In 2016 i wrote a book for beginner and intermediate T-SQL programmers which you can download here. This blog is something like my personal programming documentation. When i am not in front of a computer, i am around my paper car – Trabant 601.

Leave a comment

Your email address will not be published.