December 2019 Blog Posts

All blog posts that were published in December 2019. To view posts from other months, use the archive control in the right-hand sidebar to pick the specified month from the specified year.

Copying files based on file content between two locations with Azure Data Factory

Friday, December 27, 2019 9:38 AM

Recently I ran across a scenario and found myself coming up empty in looking for resources on how to solve it. I didn’t think the scenario was all that unique, but I could find not a single article or post on how to solve this problem. It’s situations like these that interest me because not only do i want to figure it out, but I want to write about it as well to help others who may run into this.

In this post, I’ll explain how I used Azure Data Factory to move millions of files between to file-based stores (Azure Blob Storage containers) but using a value within the contents of each file as a criteria where the file would go be saved to.

Read More