Data Factory
Needs VotesAllow dynamic content in Activity Name (and other fields on general tab)
Scott Powell on 13 Nov 2024 14:34:06
We copy a large number of tables by iterating through a ForEach activity and calling the copy activity for each. When trying to answer "which tables take a long time to copy", it's hard because all of the copy activities just have the generic activity name. If I were able to include dynamic content in the Activity name field, I could use code like @concat('Copy activity - ', @item().TableName) and then in the output we could tell which table was being copied without having to dive into the .json input and output.
This would also be helpful for other fields on the general tab - like Timeout settings and the like. Then timeout durations could be calculated offline, and fed into the activity vs. hardcoding. That way if the job starts running slower over time, the timeout setting could be gradually increased.
p.s. Unable to use the new "Copy Job" activity because it doesn't support dynamic partitioning, needed for good performance.
Thanks,
Scott