Tag: Azure

In this post, I’ll walk through how to filter rows in Azure Data Factory (ADF) using the Filter activity to retain only the rows where a specific column (OperationName) has the value “FileWrite”. This is especially useful when you’re processing large datasets and only need certain entries based on a condition. Problem You have a

When working with data in Azure Data Factory (ADF), it’s common to deal with delimited strings. You might need to extract the last element from such strings. For instance, given a string like string1/string2/string3, you want to extract the last part, which is string3. In this blog post, we’ll explore how to achieve this using

In Azure Data Factory (ADF), we often use expressions to manipulate strings and extract specific parts of data. One common operation is splitting strings based on a delimiter. However, this can sometimes lead to errors, especially if the string format is not consistent. In this blog post, we’ll explore a common issue with the split

Azure Data Factory (ADF) is a powerful tool for building ETL (Extract, Transform, Load) workflows in the cloud. One common requirement is to filter data or files based on certain conditions. In this post, we’ll explore how to use the Filter activity in ADF to exclude items that begin with an underscore (“_”), which is

Introduction Azure Data Factory (ADF) is a powerful cloud-based data integration service that allows you to create data-driven workflows for orchestrating and automating data movement and data transformation. When working with data, it’s common to encounter situations where you need to manipulate strings, such as splitting a string by a delimiter and accessing specific elements.

In Azure Data Factory (ADF), working with dates is a common task, especially when dealing with data transformations and scheduling tasks. ADF allows you to handle dates in different formats, such as timestamps and strings. This blog post will guide you on how to extract the year, month, and day from two types of dates: