🎒Understanding the Filter Component

The Filter Component processes input data by applying specific conditions to a particular field, retaining only the data that meets these criteria. It is used to refine and focus datasets by filtering out unwanted or irrelevant information.

🚀 Key Features

• Field-Based Filtering: Filters data based on the values of a specific field.
• Conditional Logic: Allows for customizable conditions to determine which data to retain.
• Integration: Works seamlessly with other pipeline components to ensure that only the relevant data progresses to the next stage.

📘 How to Use a Filter Component

Configuration Steps

1. Add a New Component: Choose "Filter" as the component type and assign it a descriptive name that reflects its filtering criteria.

2. Configure the Component: Open its configuration settings by clicking on the component.

3. Configure the Field: Determine which field in the input data will be used for filtering.

   

4. Set the Filtering Condition Type: Choose the type of filtering condition. Currently, two types are supported:

   

   • Exact Match: Filters data where the field value precisely matches a specified value.
   • Numeric Condition: Filters data based on numeric comparisons, such as greater than, less than, or equal to a specific value.

5. Specify the Filtering Condition Value:

   • For Numeric Conditions, set whether the field value should be greater than, less than, or equal to a certain numeric value.

   • Great than:

     

   • Equal to:

     

   • Less than:

     

   • For Exact Match, set the field value to be equal to a specified value.

     

Component Input

• Type: List of Dictionaries
• Description: The input is a list of dictionaries. Each dictionary contains consistent fields with uniform data types.
• Example Input

Component Output