What is a set level transformation?¶
Set level transformation operates on a group of records that may result in joining, rearranging, elimination, or aggregation of records. Data sources and destinations are also considered as set transformations. Generally, set transformations operate on the entire data set. For instance, a Sort transformation sorts the entire dataset before passing records to the next object. Similarly, Aggregate transformation uses the entire data set to construct aggregated records.