Historical Database I inherited
I'm dealing with CRM data, and have a snapshot of all of our data that is appended to a full historical daily database. This is done in a SQL transform, but I am completely unable to figure out why the input data is being appended to the output instead of clearing it. I am completely dumbfounded. I'm attaching screenshots of the SQL transform, but basically I have an input, a simple transform that selects a bunch of columns and adds a date stamp, and the output. The input data is around 53k rows daily, and the historical dataset is around 18m at this time. I'm also attaching a screenshot of the run history of the dataflow, where it shows clearly that the input is 53k and the output is also 53k.
I inherited this dataflow from someone that left my company. I would greatly appreciate the help
HistoryInput and OutputOutputTransform2Transform1SQL transform