Any way to delete data automatically after a certain time?
So I'm updating a dataset of mine through a connector on a daily basis, and I foresee that after some time the dataset will be huge (having millions of rows!) I want to delete rows from this dataset that I don't need anymore. The criteria for this can be multiple e.g: Delete rows with dates before a certain time. OR Delete rows which are classified as 'Obsolete'.
Is there any way in which I can do this?
(P.S note that with the connector I'm using (CSV import) I cannot filter on the data I'm bringing in. Also I need to perform some SQL transforms on this dataset to tell which rows are obsolete)