How to delete rows automatically based on a date in a dataset ?

Reply
White Belt

How to delete rows automatically based on a date in a dataset ?

I am inserting new rows in a dataset on daily basis, and now the dataset size has became huge since the rows are added daily. I want to delete the rows from this dataset based on date criteria (Dataset has a column type of "date" in it). So the criteria is like I want to maintain rows in dataset for last 30 days. eg assume I updated the dataset today (Nov 25) then dataset should only have rows (Oct 25 - Nov 25) and for tomorrow ie Nov 26 the dataset should have rows in range from (Oct 26 to Nov 26) and all the rows before Oct 26 should get deleted, if exist.

1. Is there a way I can do this? 
2. Is there any API provided by DOMO that can be used to do programmatically?

Black Belt

Hi @user017486 

 

I posted an answer to your question here: https://dojo.domo.com/t5/Beast-Mode-ETL-Dataflow/How-to-delete-rows-automatically-based-on-a-date-in... 



**Was this post helpful? Click the heart icon**

**Did this solve your problem? Accept it as a solution!**
Black Belt

You probably should not truncate your dataset. (unless we're getting into Billions of rows AND you're confident the data has no value.)  Today you might not want that data, but in five weeks if you change your mind it'll be borderline impossible to recover the data you threw away without reloading it.

 

I assume you're discarding data because it's cumbersome to handle in Dataflows.

 

You can use a DataSet View (domo beta feature speak to your CSM) to create a filter based on TODAY(), similar to the recursive query model @GrantSmith is proposing.


Jae Wilson
Check out my Domo Training YouTube Channel

**Say "Thanks" by clicking the heart in the post that helped you.
**Please mark the post that solves your problem by clicking on "Accept as Solution"
Announcements
New & Improved Dojo: Get excited for a new feel and additional features in the online community.

Site will be down February 4-5th for maintenance.

Launch coming February 8th!