Managing Data Retention Policy

Currently, there's no feature to create and manage custom rules for handling historical data within datasets. Companies have specific rules on how long they are allowed to keep different types of data and it looks like it is not easy to enforce this in Domo.Β 

There should be settings in DataSets where we can define conditions and scheduling on the checks and actions to execute (e.g. Which data to archive or remove entirely from storage).Β 

9
9 votes

Submitted Β· Last Updated

Comments

  • GrantSmith
    GrantSmith Indiana πŸ₯·

    You could utilize Magic ETL dataflows to check the date on the data and either split it out and archive it or remove it from the dataset depending on your company's data retention policy.



    **Was this post helpful? Click the heart icon**

    **Did this solve your problem? Accept it as a solution!**
  • jaeW_at_Onyx
    jaeW_at_Onyx Budapest / Portland, OR 🟀

    this can be automated via APIs. use the DatasetAPI or QueryAPI to find out it's age.


    the tough part will be if you want to retire rows of data (as opposed to entire datasets). you'll need a recursive query with a partitioning model to drop old data.


    also in the java cli there are functions to assist with setting the retention policy.


    Jae Wilson
    Check out my Domo Training YouTube Channel

    **Say "Thanks" by clicking the heart in the post that helped you.
    **Please mark the post that solves your problem by clicking on "Accept as Solution"
  • Some interesting options gents but surely there could a more convenient solution towards lean data instances.