How to append monthly data?

eriena

Hello,

Please let me ask how to append monthly data to accumulated data.

I want to append monthly data using DataSet via Email Connector on the accumulated data from January to April.

For example, I upload May data by using email connector in May, the output dataset will be for January-May data.

However, after that I upload the June data by email in June, the output data will be the Jan-Apr and June Datasets. Obviously, the data for May will be lost.

How can I append monthly data?

I thought that it could be solved by Appending Update mode in DataSet via Email Connector, but it seemed that DataSet via Email Connector can't set append.

Thank you.

GrantSmith

Hi @eriena

You'll want to utilize a recursive dataflow. The knowledge base has several different articles on how to do this. Here's the Magic ETL version:

https://domohelp.domo.com/hc/en-us/articles/360057087393-Creating-a-Recursive-Snapshot-DataFlow-in-the-New-Magic-ETL

MarkSnodgrass

the dataset via e-mail connector does have an update mode of append, but it can be challenging if you are toggling back and forth and not lose what is currently stored.

I might suggest a recursive dataflow. Here is the KB article on how to create it in Magic ETL.

https://domohelp.domo.com/hc/en-us/articles/360057087393-Creating-a-Recursive-Snapshot-DataFlow-in-the-New-Magic-ETL

eriena

@GrantSmith

@MarkSnodgrass

Thank you so much for sharing the article. I will read the article.

eriena

Hello,

@GrantSmith

@MarkSnodgrass

I could solve my issue.

Thank you so much for your advise.