Speed up the development time for ETL data flows by caching the preview results

doc-domo

As I'm building a workflow my typical approach is to add one or tow ELT Actions and run preview to check the ouput. Currently preview recomputes all the Actions, which for a complex dataflows takes  a lot of time and interupts the development processes. Typically I'm only changing, or adding,  Actions to the end of the dataflow and the outputs of all the earlier Actions will be unchanged and should not need to be recomputed

 

It should be possible to cache the preview output of each Action and only rerun an Actions if its configuration has been changed or the inputs o the Actions have changed. 

 

This is how other visual tools like RapidMiner work to greatly speed up development of complex workflows.

btm

Thank you for submitting this @doc-domo. I am assigning to our product manager @StevenC to review and comment.

user014481

Has this feature been built into DOM? If so, how can I perform a preview of only one transform?

Thanks in advance!