Dataset Run Time
I was trying to figure out if there's a way to track total dataset run time.
I'm just not sure where to find how long it took my dataset's to run from start to finish.
Thanks in advance for any help.
Best Answer
-
Both Dataset and Dataflows have a History tab at the top when you are in it for properties...it should show you run times there.
Matt
*Please Like to Thank
1
Answers
-
I wrote a C# program a long time ago that exports the dataset metadata and then pushes it back into Domo. I would recomend using hte something like powershell and the APIs to do the same thing. This allows me to create a card on the inputs datasets for a given dataflow - take sales for example - and with some beast modes I check if a given dataset updated before or after the dataflow kicked off. the card is color coded for "all good" or "Houston we have a problem".
Looking through the APIs I do not find anything for Dataflows. You might have to use C#. That makes it a bit trickier ...For what it is worth, here is the section of code I use to read the data about our dataflows
Utility.LogMessage(DateTime.Now + " Creating array of dataflows to load back to Domo.");
var dflows = client.DataFlows.GetDataFlowsAsync();
DomoApi.Model.DataFlow.DataFlowCollection Dataflows = new DomoApi.Model.DataFlow.DataFlowCollection();
Dataflows = await dflows;
try
{okToUpdate = true;
foreach (var df in from DFList in Dataflows.DataFlows select DFList)
{
Console.WriteLine(df.Name);
if (df.Inputs != null)
{
foreach (var inp in from inputlist in df.Inputs select inputlist)
{
if (df.Outputs != null)
{
foreach (var outp in from outputlist in df.Outputs select outputlist)
{
List<object> dfobj = new List<object>();if (df.Name != null) dfobj.Add(df.Name.ToString()); else dfobj.Add("no name");
dfobj.Add(df.Id.ToString());
if (df.DatabaseType != null) dfobj.Add(df.DatabaseType.ToString()); else dfobj.Add("no Database type");
if (df.Description != null) dfobj.Add(df.Description.ToString()); else dfobj.Add("no Description");
dfobj.Add(df.DocumentVersion.ToString());
dfobj.Add(df.Enabled.ToString());dfobj.Add(df.LastExecution.LastUpdatedTimeUtc.ToString("o"));
dfobj.Add(df.LastExecution.BeginTimeUtc.ToString("o"));
dfobj.Add(df.LastExecution.EndTimeUtc.ToString("o"));dfobj.Add(df.ResponsibleUserId.ToString());
if (inp.DataSetName != null) dfobj.Add(inp.DataSetName.ToString()); else dfobj.Add("no input dataset name");
if (inp.DataSetId != null) dfobj.Add(inp.DataSetId.ToString()); else dfobj.Add("no Input Dataset Id");
if (inp.ExecuteFlowWhenUpdated != null) dfobj.Add(inp.ExecuteFlowWhenUpdated.ToString()); else dfobj.Add("no dataflow trigger indicator");if (outp.DataSetName != null) dfobj.Add(outp.DataSetName.ToString()); else dfobj.Add("no Output Dataset Name");
if (outp.DataSetId != null) dfobj.Add(outp.DataSetId.ToString()); else dfobj.Add("no Output Dataset Id");
if (outp.DataFlowId != null) dfobj.Add(outp.DataFlowId.ToString()); else dfobj.Add("no Output Dataflow Id");
dfobjects.Add(dfobj);
dfobj = null;
}}
}
}} // end of dataflow loop
0
Categories
- 10.8K All Categories
- 3 Private Company Board
- 1 APAC User Group
- 12 Welcome
- 39 Domo News
- 9.7K Using Domo
- 1.9K Dataflows
- 2.5K Card Building
- 2.2K Ideas Exchange
- 1.2K Connectors
- 343 Workbench
- 260 Domo Best Practices
- 11 Domo Certification
- 465 Domo Developer
- 50 Domo Everywhere
- 106 Apps
- 717 New to Domo
- 85 Dojo
- Domopalooza
- 1.1K 日本支部
- 4 道場-日本支部へようこそ
- 27 お知らせ
- 64 Kowaza
- 299 仲間に相談
- 654 ひらめき共有