Currently, we're storing a lot of custom data in a central server, summarizing it, generating spreadsheet, and feeding these into Domo via Workbench. It works really well, partly because we've been able to do full DataSet replacements rather than "appends." As we're accumulating more data, the process is slowing down. Also, as we build out, we'll have multiple servers, not a single consolidated servers. This information is the background for what we're looking at doing next.
We've got our DatSets, page filters and PDP rules set up to allow us to reuse pages and cards to show very different slices of data. What we're hoping to do is continue along these lines, but have multiple sites append data to a single DataSet. Is this possible, or does each site need a distinct DataSet that we then combine on the back-end?
I've had a look at several options for how to handle multiple sites pushing into Domo:
Of these options, the DataSet API seems like the most straightforward. I've used a bunch of the "read" APIs in the past to pull down DataSet, etc. details for auditing and review. The APIs were fine to work with. I just tried a little "hello world" code and was able to create a DataSet easily enough. I've looked through the docs and have some questions. I'd love to hear back from anyone who has used the DataSet and or Stream API to define, configure and update DataSets. Not just with answers to my questions, but info on gotchas, tips, anything you're inclined to share.
My questions so far are:
I can test all, or nearly all, of what I've asked on my own....but am hoping to save some time by learning from others that have been down this road in the past. And, please, any broad or specific suggestions or notes that I haven't though to ask about are more than welcome.