Importing Data into Domo from our Connectors

A lot of our data sources are becoming fairly large over a few million rows, and we have noticed refresh speeds getting much slower.

I think the solution is to have data appended as of last import rather than replace the whole thing? But I'm curious to know if anyone else has a better solution?


  • MarkSnodgrass
    MarkSnodgrass Portland, Oregon πŸ₯·

    If you are using Domo Workbench 5.1, they have the option of partition support, which can help when dealing with large datasets. Here's the KB article about it.

    If you are using another type of connector, appending is the most common way to minimize refresh speeds.

    **Make sure to like any users posts that helped you and accept the ones who solved your issue.**
  • GrantSmith
    GrantSmith Indiana πŸ₯·

    You can also utilize UPSERT within workbench as well to update / create records so you only need to pull in the changes assuming your data doesn't get deleted out of your tables. If they do you'd need to use partitioning.

    **Was this post helpful? Click the heart icon**

    **Did this solve your problem? Accept it as a solution!**