Custom Connector | Response size too big - Error 500

ArthurLazaro
ArthurLazaro ⚪️
edited January 4 in Connectors

Hi guys,

I am working on a custom connector to access an API, and the response I need from the API is a link to download a CSV file. I was able to figure out that if I use httprequest.get(URL) I can 'download' the file and save it in a text variable and then use the datagrid.magicParseCSV to send it to the Datagrid.

The issue is that I am getting the error 'Domo encountered an error proxying your request: 500' because the response size sometimes is too big (more than 7Mb).

Is there a better way to handle the download link than using the httprequest.get?

Also, what do you guys recommend to deal with the response size? I could have a lot of request calls but it would be too many. In one of my reports, if I get more than 2 days of data, the request is already too big. It would grow exponentially with time.

Thanks!

Tagged:

Categories