Export large amount of data issue as JSON

gg1234 · February 2

I am trying to export a large amount of data by using a custom template so that the exported result is a JSON (since I prefer to have nested data instead of a flat csv). Given the big amount of data I got the following error:

"Too many reports to be processed at once, template needs to use the \"addHeader\" statement."

Do you have any idea about what to add if my template is JSON and not a CSV (as per API Documentation examples)?

The only workaround I can see is to call many times the api, but it can break at any moment.

Thanks in advance

gg1234 · February 8

Maybe can be useful to other people: a solution is just to have smaller date ranges and iterated over them.

Sasha Kluger · February 8

Hi @gg1234 - For JSON export templates, you can use addHeader and addFooter for large exports. Here is an example of how this might look, but please note that this is just a rough example and isn't tested.

<#if addHeader>
[
</#if>
<#list reports as report>
  {
     details regarding each report
  }<#if report?has_next || !addFooter>,</#if>
<#if addFooter>
]
</#if>

gg1234 · February 8

Thank you, I will try it

Export large amount of data issue as JSON

Comments