Cursor-based pagination in EazyBI for data center does not stop

Hi,

I am having trouble using cursor-based pagination in the newly release EazyBI for Jira 8.1 for data centers. My API return looks like this:

{
  "data": [
  ],
  "cursor": "somethingSomething"
}

I setup the REST API in Eazy as as follows:

What happens is that the API calls never stop, I expect ~ 32.000 rows, I canceled the import at ~ 100.000. If I delibertaly use a wrong cursor name it will only import the first batch. This indicates to me that I am doing it somewhat correctly but not to the full extent. What am I missing here?

Hi @Maiko,

The configuration looks OK. Sometimes, we have seen issues when the cursor is returned even for the last page. That leads to an infinite loop by trying to fetch the last page.
To help debug the issue more, please send the REST API definition (Import from REST API) and eazyBI log files (Troubleshooting) to our support email—support@eazybi.com.

Best regards,
Jānis Baiža
eazyBI developer

Hello,

thanks for the reply. I did a test with the API I want to collect data from and created a short Python script. The last page returns a ā€œcursorā€ element but it is empty. I will get in contact with our admins to collect the log files

Hello @Maiko,

I was able to reproduce the issue when the last page ā€œcursorā€ element is empty - eazyBI will make a request with an empty cursor, leading to a pagination restart.
Please send a short note to our support email, and I will prepare a patch for you to fix the issue.

Best regards,
Jānis Baiža
eazyBI developer

1 Like