Forum Discussion

AndrewHansen1's avatar
AndrewHansen1
Qrew Member
4 years ago

Pipeline to create JSON only collects first 200 records

Hi Everyone,

I have a pipeline that uses the quickbase API to run a custom report that I have created and exports the results into a JSON. No matter what I seem to do the JSON is only built with the first 200 records of the report. The report has hundreds more records when I run it manually.

I am pretty sure that there is a setting or something else that I am missing that is limiting either the report or the API in some way. Has anyone experienced this before? What was your solution?

Thanks,
Andrew


Pipeline info:

Pipeline Channel = Make Request 

 

URL

https://api.quickbase.com/v1/reports/9/run?tableId=TABLE_ID

 

Method

POST

 

Headers

Name

QB-Realm-Hostname

Authorization

 

Value

MY_QB_REALM

QB-USER-TOKEN MY_QB_USER_TOKEN



------------------------------
Andrew Hansen
------------------------------
​#Pipelines #APIsandcustomcode​​
APIs and custom code
Pipelines
  • JustinTorrence's avatar
    JustinTorrence
    Qrew Cadet
    4 years ago

    The Quickbase REST API paginates records depending on the size of the query. Check out this link for more. The metadata object should give you information about how many records were returned (so you know how many to skip for the next call).

    Example:

    {
  "metadata": {
    "totalRecords": 10,
    "numRecords": 1,
    "numFields": 3,
    "skip": 0,
    "top": 10
  }
}

    If you don't want to deal with this, I would suggest using the Quickbase channel for querying records if at all possible.



    ------------------------------
    Justin Torrence
    Quickbase Expert, Jaybird Technologies
    jtorrence@jaybirdtechnologies.com
    https://www.jaybirdtechnologies.com/#community-post
    ------------------------------
    • AndrewHansen1's avatar
      AndrewHansen1
      Qrew Member
      4 years ago
      Thanks Justin! Unfortunately the Pipeline options in the Quickbase channel are too slow to be tenable for our application, so API it is!

      I will look over the documentation that you provided, and see if I can get a working solution.

      Regards,
      Andrew

      ------------------------------
      Andrew Hansen
      ------------------------------