A common method I've employed with client side scripting ( I'm not familiar with Alteryx so I'll leave this here and ignore me if its not relevant or doable ) is to do it in batches like you describe doing a combination of API_DoQueryCount with API_DoQuery and using the 'num-' and skp-n components of
API_DoQuery in the 'options' parameter
So in your table - lets say you have 100,000 records - API_DoQueryCount returns that #. Pick a batch size you like based on whatever feels right - say 15,000, and do the Ceiling() of Num of records / your chosen batch size. So 7 batches in this example. Simple For loop through your number of batches - you end up doing 7 API_DoQuery calls, you can call the same qid over and over - and your actual API call looks like
API_DoQuery&qid=1234&options=num-20000.skp- // You would skip 20,000 * wherever you are in the loop
So all in all it looks like
API_DoQuery&qid=1234&options=num-20000.skp-0
API_DoQuery&qid=1234&options=num-20000.skp-15000
API_DoQuery&qid=1234&options=num-20000.skp-30000
API_DoQuery&qid=1234&options=num-20000.skp-45000
API_DoQuery&qid=1234&options=num-20000.skp-60000
API_DoQuery&qid=1234&options=num-20000.skp-75000
API_DoQuery&qid=1234&options=num-20000.skp-90000
Just string all the responses together to build the entire response
Chayce Duncan | Technical Lead
(720) 739-1406 |
chayceduncan@quandarycg.com Quandary Knowledge Base