Forum Discussion

MarkShnier__You's avatar
MarkShnier__You
Icon for Qrew Legend rankQrew Legend
5 years ago

Pipeline "for each" loops

I must be missing a basic concept with Pipelines. My goal is to Search (retrieve) records from a table.  Then for each record, do three steps in sequence. 1. Update a record  2. Call an API Webhook...
Pipelines
NicodemusSchoe1's avatar
NicodemusSchoe1
Qrew Trainee
4 years ago
Did support mention anything regarding how many asynchronous runs are executed? I've an issue where the Webhooks need to occur a max number of times a minute. I was trying to use a Pause in the loop, but that doesn't fix because of this issue. If I knew exactly how many asynchronous runs are run at a time, I could better adjust my Pause to avoid the API call limits.

------------------------------
Nicodemus Schoenwald
------------------------------
MarkShnier__You's avatar
MarkShnier__You
Icon for Qrew Legend rankQrew Legend
4 years ago

Would it work in your use case to have a looping callable pipeline.  

pipeline called
search for a record that needs action
call your webhooks
call the pipeline


that way there would not be a For Each loop and only one would be running at a time.



------------------------------
Mark Shnier (YQC)
mark.shnier@gmail.com
------------------------------
  • NicodemusSchoe1's avatar
    NicodemusSchoe1
    Qrew Trainee
    4 years ago
    It might. I might put the Search and For Each Loop inside another outer loop. The Pause would be in the outer loop, and the inner search would only return a limited number of records to loop through in the inner loop. However, if the parallel iterations of the loops is a specific number, then I can avoid the layers and just have Pauses with a set length.

    ------------------------------
    Nicodemus Schoenwald
    ------------------------------