Pipeline Jinja Issues

Question

Hello Quickbase Community!

I'm having issues with a pipeline.&nbsp;

Step A: Quickbase Channel - Quickbase API - Make a Request
Essentially, I query data in a table and get back some JSON data. This step works completely fine.&nbsp;Step B (the problem step): Quickbase Channel - Quickbase API - Make a Request
This request is to post data to a test table for now. I'm trying to run a for loop on the data. I'm eventually going to incorporate the myTimeStop variable, but it can be ignored for now. I'm trying to iterate through the data, adding a line for each one, and keeping a running total for row '33'.
This works, but it's still resetting the runningTotal to 0.0 in each loop for some reason. Table ID redacted.
{% set myDataSet = "myTableID" %}{% set myTimeStop = 5.0 | float %}{% set runningTotal = 0.0 | float %}{&nbsp; &nbsp; "to": "{{myDataSet}}",&nbsp; &nbsp; "data": [&nbsp; &nbsp; &nbsp; &nbsp; {% for row in a.json.data %}&nbsp; &nbsp; &nbsp; &nbsp; {% set runningTotal = runningTotal + row['33'].value %}&nbsp; &nbsp; &nbsp; &nbsp; {&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; "6": {&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; "value": "{{row['36'].value}}"&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; },&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; "7": {&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; "value": "{{row['8'].value}}"&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; },&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; "8": {&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; "value": "{{row['13'].value}}"&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; },&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; "9": {&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; "value": "{{row['33'].value}}"&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; },&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; "10": {&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; "value": "{{runningTotal}}"&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; }&nbsp; &nbsp; &nbsp; &nbsp; }&nbsp; &nbsp; &nbsp; &nbsp; {% if not loop.last %},{% endif %}&nbsp; &nbsp; &nbsp; &nbsp; {% endfor %}&nbsp; &nbsp; ]}

I've tried this, but it gives me a vague error. It's pretty much the same as the top, but I'm appending each line to the list as later I want to iterate through the data until I hit the timestop variable and then add that list to Quickbase.&nbsp;
{% set myDataSet = "myTableID" %}
{% set myTimeStop = 5.0 | float %}{% set runningTotal = 0.0 | float %}
{% set data = [] %}
{% for row in a.json.data %}&nbsp; &nbsp; {% set runningTotal = runningTotal + row['33'].value %}&nbsp; &nbsp; {% set item = {&nbsp; &nbsp; &nbsp; &nbsp; "6": {"value": row['36'].value},&nbsp; &nbsp; &nbsp; &nbsp; "7": {"value": row['8'].value},&nbsp; &nbsp; &nbsp; &nbsp; "8": {"value": row['13'].value},&nbsp; &nbsp; &nbsp; &nbsp; "9": {"value": row['33'].value},&nbsp; &nbsp; &nbsp; &nbsp; "10": {"value": runningTotal}&nbsp; &nbsp; } %}&nbsp; &nbsp; {% do data.append(item) %}{% endfor %}
{&nbsp; &nbsp; "to": "{{myDataSet}}",&nbsp; &nbsp; "data": {{data|to_json}}}

I'm just not understanding why it doesn't like the second variation. It passes the test initially, but when run gives a vague "Something went wrong executing a step. Try modifying your pipeline."
Also, not understanding why in the first one it's not actually keeping a running total.&nbsp;------------------------------Dwight Munson------------------------------

dwightmunson1 · Answer

For the second bit, I've also tried:{% set data = data.append(item) %}
and
{% set _ = data.append(item) %}
and
{{data.append(item)}}

I've also tried:&nbsp;
{&nbsp; &nbsp; "to": "{{myDataSet}}",&nbsp; &nbsp; "data": {{data|tojson}}}
and
{&nbsp; &nbsp; "to": "{{myDataSet}}",&nbsp; &nbsp; "data": {{ data | tojson }}}------------------------------Dwight Munson------------------------------

donlarson · Answer

Dwight,

I am no Jinja or Python expert, however I remember reading somewhere in a Python resource about declaring variables inside and outside of a loop.&nbsp; &nbsp;You have defined Running Total twice and there is a voice in my head saying that your problem lies there.
The two best resources for Jinja here are @Doug Henning or @Prashant Maheshwari&nbsp;
------------------------------Don Larson------------------------------

dwightmunson1 · Answer

This worked for me for the running total. Now I'm trying to figure out a while loop for it to only iterate up to the myTimeStop.
{
{% set myDataSet = "myTableID" %}
{% set myTimeStop = 5.0 %} 
{% set runningTotal = namespace(val=0.0) %} 
&nbsp;&nbsp;&nbsp;&nbsp;
"to": "{{myDataSet}}",
"data":[
&nbsp;
&nbsp;&nbsp;&nbsp; {% for row in (a.json.data) %}
&nbsp;&nbsp;&nbsp; {
&nbsp;&nbsp; &nbsp;&nbsp;&nbsp;&nbsp;&nbsp;{% set runningTotal.val = runningTotal.val + row['33'].value %} 
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;"6":{&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; 
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;"value": "{{row['36'].value}}"
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; },
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; "7":{&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; 
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;"value": "{{row['8'].value}}"
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; },
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; "8":{&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; &nbsp;&nbsp;&nbsp;
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;"value": "{{row['13'].value}}"
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; },
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; "9":{&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; 
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;"value": "{{row['33'].value}}"
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; },
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; "10":{&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; 
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;"value": "{{runningTotal.val}}"
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; }
&nbsp;&nbsp;&nbsp; }
&nbsp;&nbsp;&nbsp; {% if loop.last == false %},{% endif %}
&nbsp;&nbsp;&nbsp; {%- endfor %}
]
}------------------------------Dwight Munson------------------------------

dwightmunson1 · Answer

In the AM I'm going to try something like this:&nbsp;
{
{% set myDataSet = "myTableID" %}
{% set myTimeStop = 5.0 %}
{% set runningTotal = namespace(val=0.0) %}
&nbsp;&nbsp;&nbsp; 
"to": "{{myDataSet}}",
"data":[
&nbsp;
&nbsp;&nbsp;&nbsp; {% set i = 0 %}
&nbsp;&nbsp;&nbsp; {% while runningTotal.val &lt;= myTimeStop and i &lt; a.json.total_records %}
&nbsp;&nbsp;&nbsp; {% set row = a.json.data %}
&nbsp;&nbsp;&nbsp; {% set remainingTime = myTimeStop - runningTotal.val %}
&nbsp;&nbsp;&nbsp; {% set currentValue = row['33'].value if row['33'].value &lt;= remainingTime else remainingTime %}
&nbsp;&nbsp;&nbsp; {% set runningTotal.val = runningTotal.val + currentValue %}
&nbsp;&nbsp;&nbsp; {
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; "6":{&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; 
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;"value": "{{row['36'].value}}"
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; },
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; "7":{&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; 
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;"value": "{{row['8'].value}}"
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; },
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; "8":{&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; 
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;"value": "{{row['13'].value}}"
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; },
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; "9":{&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; 
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;"value": "{{currentValue}}"
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; },
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; "10":{&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; 
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;"value": "{{runningTotal.val}}"
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; }
&nbsp;&nbsp;&nbsp; }
&nbsp;&nbsp;&nbsp; {% set i = i + 1 %}
&nbsp;&nbsp;&nbsp; {% if loop.last == false and runningTotal.val &lt;= myTimeStop %},{% endif %}
&nbsp;&nbsp;&nbsp; {%- endwhile %}
]
}------------------------------Dwight Munson------------------------------

prashantmaheshw · Answer

You are too kind @Don Larson !!&nbsp;
Doug Hemming is the absolute beast in Jinja !
Dwight , you seem to have figured namespace which I would have recommended. Below is from on my notes I made few months back
You cannot use a simple counter variables inside ninja loops. Case in Point
```
{% set x = 0 %}
Counter Value before loop {{x}}
{% for myloop in range(6) %}
{% x=x+1 %}
{%end for%}
Counter Value after loop {{x}} 
```
You would expect the output  to be 
```
Counter value before loop 0
1
2
3
4
5
Counter value after loop 5
```
Instead what we get it is 
Counter value before loop 0
1
1
1
1
1
1

Counter value after loop 0
Everything inside loop gets a fresh value of our counter X in case
---

After some painful searching I stumbled upon a Ninja function called namespace for solving exactly the same issue
```
{% set x = namespace(value=0) %}
Counter Value before loop {{x}}
{% for myloop in range(6) %}
{% x.value=x.value+1 %}
{%end for%}
Counter Value after loop {{x}} 
```
Now the output is
```
Counter value before loop 0
1
2
3
4
5
Counter value after loop 5
```------------------------------Prashant Maheshwari------------------------------

Forum Discussion

Pipeline Jinja Issues

6 Replies

Related Content

Performing Multiplication in Jinja for Pipelines

Jinja Expression Comparing Now to Now+Hours

Pipeline JSON Issue

Pipeline Jinja based on current timestamp

pipeline import with CSV jinja issue

Recent Discussions

An API(?) button to copy fields from the form, to other fields

Pipeline Make Request - Return Make Request JSON Output into fields

Formula using Contain

Moving data from a columnar table to a record based table

Create Child Record, Save and then Edit button