Pipeline Jinja Issues

Question

Hello Quickbase Community!

I'm having issues with a pipeline.&nbsp;

Step A: Quickbase Channel - Quickbase API - Make a Request
Essentially, I query data in a table and get back some JSON data. This step works completely fine.&nbsp;Step B (the problem step): Quickbase Channel - Quickbase API - Make a Request
This request is to post data to a test table for now. I'm trying to run a for loop on the data. I'm eventually going to incorporate the myTimeStop variable, but it can be ignored for now. I'm trying to iterate through the data, adding a line for each one, and keeping a running total for row '33'.
This works, but it's still resetting the runningTotal to 0.0 in each loop for some reason. Table ID redacted.
{% set myDataSet = "myTableID" %}{% set myTimeStop = 5.0 | float %}{% set runningTotal = 0.0 | float %}{&nbsp; &nbsp; "to": "{{myDataSet}}",&nbsp; &nbsp; "data": [&nbsp; &nbsp; &nbsp; &nbsp; {% for row in a.json.data %}&nbsp; &nbsp; &nbsp; &nbsp; {% set runningTotal = runningTotal + row['33'].value %}&nbsp; &nbsp; &nbsp; &nbsp; {&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; "6": {&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; "value": "{{row['36'].value}}"&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; },&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; "7": {&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; "value": "{{row['8'].value}}"&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; },&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; "8": {&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; "value": "{{row['13'].value}}"&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; },&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; "9": {&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; "value": "{{row['33'].value}}"&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; },&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; "10": {&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; "value": "{{runningTotal}}"&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; }&nbsp; &nbsp; &nbsp; &nbsp; }&nbsp; &nbsp; &nbsp; &nbsp; {% if not loop.last %},{% endif %}&nbsp; &nbsp; &nbsp; &nbsp; {% endfor %}&nbsp; &nbsp; ]}

I've tried this, but it gives me a vague error. It's pretty much the same as the top, but I'm appending each line to the list as later I want to iterate through the data until I hit the timestop variable and then add that list to Quickbase.&nbsp;
{% set myDataSet = "myTableID" %}
{% set myTimeStop = 5.0 | float %}{% set runningTotal = 0.0 | float %}
{% set data = [] %}
{% for row in a.json.data %}&nbsp; &nbsp; {% set runningTotal = runningTotal + row['33'].value %}&nbsp; &nbsp; {% set item = {&nbsp; &nbsp; &nbsp; &nbsp; "6": {"value": row['36'].value},&nbsp; &nbsp; &nbsp; &nbsp; "7": {"value": row['8'].value},&nbsp; &nbsp; &nbsp; &nbsp; "8": {"value": row['13'].value},&nbsp; &nbsp; &nbsp; &nbsp; "9": {"value": row['33'].value},&nbsp; &nbsp; &nbsp; &nbsp; "10": {"value": runningTotal}&nbsp; &nbsp; } %}&nbsp; &nbsp; {% do data.append(item) %}{% endfor %}
{&nbsp; &nbsp; "to": "{{myDataSet}}",&nbsp; &nbsp; "data": {{data|to_json}}}

I'm just not understanding why it doesn't like the second variation. It passes the test initially, but when run gives a vague "Something went wrong executing a step. Try modifying your pipeline."
Also, not understanding why in the first one it's not actually keeping a running total.&nbsp;------------------------------Dwight Munson------------------------------

dwightmunson1 · Answer

For the second bit, I've also tried:{% set data = data.append(item) %}
and
{% set _ = data.append(item) %}
and
{{data.append(item)}}

I've also tried:&nbsp;
{&nbsp; &nbsp; "to": "{{myDataSet}}",&nbsp; &nbsp; "data": {{data|tojson}}}
and
{&nbsp; &nbsp; "to": "{{myDataSet}}",&nbsp; &nbsp; "data": {{ data | tojson }}}------------------------------Dwight Munson------------------------------

donlarson · Answer

Dwight,

I am no Jinja or Python expert, however I remember reading somewhere in a Python resource about declaring variables inside and outside of a loop.&nbsp; &nbsp;You have defined Running Total twice and there is a voice in my head saying that your problem lies there.
The two best resources for Jinja here are @Doug Henning or @Prashant Maheshwari&nbsp;
------------------------------Don Larson------------------------------

dwightmunson1 · Answer

This worked for me for the running total. Now I'm trying to figure out a while loop for it to only iterate up to the myTimeStop.
{
{% set myDataSet = "myTableID" %}
{% set myTimeStop = 5.0 %} 
{% set runningTotal = namespace(val=0.0) %} 
&nbsp;&nbsp;&nbsp;&nbsp;
"to": "{{myDataSet}}",
"data":[
&nbsp;
&nbsp;&nbsp;&nbsp; {% for row in (a.json.data) %}
&nbsp;&nbsp;&nbsp; {
&nbsp;&nbsp; &nbsp;&nbsp;&nbsp;&nbsp;&nbsp;{% set runningTotal.val = runningTotal.val + row['33'].value %} 
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;"6":{&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; 
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;"value": "{{row['36'].value}}"
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; },
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; "7":{&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; 
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;"value": "{{row['8'].value}}"
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; },
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; "8":{&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; &nbsp;&nbsp;&nbsp;
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;"value": "{{row['13'].value}}"
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; },
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; "9":{&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; 
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;"value": "{{row['33'].value}}"
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; },
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; "10":{&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; 
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;"value": "{{runningTotal.val}}"
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; }
&nbsp;&nbsp;&nbsp; }
&nbsp;&nbsp;&nbsp; {% if loop.last == false %},{% endif %}
&nbsp;&nbsp;&nbsp; {%- endfor %}
]
}------------------------------Dwight Munson------------------------------

dwightmunson1 · Answer

In the AM I'm going to try something like this:&nbsp;
{
{% set myDataSet = "myTableID" %}
{% set myTimeStop = 5.0 %}
{% set runningTotal = namespace(val=0.0) %}
&nbsp;&nbsp;&nbsp; 
"to": "{{myDataSet}}",
"data":[
&nbsp;
&nbsp;&nbsp;&nbsp; {% set i = 0 %}
&nbsp;&nbsp;&nbsp; {% while runningTotal.val &lt;= myTimeStop and i &lt; a.json.total_records %}
&nbsp;&nbsp;&nbsp; {% set row = a.json.data %}
&nbsp;&nbsp;&nbsp; {% set remainingTime = myTimeStop - runningTotal.val %}
&nbsp;&nbsp;&nbsp; {% set currentValue = row['33'].value if row['33'].value &lt;= remainingTime else remainingTime %}
&nbsp;&nbsp;&nbsp; {% set runningTotal.val = runningTotal.val + currentValue %}
&nbsp;&nbsp;&nbsp; {
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; "6":{&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; 
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;"value": "{{row['36'].value}}"
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; },
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; "7":{&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; 
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;"value": "{{row['8'].value}}"
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; },
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; "8":{&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; 
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;"value": "{{row['13'].value}}"
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; },
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; "9":{&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; 
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;"value": "{{currentValue}}"
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; },
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; "10":{&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; 
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;"value": "{{runningTotal.val}}"
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; }
&nbsp;&nbsp;&nbsp; }
&nbsp;&nbsp;&nbsp; {% set i = i + 1 %}
&nbsp;&nbsp;&nbsp; {% if loop.last == false and runningTotal.val &lt;= myTimeStop %},{% endif %}
&nbsp;&nbsp;&nbsp; {%- endwhile %}
]
}------------------------------Dwight Munson------------------------------

prashantmaheshw · Answer

You are too kind @Don Larson !!&nbsp;
Doug Hemming is the absolute beast in Jinja !
Dwight , you seem to have figured namespace which I would have recommended. Below is from on my notes I made few months back
You cannot use a simple counter variables inside ninja loops. Case in Point
```
{% set x = 0 %}
Counter Value before loop {{x}}
{% for myloop in range(6) %}
{% x=x+1 %}
{%end for%}
Counter Value after loop {{x}} 
```
You would expect the output  to be 
```
Counter value before loop 0
1
2
3
4
5
Counter value after loop 5
```
Instead what we get it is 
Counter value before loop 0
1
1
1
1
1
1

Counter value after loop 0
Everything inside loop gets a fresh value of our counter X in case
---

After some painful searching I stumbled upon a Ninja function called namespace for solving exactly the same issue
```
{% set x = namespace(value=0) %}
Counter Value before loop {{x}}
{% for myloop in range(6) %}
{% x.value=x.value+1 %}
{%end for%}
Counter Value after loop {{x}} 
```
Now the output is
```
Counter value before loop 0
1
2
3
4
5
Counter value after loop 5
```------------------------------Prashant Maheshwari------------------------------

Forum Discussion

Pipeline Jinja Issues