Pipelines, Data Transformation, and Jinja!

I'm only up to Pipelines 101 myself, so far from an expert, and I know that there are Pipelines Office Hours every Thursday, (so another way to get at a free answer) but I do know that under the Quick Base channel there is a way to Prepare a Bulk record Upsert, which is like an "empty box" and then later to do a single step Commit Upsert which will merge in the records in the Upsert "box" into a Quick Base table.  If there is a Key field to that table which will eliminate the duplicates, then maybe when you upload with dups, only a single record will get uploaded.  I don't know if the Upsert will object to duplicate keys in the records to be Upserted.

If that approach works, then you can continue to have steps to keep adding to your Bulk Record Upsert box and do one big UPsertg at the end of the Pipeline Steps.

------------------------------
Mark Shnier (YQC)
Quick Base Solution Provider
Your Quick Base Coach
http://QuickBaseCoach.com
mark.shnier@gmail.com
------------------------------