Forum Discussion

Qrew Cadet

2 months ago

Pipeline to Search 130k Records in Another App and Create if the Record Does Not Yet Exist

I'm trying to optimize my pipeline and I'm having trouble deciding on the best way. I have 2 apps in the same realm. App "A" has approx. 30k records, and app "B" has approx. 130k records. When a ne...

Pipelines

MarkShnier__You

Qrew Legend

I'm not very proficient in Jinja Date Math. You can cheat and make a native Quickbase field and then hook onto that. Also, You have not explained how you plan to use a date/ time field in a fitter in the pipeline.

In native Quickbase you would just have a formula checkbox field

ToDate([Date Created]) = Today() - Days(1)

ToddMolino

Qrew Cadet

2 months ago

Def leaning towards the formula checkbox filter at this point LOL. Problem is, in my pipeline, ONLY the advanced filter option is available. I can't even use the simple filter option which is where I would reference the formula checkbox. Perhaps that's not allowed when doing upserts? Still very green at jinja and bulk upserts. I'll keep plugging away at this one. Thanks again.

MarkShnier__You
Qrew Legend
2 months ago
Why not just fire the Pipeline one by one as new records arrive in Table A?