Forum Discussion

CharlotteM's avatar
CharlotteM
Qrew Assistant Captain
4 days ago

Pipeline: Create a parent record if one does not exist

I have a child table (created by form engine) which contains a field that will be the (custom) key to its parent. The child table may have one or several records which should relate to one parent re...
Pipelines
CharlotteM's avatar
CharlotteM
Qrew Assistant Captain
4 days ago

That would be quick enough. But in this case, I added 147 child records (via Import, because I'm testing reports, so the Form Engine doesn't come into it in this case, just FYI). And the pipeline then added 34 parent records - in 32 minutes.  So I think something is not right.  

I've tried to provide a scrubbed YAML below, can you tell from this why it's so slow?

 

A: On Insert

 

- TRIGGER on_create -> a:
    inputs-meta:
      export_fields: '"Custom Parent Key, Related Record ID

      table: '"Child Table

B: Prepare to insert or update parent table

 

ACTION bulk_record_set define -> b:
    inputs-meta:
      export_fields: '"Custom Parent Key, Related Record ID1, Related Record ID2'
      merge_field: '"Custom Parent Key '
      table: '"Parent Table

C: using only recent records as candidates (to avoid looking at  the whole table, which will get very large)

 

- - QUERY record search -> c:
    FILTERS:
    - AND:
      - created_at less-than:
        - '5'
        - minutes
        - past
        - ''

D: Prepare records for insert or update

 

    inputs-meta:
      export_fields: '"Custom Parent Key, Related Record ID1, Related Record ID2'
      table: 'Child Table
- c<>LOOP:
  - DO:
    - b<>ACTION quickbase bulk_record_set create -> d:

E: Commit

 

        inputs:
          Custom Parent Key: '{{c.Custom Parent Key}}'
          Related Record ID1: '{{c.Related Record ID1 }}'
          Related Record ID2: '{{c.Related Record ID2}}'
    - b<>ACTION quickbase bulk_record_set commit_bulk_upsert -> e: {}

 

  • MarkShnier__You's avatar
    MarkShnier__You
    Icon for Qrew Legend rankQrew Legend
    4 days ago

    I think there's a problem with your pipeline. The pipeline should be as I described in the answer in your link. When a record is created, and it doesn't have a parent, then the pipeline is triggered. It creates a bulk record upsert, then  adds the one row into the upsert,  and it commits the upsert. There is no query for records created in the last five minutes. The pipeline simply acts on the individual Orphan records as they are created.