Discussions

Pipelines Expert Needed for Issues in a Bulk Upsert Pipeline

  • 1.  Pipelines Expert Needed for Issues in a Bulk Upsert Pipeline

    Posted 11 days ago
    Edited by Evan Martinez 10 days ago
    I am trying to create a Batch Upsert Pipeline.  It looks like everything is working fine until the very end when it shows the following:

    records_added:0
    records_updated:0
    records_processed:0
    records_unchanged:0
    -------------------------
    Data is being processed and can be seen in the various steps.  Why does it not load/update/or give the number of records read?

    ------------------------------
    # xpt_hrly_FPHR_to_QuickBase2
    #
    
    # Account slugs:
    #  - Removed: Pipelines User Token For Myra <None>
    ---
    - META:
        name: xpt_hrly_FPHR_to_QuickBase2
    - TRIGGER csv-handler csv_source on_incoming_csv_blob -> a:
        ___: ___
    - ACTION Removed bulk_record_set define -> b:
        export_fields: 8, 9, 24, 25, 12, 15, 14, 16, 6, 17, 10, 13, 11, 26, 7
        merge_field: '24'
        table: bqvir4hqv
        ___: ___
    - a<>QUERY csv-handler csv_row search -> c:
        csv_header_mapping: hrly_Period,hrly_Site,hrly_CurrentEndDate,hrly_CurrentEndTime,hrly_PeriodIndex,hrly_Product_Sysid,hrly_ProductTypeNumber,hrly_NAXMLFuelGradeID,hrly_ProductName,hrly_NonResettableTransactionCount,hrly_NonResettableTransactionAmount,hrly_NonResettableTransactionVolume,hrly_FPHRID,hrly_Index,hrly_ShiftPeriod
        has_header_line: 'true'
        row_separator: ','
        type_of_hrly_current_end_date: string
        type_of_hrly_current_end_time: string
        type_of_hrly_fphrid: integer
        type_of_hrly_index: string
        type_of_hrly_naxml_fuel_grade_id: string
        type_of_hrly_non_resettable_transaction_amount: number
        type_of_hrly_non_resettable_transaction_count: integer
        type_of_hrly_non_resettable_transaction_volume: number
        type_of_hrly_period: integer
        type_of_hrly_period_index: string
        type_of_hrly_product_name: string
        type_of_hrly_product_sysid: integer
        type_of_hrly_product_type_number: number
        type_of_hrly_shift_period: integer
        type_of_hrly_site: string
        ___: ___
    - c<>LOOP:
      - DO:
        - b<>ACTION quickbase bulk_record_set create -> d:
            ___: ___
            hrly_current_end_date: '{{c.hrly_current_end_date}}'
            hrly_current_end_time: '{{c.hrly_current_end_time}}'
            hrly_fphrid: '{{c.hrly_fphrid}}'
            hrly_hourly_index: '{{c.hrly_period_index}}'
            hrly_naxml_fuel_grade_id: '{{c.hrly_naxml_fuel_grade_id}}'
            hrly_non_resettable_transaction_amount: '{{c.hrly_non_resettable_transaction_amount}}'
            hrly_non_resettable_transaction_count: '{{c.hrly_non_resettable_transaction_count}}'
            hrly_non_resettable_transaction_volume: '{{c.hrly_non_resettable_transaction_volume}}'
            hrly_period: '{{c.hrly_period}}'
            hrly_period_index: '{{c.hrly_period_index}}'
            hrly_product_name: '{{c.hrly_product_name}}'
            hrly_product_sysid: '{{c.hrly_product_sysid}}'
            hrly_product_type_number: '{{c.hrly_product_type_number}}'
            hrly_shift_period: '{{c.hrly_shift_period}}'
            hrly_site: '{{c.hrly_site}}'
    - b<>ACTION quickbase bulk_record_set commit_bulk_upsert -> e:
        ___: ___
    ...
    What other information will help you help me?  

    Thanks so much!
    Myra Canterbury






    ------------------------------
    Myra Canterbury
    ------------------------------