Forum Discussion

GowthamVemuri1's avatar
GowthamVemuri1
Qrew Member
5 years ago

Delete records while adding the records via import from CSV

Hi  I am importing some date from csv through import from file functionality. while adding the records in this attached step, is there any functionality which i can implement in such a way...i shoul...
Data import and export
EvanMartinez's avatar
EvanMartinez
Moderator
5 years ago
Hi Gowtham,

There is not a way to upload an entire spreadsheet into Quick Base and then go back to select which lines of the spreadsheet you wish to import into Quick Base. For that you would want to go through your spreadsheet before the upload and clean your data. Once the upload is set up and running in Quick Base you can leave out fields/columns from the import but not records. I hope this information is helpful.

If being able to better manage which records are getting uploaded into Quick Base would be helpful I would suggest leaving that as feedback on our User Voice. User Voice is a tool our product team uses to help track interest in new features and enhancements to existing features. The Quick Base User voice can most easily be accessed from the My Apps page in Quick Base by clicking on the orange Feedback tab that appears on the right of the page or at http://quickbase.uservoice.com by signing in with your Quick Base credentials. If you have any trouble signing in directly with the URL going through the Feedback tab on the My Apps page most often resolves them. If you do decide to share this feedback, if you post a link back here in this community thread if there are other community members with the same need they can vote to show their support.

------------------------------
Evan Martinez
Community Marketing Manager
Quick Base
------------------------------
  • MarkShnier__You's avatar
    MarkShnier__You
    Icon for Qrew Legend rankQrew Legend
    5 years ago
    One approach that I just thought of would be to import the CSV Into a temporary table in your app and then push a button to run a save table to table import from the temporary table into your real table. The save table to table import would have filters which would allow you to control which records past the final hurdle to get into your real data.

    ------------------------------
    Mark Shnier (YQC)
    Quick Base Solution Provider
    Your Quick Base Coach
    http://QuickBaseCoach.com
    mark.shnier@gmail.com
    ------------------------------
    • MarcBarry3's avatar
      MarcBarry3
      Qrew Trainee
      5 years ago
      Hey Mark,
        I've had varying degrees of success with this temporary table approach, usually less so when dealing with larger data sets.  I've been using automations to try and mark records back and forth so that reactions can drive whether records are copied over. 
      For example (each step is a separate automation):
      Step 1: data drops into a temp table (this step is a Pipeline/MS Flow step)
      Step 2: the target table reacts to this and marks any "legacy records" already living in the target table by using a formula field, that concatenates 3 other fields and comparing to a field in the target's key.  The target table uses this concatenated field as it's key.
      Step 3: the temp table will then react and mark records that match in the target table, then delete itself.  (This step fails on data sets larger than 1000)
      Step 4: run a table to table import from temp to target on a schedule after all of those records have finished marking and deleting themselves.  These existing records should be unique.  (This step fails on data sets larger than 1000)
      Step 5: Uncheck all Legacy checkboxes in the target table on a schedule.  (This step fails on data sets larger than 1000)

      Maybe I'm making this too complicated, but since this works on data sets smaller than 1000, it feels like I'm missing a simple way to make it all work.  In reading your response, I'd love to understand how to "push a button to run a save table to table import from the temporary table into your real table".  Since my attempt at automating this task is not working well, maybe a manual approach with actual working steps like yours would be a better place for me to work from.

      Any help is greatly appreciated! 

      Marc

      ------------------------------
      Marc Barry
      ------------------------------
      • MarkShnier__You's avatar
        MarkShnier__You
        Icon for Qrew Legend rankQrew Legend
        5 years ago
        If are simply asking how to create a formula URL button which will run a saved table to table copy and refresh the page you were on it would be

        var text URL = URLRoot() & "db/" & [_DBID of the target table from Advanced Properties] & "?act=API_RunImport&ID=10;

        "javascript:" &
        "$.get('" &
        $URL &
        "',function(){" &
        "location.reload(true);" &
        "});"
        & "void(0);"

        n the code above you need to enter the ID for the saved T2T import. In my case it was 10.  You see that in the URL when you edit the saved T2T import.

        Typically I make a table called like Admin Import and make a single record, which will be [Record ID#]= 1.

        Then I can use that to hold my button and to make relationships to count, for example how many records on the scratchpad and to put buttons to lead the user to the Import /Export page.



        ------------------------------
        Mark Shnier (YQC)
        Quick Base Solution Provider
        Your Quick Base Coach
        http://QuickBaseCoach.com
        mark.shnier@gmail.com
        ------------------------------