update all records

  • 0
  • 1
  • Question
  • Updated 4 years ago
  • Answered

I need to update 100,000 records every week -- just serial number and product name.  About 99,500 will be exactly the same.  Then there will be a few additions and a dozen or so deletes every week.  I cannot get a 'changes' file.  Unless there is a better way, I'm planning to just delete all records in Quckbase, and upload the new file, is that how you would do it?  Is there a way to tell Quickbase to automatically delete all records and load this file ever week if it's on a server somewhere?


Photo of Quintin

Quintin

  • 0 Points

Posted 4 years ago

  • 0
  • 1
Photo of QuickBaseCoach App Dev./Training

QuickBaseCoach App Dev./Training, Champion

  • 67,760 Points 50k badge 2x thumb
Is the serial # field unique and is it or can it be the key field to your table?
Photo of Quintin

Quintin

  • 0 Points
Yes, the serial number is unique.  I could make it the key if necessary.
Photo of Quintin

Quintin

  • 0 Points
If you are thinking about an "update import", or whatever it's called, I was concerned that that method would not delete the serial number records that are no long in the file.  Is that right?
Photo of QuickBaseCoach App Dev./Training

QuickBaseCoach App Dev./Training, Champion

  • 67,760 Points 50k badge 2x thumb
Here is my suggestion for a native solution.  Of course there are third party QuickBase Service Providers who can automate this for, but then you then you are typically into one time setup fee and a monthly hosting fee in the order of $30 a month or so.

As you know, QuickBase has announced Synch and at EMPOWER they said that while they do not "sync" to CSV files, that is the next interface they are working on and it will be available soon.  I don't know when "soon" is but I would guess by the end of the calendar year at the latest.  But that is just my assumption because they typically do not discuss features which are years away.

So, until then its probably best to just purge and re-import. 


I don't know if you have tried to do a full import and how smoothly it went.  You are lucky that your data is only 2 columns "wide".  I have found that when trying to import a dataset with many columns, I had to break it up to 25,000 records at a time or i would get an error.  The specific error message is misleading, but its just telling you that it's unhappy.

To make the purge quicker, you could use the API_PurgeRecords in a URL formula button or a dashboard button and hope that it does not choke on too many records.  It can time out if there are too many records, in which case you need to fall back on a List All report and then "More ...  Delete these records" and watch the progress bar creep across.








Photo of QuickBaseCoach App Dev./Training

QuickBaseCoach App Dev./Training, Champion

  • 67,760 Points 50k badge 2x thumb
Sync does have a delete mode where the QuickBase record would be deleted if the source table record is no longer there.