So if you do the math, in order to check the first record to see it is a duplicate, the system needs to look at he other 88,000 records. So to scan 88,000 record for duplicates it needs to look at 88,000 * 88,000 = a very big number 7.7 Billion.
Alas, I had the same problem though with a smaller record count. I think mine was about 30,000 records.
So I created a formula to get the last digit of the Record ID, so that would be a number from 0 to 9. The I created 9 more copies of my Saved Table to Table Import each one filtered to just import 1/10th, so like batch 0, batch 1 etc .... of the data. Then created the URL formula button to run the 10 imports. Individually they will take 1/10 of the amount of time each and in my case it worked.
This is part of my code
var text UpdateMembershipWithEMRIDIFMembershipEMRIsBlankANDMatchesOnLastFirstInitialDOBBatchOne = URLRoot() & "db/"
& [_DBID_MEMBERSHIP_TRACKING_1] & "?act=API_RunImport&ID=16";
var text UpdateMembershipWithEMRIDIFMembershipEMRIsBlankANDMatchesOnLastFirstInitialDOBBatchTwo = URLRoot() & "db/"
& [_DBID_MEMBERSHIP_TRACKING_1] & "?act=API_RunImport&ID=20";
var text UpdateMembershipWithEMRIDIFMembershipEMRIsBlankANDMatchesOnLastFirstInitialDOBBatchThree = URLRoot() & "db/"
& [_DBID_MEMBERSHIP_TRACKING_1] & "?act=API_RunImport&ID=21";
var text UpdateMembershipWithEMRIDIFMembershipEMRIsBlankANDMatchesOnLastFirstInitialDOBBatchFour = URLRoot() & "db/"
& [_DBID_MEMBERSHIP_TRACKING_1] & "?act=API_RunImport&ID=22";
var text UpdateMembershipWithEMRIDIFMembershipEMRIsBlankANDMatchesOnLastFirstInitialDOBBatchFive = URLRoot() & "db/"
& [_DBID_MEMBERSHIP_TRACKING_1] & "?act=API_RunImport&ID=23";
var text UpdateMembershipWithEMRIDIFMembershipEMRIsBlankANDMatchesOnLastFirstInitialDOBBatchSix = URLRoot() & "db/"
& [_DBID_MEMBERSHIP_TRACKING_1] & "?act=API_RunImport&ID=24";
var text UpdateMembershipWithEMRIDIFMembershipEMRIsBlankANDMatchesOnLastFirstInitialDOBBatchSeven = URLRoot() & "db/"
& [_DBID_MEMBERSHIP_TRACKING_1] & "?act=API_RunImport&ID=25";
var text UpdateMembershipWithEMRIDIFMembershipEMRIsBlankANDMatchesOnLastFirstInitialDOBBatchEight = URLRoot() & "db/"
& [_DBID_MEMBERSHIP_TRACKING_1] & "?act=API_RunImport&ID=26";
var text UpdatePartOneOrPartTwo = URLRoot() & "db/" & Dbid() & "?act=API_EditRecord&rid=1"
& "&_fid_153=" & URLEncode("Part 1 of 2");
var text Refresh = URLRoot() & "db/" & Dbid() & "?a=dr&rid=1";
$UpdateLastSeenBasedOnMatchingLastFirstDOB
& "&rdr=" & URLEncode($UpdateNextApptBasedOnMatchingLastFirstDOB)
& URLEncode("&rdr=" & URLEncode($UpdateMembershipWithEMRIDIFMembershipEMRIsBlank))
& URLEncode(URLEncode("&rdr=" & URLEncode($UpdateMembershipWithEMRIDIFMembershipEMRIsBlankANDMatchesOnLastFirstInitialDOBBatchOne)))
& URLEncode(URLEncode(URLEncode("&rdr=" & URLEncode($UpdateMembershipWithEMRIDIFMembershipEMRIsBlankANDMatchesOnLastFirstInitialDOBBatchTwo))))
& URLEncode(URLEncode(URLEncode(URLEncode("&rdr=" & URLEncode($UpdateMembershipWithEMRIDIFMembershipEMRIsBlankANDMatchesOnLastFirstInitialDOBBatchThree)))))
& URLEncode(URLEncode(URLEncode(URLEncode(URLEncode("&rdr=" & URLEncode($UpdateMembershipWithEMRIDIFMembershipEMRIsBlankANDMatchesOnLastFirstInitialDOBBatchFour))))))
& URLEncode(URLEncode(URLEncode(URLEncode(URLEncode(URLEncode("&rdr=" & URLEncode($UpdateMembershipWithEMRIDIFMembershipEMRIsBlankANDMatchesOnLastFirstInitialDOBBatchFive)))))))
& URLEncode(URLEncode(URLEncode(URLEncode(URLEncode(URLEncode(URLEncode("&rdr=" & URLEncode($UpdateMembershipWithEMRIDIFMembershipEMRIsBlankANDMatchesOnLastFirstInitialDOBBatchSix))))))))
& URLEncode(URLEncode(URLEncode(URLEncode(URLEncode(URLEncode(URLEncode(URLEncode("&rdr=" & URLEncode($UpdateMembershipWithEMRIDIFMembershipEMRIsBlankANDMatchesOnLastFirstInitialDOBBatchSeven)))))))))
& URLEncode(URLEncode(URLEncode(URLEncode(URLEncode(URLEncode(URLEncode(URLEncode(URLEncode("&rdr=" & URLEncode($UpdateMembershipWithEMRIDIFMembershipEMRIsBlankANDMatchesOnLastFirstInitialDOBBatchEight))))))))))
& URLEncode(URLEncode(URLEncode(URLEncode(URLEncode(URLEncode(URLEncode(URLEncode(URLEncode(URLEncode("&rdr=" & URLEncode($Refresh)))))))))))
// here is the generic syntax to next 11 URL calls such as run the 10 imports and refresh the page
$URLONE
& "&rdr=" & URLEncode($URLTwo)
& URLEncode("&rdr=" & URLEncode($URLThree))
& URLEncode(URLEncode("&rdr=" & URLEncode($URLFour)))
& URLEncode(URLEncode(URLEncode("&rdr=" & URLEncode($URLFive))))
& URLEncode(URLEncode(URLEncode(URLEncode("&rdr=" & URLEncode($URLSix)))))
& URLEncode(URLEncode(URLEncode(URLEncode(URLEncode("&rdr=" & URLEncode($URLSeven))))))
& URLENcode(URLEncode(URLEncode(URLEncode(URLEncode(URLEncode("&rdr=" & URLEncode($URLEight)))))))
& URLENcode(URLENcode(URLEncode(URLEncode(URLEncode(URLEncode(URLEncode("&rdr=" & URLEncode($URLNine))))))))
& URLENcode(URLENcode(URLENcode(URLEncode(URLEncode(URLEncode(URLEncode(URLEncode("&rdr=" & URLEncode($URLTen)))))))))
& URLENcode(URLENcode(URLENcode(URLENcode(URLEncode(URLEncode(URLEncode(URLEncode(URLEncode("&rdr=" & URLEncode($URLEleven))))))))))
------------------------------
Mark Shnier (Your Quickbase Coach)
mark.shnier@gmail.com
------------------------------