Hi everyone, I am new to QB so these questions could have simple solutions so I figured I would post them. I am currently uploading 100K+ in entries from excel and want to select a random 1000 from the data set. Is there a way to do that? I looked into the report formulas and pipelines and nothing stood out, but doesn't mean it's not there. 2nd - If not, I know how to randomize it based off sorting the data a particular way, but didn't know if I am able to limit the output of the table to only 1000 rows? Either would work, but a random function would be more idea.
Thank you Anthony
------------------------------ Anthony McIntyre ------------------------------
Mark and Jeff both mentioned some potential solutions. Agreed there isn't an easy answer to this specific issue in QB.
Another option would be to use the Jinja Random function in a pipeline based off the Rec ID#, limit the result to 1k records, and then have the pipeline mark those 1000 random records with a checkbox. That way the report could be filtered to only show 1k records and be random.
Here is a Pipeline to select a given percent of records from a table. I use 2 "Make Request" steps, as they are very efficient at traversing a VERY large data sets and performing data transformations on the data as it moves through the pipeline. I can filter the source records by any field. In this example, I'm filtering on "Dimension_01" (FID[11]).
The Body is; { {% set myData_Set_01 = "ttttttttt" %}.
"from": "{{myData_Set_01}}", "select":[3], {# Dimension 01 #} "where": " {11.EX.'A'}OR{11.EX.'B'}OR{11.EX.'C'}OR{11.EX.'D'}OR{11.EX.'E'}" } * replace "ttttttttt" with the table ID for your source table
STEP B) This Make Request step is where the random selection is performed.
I do not believe there is any way to generate random values in QuickBase natively. You could probably do this using some javascript and a code page, but that's a bit more of an advanced function.
------------------------------ Jeff Peterson ------------------------------
I have this in my bag of tricks to generate a Random number. If you really cared how random it was you would have to run your own statistical test I suppose. Since it is based on the record ID then you have to decide if that works for your process because of course this pseudo-random number will never change for a particular Record ID