Skip to main content
Question

Time Series Data

I have a large amount of time series data taken in 30 second increments over the course of 4-5 days.  This gives 10,000 individual items needed to store in 12+ columns.  I do not want to analyze the data in QB, due to the 200 item limit, but I do want it stored together.  I imported the CSV data and it is held just fine, but when I go to add it to a project description table I made, then I have to enter the data in individual increments.

Is there an option for a mass import, basically treating each column of 10,000 pieces of data as 1 piece?  I just need to avoid individually entering 10,000 items needlessly. 

Thanks!
    This topic has been closed for replies.

    I am not quite sure of your table structure, but if you make a summary report one of the options under the more button is to copy these records to another table.
    See the images below for what I am talking about.  I looked at the summary, but it just said I had 10K data points.  The bottom pic show the input for a new time series and at the bottom is the selection for the project the data belongs to, a 1 to Many table.

    Maybe that helps explain a bit.  I know QB is not really meant for this, but trying to find the limit of a QB in relation to a new project we are doing.

    >Is there an option for a mass import, basically treating each column of 10,000 pieces of data as 1 piece

    The option you are looking for is called a file attachment field. Store all your time series data in a file and upload the file.  I don't understand the goal of what you are trying to accomplish.

    If you need some type of custom import, manipulation, calculation or access to the data after bulk import this can all be done with script.
    • MCFNeil
    • Registered
    • April 12, 2017
    Neil,  How you been?  QuickBase will be able to do this for you.  

    To assign all those Series data records to the project, you can do a mass update, by using the "More" drop-down, then select "search & Replace in this report"

    You can then select "Related Project", change 'blank' to 'your project'

    Click replace.




    This will update all the child records at once.
    Your project can be implemented entirely in QuickBase. D3.js is better than Bokeh and jsData (and other JavaScript libraries) can probably do everything you are doing in Pandas. See:

    D3
    https://d3js.org/

    jsData
    http://learnjsdata.com/

    Bokeh
    http://bokeh.pydata.org/en/latest/

    Pandas
    http://pandas.pydata.org/

    I am an electrical engineer and I have extensive experience with modeling, simulation and data analysis - and I have written libraries to model motors (synchronous, asynchronous, etc), switchgear, semiconductors (http://ws680.nist.gov/publication/get_pdf.cfm?pub_id=19115) etc.

    Again, your project can be done entirely within QuickBase.
    Ah so, now we should talk!!!!  We are an electrical consulting firm.  If QB can do what we want, then we would be golden.  

    As Matthew Neil knows, I am not a programmer, hence the work with QB.  Python is done by a coworker who is a wizard at Python.

    I will look at D3 tonight, and look through your IEEE article also. (I am IEEE PES myself).  We are doing event analysis on the time series data, graphing load to power factor, etc. to analyze what is happening electrically.  Our client started by storing and analyzing these data points in Excel and it is not pretty.  I am trying to see if QB will do this.

    Will D3js import the data from QB, analyze and plot as we want, and then export the results back to QB?  If so, Would you be willing to talk some off-line so I can pick your brain on methodology for using within QB?

    Thanks for the help you have given so far on this question and the others you have answered!

    Cheers. 
    Terms & ConditionsAccessibility statement