Forum Discussion

hhersch's avatar
hhersch
Qrew Captain
6 years ago

Exciting feature for integrators Ð new mergeFieldId in API_ImportFromCSV

We know that approximately half of all Quick Base traffic comes from our API. This is a staggering statistic that continues to rise. This is partly due to new integration-Platform-as-a-Service (iPaaS) solutions accelerating in the market (such as Workato, Zapier, and others). Many customers are also either themselves, or with a valued QSP, writing custom code that integrates other systems with Quick Base. Our data shows that customers leveraging these integrations are getting even more value out of Quick Base.

We want to ensure that our builders can integrate Quick Base with other solutions as easily as possible. Historically, builders have needed to use workarounds if they werenÕt able to match the keys. One alternative was to change the key field on the table, rather than the built-in Record ID#. While powerful, this has the potential to become complicated and burdensome. Knowing that API_ImportFromCSV is used tens of millions of times per week, we knew we needed to make integrations easier. To that end, we are introducing a new feature to this API call. Today, when calling this API, the key field is used to tell Quick Base which records the data being imported should match to. Visually, the flow looks something like the below*.


*This is just a sample representation. Many different workflows are possible.

With our new feature coming with the November release, integrators will be able to pass in any unique field and Quick Base will do the matching. This completely eliminates what is usually the most difficult part of an integration Ð the ÒTÓ (Transform) in ÒETLÓ.

Now, the process will look something like this.


We worked hard on this feature, after identifying it as an important need in the Òbuilder journeyÓ. We expect this to go live with our November release, with updates to the API documentation shortly thereafter. Below, IÕve included a payload request sample as well a sample of a possible error we might return when using this feature. We encourage you try this feature in your integrations. As always, please provide feedback in UserVoice by clicking the orange ÒFeedbackÓ button from your ÒMy AppsÓ page.

Sample request with new mergeFieldId



Sample response when the mergeFieldId is not unique


 

15 Replies

Sort By
  • ArchiveUser's avatar
    ArchiveUser
    Qrew Captain
    6 years ago
    This will be a lifesaver if it works as advertise! As you said, the T is the most complicated part of any integration. 
  • _anomDiebolt_'s avatar
    _anomDiebolt_
    Qrew Elite
    6 years ago
    This is indeed a welcome and needed feature.

    >We expect this to go live with our November release, with updates to the API documentation shortly thereafter. 

    Include this missing info in your API documentation:

    The QuickBase HTTP API documentation overwhelmingly emphasizes and encourages using XML for both requests and responses. But forming XML requests can be verbose and overly complicated. Luckily you can send your request parameters as (1) URL encoded strings or (2) as formdata and depending on the language you are using there may well be a library or language feature that makes this dead simple. QuickBase will recognize these requests even though they do not use an XML body.

    This is best demonstrated by an example. Assuming your CSV data is in the variable csvData and there are variables for apptoken and usertoken the following two code fragments demonstrates you don't need to send an XML body:

    Using JavaScript and jQuery library: 
    var object = {
      act: "API_ImportFromCSV",
      records_csv: csvData,
      clist: clist, "6.7.8.9.10",
      mergeFieldId: "10"
      apptoken: apptoken,
      usertoken: usertoken
    };

    $.post(dbid, object);

    Using JavaScript and Fetch API:
    var formData = new FormData();

    formData.append("act", "API_ImportFromCSV");
    formData.append("records_csv", csvData);
    formData.append("clist", "6.7.8.9.10");
    formData.append("mergeFieldId", "10");
    formData.append("apptoken", apptoken);
    formData.append("usertoken", usertoken);

    fetch(dbid, {
      method: "POST",
      body: formData,
      credentials: "include"
    });

    The point is that you don't need to send an XML body and alternatively QuickBase will recognize parameters passed as a URL encoded string or as formdata. This applies no matter what language or library you are using as it is an inherent feature of how QuickBase processes API  requests.

    Additionally, if you see an XML body being specified in some API call you can bust it down to a set of simple attribute/value parameters by removing the <qdbapi> tag altogether and just passing all the other tags as parameters. This procedure works for all API_*, QBI_* and JBI_* methods.

    My advice is to NOT send XML bodies as it only makes your code bloated.

    Proof That XML Is Extremely Bloated
    https://www.zdnet.com/article/proof-that-xml-is-extremely-bloated/
  • EvanMartinez's avatar
    EvanMartinez
    Qrew Elite
    6 years ago
    I just wanted to let everyone here know that this update is planned to go live with our November release which is scheduled for Sunday November 11, 2018. That is when this new expanded functionality will begin to be available with the update to documentation for the mergeFieldId in API_ImportFromCSV to come trailing the release itself, a firm date on that hasn't been set yet but once it is I will update this thread as well.

    You can find all the details of our upcoming November release below:

    https://community.quickbase.com/quickbase/topics/quick-base-release-notes-for-november-2018
  • EvanMartinez's avatar
    EvanMartinez
    Qrew Elite
    6 years ago
    Hi Dan,

    Thanks I cut myself off when putting the response in and ate part of my post. I meant to indicate the update on the docs will come sometime after the release itself. I don't currently have a firm date on the update to the API guide for ImportFromCSV yet. When I do I'll make sure to update this post above with that information.
  • SuryaExpert's avatar
    SuryaExpert
    Qrew Assistant Captain
    6 years ago
    Is this only when you import using the API or is this mergefieldID an option when importing interactively too? (Using the Import wizard) My clients prefer the interactive way of importing.
  • hhersch's avatar
    hhersch
    Qrew Captain
    6 years ago
    Surya - right now just on the API. We consume our own APIs for the UI import so we will be evaluating effort and impact of expanding to that as well.