Table to Table import in Pipeline

Question

Has anyone heard if there is a roadmap to simply run table to table imports in Pipelines, or if you will need to essentially build it in the Pipeline using the following instructions.

Building Table-to-Table (T2T) Imports using Pipelines

------------------------------
Mike Tamoush
------------------------------

markshnier__you · Answer

No, you just call the API.&nbsp; They had to figure that one out in order to be able to migrate Automations.&nbsp; The easiest thing to do is to make a dummy automation that runs an import and migrate it and then you'll see exactly what you need to do.&nbsp; It is really just a one line API call and I think you set a setting to&nbsp; POST.------------------------------Mark Shnier (YQC)mark.shnier@gmail.com------------------------------

miketamoush · Answer

Oh thanks! I didn't realize they got around to including that in the migration function. Which reminds me....I still have 150 automations to migrate....wonder how long I have to do that. Another year at least I think.

------------------------------
Mike Tamoush
------------------------------

markshnier__you · Answer

Yes, if they hold to their public statements then I believe after the January release which is around January 20 or so they will prevent the creation of new automations. Then you will have till the end of 2022 to do your migrations. Now that everybody is moved over to the Blaze engine for pipelines, yes it is probably time to start thinking about planning that migration.

One thing to plan for is they have not yet solved the governance issue. That refers to the topic of which users can see which pipelines. If you do have a Service Account to own automated functions then my recommendation would be to make sure that the Automations are owned by that Service Account so you would need to go in and edit and then resave them to make sure the ownership transfers. Then do the migration. That way the Service Account will own the pipeline.

------------------------------
Mark Shnier (YQC)
mark.shnier@gmail.com
------------------------------

miketamoush · Answer

Good call on the ownership. One thing I was trying to wait for them to figure out was the load speed. I have about 50 pipelines, and the page takes about 45 seconds to load. I can't imagine how long it will take with 200 pipelines.Though, customer support did have one good idea that i tag all of my pipelines with useful tags, then bookmark the page when it is filtered. If i have a say 5 bookmarks, i can limit my pipelines that load.But still, I really hope they just figure out how to make the pipeline page load at a reasonable rate.------------------------------Mike Tamoush------------------------------

Forum Discussion

Table to Table import in Pipeline

4 Replies