Forum Discussion

MichaelTamoush's avatar
MichaelTamoush
Qrew Captain
5 years ago

Pipelines Issues

Does anyone else have constant issues with pipelines not refreshing, or not wanting to save changes, or simply having pipelines look blank when you go edit them?

Any of these issues I usually just need to give it 10-15 minutes and it resolves, but it happens constantly. Wondering if my frustrations are with pipelines, or perhaps just my internet connection....

------------------------------
Mike Tamoush
------------------------------
Pipelines
  • BlakeHarrison's avatar
    BlakeHarrison
    Qrew Captain
    5 years ago
    Unfortunately, yes, I'm seeing the same thing and would have to lean toward it being a Pipelines issue. The next time you see something like that, see if you can capture video of the issue and submit to to Support. There are random issues all over and we need to submit as many examples as possible so they can track down the root cause.

    ------------------------------
    Blake Harrison
    bharrison@datablender.io
    DataBlender - Quick Base Solution Provider
    Atlanta GA
    404.800.1702 / http://datablender.io/
    ------------------------------
  • AustinK's avatar
    AustinK
    Qrew Commander
    5 years ago
    Yes we have seen a lot of pipeline issues but usually only on the bigger ones. We were starting to implement pipelines into some important processes and they just kept breaking constantly so we no longer use pipelines for anything that we need consistency from.

    We can't narrow down the issue. The more complicated pipelines always end up exploding at some point. You get them working and then you go in and make one tiny little change to one part and some other part of it collapses and sometimes you need to make it from scratch again. Sometimes you can fix it.

    I really want pipelines to be good because I can see a lot of potential there but I just don't think we are willing to be guinea pigs for it. There are a lot of integration services that don't give us these issues and while they will cost more in the end... The cost of the pipeline failing on us at unexpected times is almost definitely greater.
    • MichaelTamoush's avatar
      MichaelTamoush
      Qrew Captain
      5 years ago

      Agree that it seems to be on complicated pipelines. One thing I have figured out that 'sort' of helps is:

      As soon as you see an error flash up on the top right (Offline, Internal Error, etc), just stop right then. Anything you do past that point will not be saved and will screw things up. What I wrote in my original post "If I wait 10 minutes it seems OK" is NOT true.

      For example: I just had a a long pipeline. In the middle of the pipeline I got an error message. I kept going and when I finished, it wouldn't let me click out (gave me the 'you will lose any unsaved changes' message). Nor would it let me turn on the pipeline. I let it sit there for 10 or 15 minutes and boom, it seemed great.

      However, if I left and came back in, everything I did AFTER that error message was totally wonky. Some was gone, some was just plain wrong.

      I rebuilt the pipeline, and this time kept turning on the pipeline and made sure it would turn on properly. If it did, I continued. If it didn't, I immediately backed out and came back in and continued. I was able to build the entire pipeline.

      Obviously, this is not remotely ideal. BUT, if you have a complicated pipeline, it might save you the nightmare that I have been through of rebuilding over and over. Essentially, make small changes. And if its really complicated, copy it before you make any changes.

      Also, I can't import/export or it gives me the internal error.

      Overall, like you said I really want Pipelines to be good but it's pretty rocked with bugs right now to utilize it.



      ------------------------------
      Mike Tamoush
      ------------------------------
      • SherrieDrummond's avatar
        SherrieDrummond
        Qrew Member
        4 years ago
        I'm finding an ton of issues with my complex pipelines. Just wanted to pipe in (no pun intended) and put this at the top so that the powers that be can see it. I also have an issue where my pipeline runs for several days and then suddenly I end up with corrupted data in my tables. Very frustrating.

        ------------------------------
        Sherrie Drummond
        ------------------------------