Pipelines recently very very slow?

The My Pipelines page does take longer to load than I would expect, but I'm not sure if it's become slower. Perhaps the inclusion of error stats has slowed it.

The performance of pipelines in general is also slower than I would expect and makes it difficult/impossible to rely on them to run in a reasonable time. It would be great if they could be used to perform 'back end processing' (i.e. responding to user actions and presenting updated information back to the user) but I guess this isn't their intended purpose.

------------------------------
Jeremy Anson
------------------------------

How many pipelines do you have in total? Loading into our main account for pipelines I would say it takes a good 15 seconds for everything to fully load. But we only have 30 pipelines and not all of them are running.

Hi Everyone,

In the last week we saw an uptick in performance pain and performance cases around Pipelines and wanted to provide some information here in this thread. It can absolutely be frustrating to have your automated workflows delayed and it is something Quickbase takes very seriously when we get that feedback and see cases of customers in pain. Over the last 12 months the usage of Pipelines has grown by over 5,000%, which is great cause it means we have opportunity to pour even more innovation and enhancement into it but has come with some growing pains. The good news I wanted to pass on is that, as we speak, our Product team is working on several major enhancements to increase the performance & execution of Pipelines.

The biggest improvement is focused on moving all customers to a new behind-the-scenes engine (named "Blaze Engine") that processes the rules and logic of each Pipeline up to 5x faster. We expect to have this new engine rolled out to all customers by our September 2021 product release. For those of you who are still having performance pains right now if you haven't submitted a case yet with our Care team we do recommend you do so as they can look at your specific experience and ideally provide you some steps to help with making your experience better today. There are often things we can do today to help alleviate slowness.

For those of you working with Pipelines and looking for a little help on Best Practices to set them up with an eye to performance we do have some resources available when building Pipelines, especially when building Loops or handling lots of records in bulk. We recommend reviewing our free on-demand video content from Empower 2021 about Optimizing your Pipelines (9 minutes) and Troubleshooting your Pipelines (40 minutes). When you're trying to do bulk-record operations (something to more than 100 records), you should make sure you use these 4 steps, in this order: 

 A. Prepare Bulk Upsert, B. Search Rows, C. Add Row to Bulk Upsert, and D. Commit Upsert

This optimizes for the best performance and we are working up a guide that will go over setting this up in more depth right now. Many of these Best Practices will also appear on the "Pipelines Certification" we are launching later this year... We hope this information helps you, and we look forward to continuing to improve your Quickbase experience each and every day. I want to thank everyone for sharing their experience and being open with your frustrations. We want to make sure we can handle not just this massive growth but another 5,000% increase and that is only possible by hearing your feedback and incorporating it into our plans.

------------------------------
Evan Martinez
Community Marketing Manager
Quickbase
------------------------------