Figured I would share the solution in case someone else have a similar problem.
The solution was to use Quick Base Action. I set it up so that a new record is created whenever a current record is modified and the calculated Adjustment is not equal to blank (plus a few other conditions that were specific to our situation).
By using Quick Base Action I could have another record created and populate the fields that we use to summarize by in the Summary Reports.
Quick Base Action offers a ton of great functionality so if you haven't checked it out yet I strongly suggest you do!
Best,
Freddy
