Is there a way to consolidate multiple URL buttons into one button, but use the link text/color of each individual button

I currently have 4 different buttons that do 4 different things (and am about to add more).
To avoid having users click the wrong button inadvertently, they only show on certain records depending on the record type.

Since I'm about to add more buttons, I'd like to see if there is a way to consolidate all of these buttons into one.

I need the button to show the action (label of the original button)

I thought if I added an IF statement to a Rich Text field that displayed the appropriate button that would solve my issue, but it only displays the text of the button, not the button itself.

Three of the different buttons:


What the Rich Text formula returns (apologies for the redaction):


The formula is working, by pasting the correct button ... it just pastes the formula behind the button and not the button itself.

I figured if I do this on a URL field, it will work ... but I will then only be able to display the text of that field, and not the individual fields that are being referenced.

Below is an example of it working, but only with the text of that assigned button: