Yeah, the way Mute works is going to be confusing if you're not coming from an EDP background. It's not like the Mute button on a recording console. It obeys Quantize so you can turn it on and off in sync with the loop you're working on, and it has some performance options around what happens when you Unmute, and situations where tracks will be automatically Unmuted without asking.
Solo behavior wasn't derived from the EDP. It was intended to work more like a recording console, it isn't quantized, and you have to manually turn it on and off.
To get Mute to behave in the simplest possible way, do this:
First disable Mute quantization. This is a new feature added in build 42 so you'll need to be on that. From the Configuration menu select Options. In the large ugly table find the row with Mute in the Name column, right click on it and select Edit. A little form should pop up, for the Quantize field select Off, and click Save. Click Save at the bottom of the Options window to close it.
Next, go to Sessions->Edit. Click the Default Parameters tab. In the tree on the left click on the Functions category. In the form on the right find the field labeled Mute Mode. Make sure that is set to Continue. In the same form find Mute Cancel and set it to Never, I believe those are the default values so if you've never messed around with mute parameters they should already have those values.
I've thought about adding another function like SimpleMute or ConsoleMute, or OutputOff that just has the effect of turning the output level down to zero then back up again which is mostly what Mute does. But without all the extra performance options that Mute has. You should be able to get there with the settings I outlined above, but then you can't use EDP-style Mute and you could want both in different situations.