The color and disabled properties of Button let you control the emphasis of a button relative to its surroundings. For example, you can specify that a button should use the primary color value. The emphasis of a button is the cumulative result of the variant and color properties. You can adjust both until the button has the appropriate emphasis.
There is no right level of emphasis. Use what makes sense in the context of your application.