How do I change a custom color

Once you have selected a custom color from the Color control in Graph Properties, the only way to change that color is to right-click the color control itself.

You can then choose Custom color… and change the currently used color from the Color dialog box.

See the RGB color table for a list of the RGB values for some typical colors.