Combine now all the layers composing the button in a group. Copy this created group three times and place everything the way it is done below: Change the colors on different ones in the groups’ layers for each of the button.
The yellow button The lowest layer Blending Options-Gradient Overlay