When you leave the music screen the music continues to play. How do you stop it? All I see is "pause".
You push the home button. Sometimes it takes two taps.
This does not stop the music from playing.
I'm assuming you're using the Google Play Music app? If so, slide the notification bar down and press the button that has two bars on it (what you're referring to as the Pause button).