My pinky hurts from playing too much piano...should I stop or bear the pain?

Actually it's quite bearable, but my pinky and the little bit of flesh between my pinky and forearm hurts. I was practicing songs with octaves and chords. I think the reason might be because I havent played piano too much for a while now, and just started playing a bit more recently....iunno.