Mystery berries

We stopped over at the post office in Mount Joy the other day, noticed these plants and realized we have no idea what we found:

Before the brash, gaudy orange parts push through, this is what the berries look like - pale, demure, blush pink....
And then, the orange part pokes out ... Here's a close up.

And even closer!
If you know what these are, I'd love to know!