Why is it called berry?

I'm curious about the origin of the name 'berry'. I want to know why it's called that, what's the story or reason behind this name. Is it because of its shape, color, taste, or some other characteristic? I'd like to understand the etymology of 'berry'.