I don't remember what show it was, but it was estimated that they might live to about 30, maybe a little more than that, since they lived such hard lives. Colds, injuries, infections, all sorts of reasons. Hope this helps.
How Long Did Cavemen Live For?
3.5 million years ago is when their race was extinct.