Caveman

A caveman was a being who inhabited a cave, often associated with primitive cultures.

The Tol people of the planet Neesan lived in caves. 

The inhabitants of an unnamed asteroid lived in caves.