They didn't use razors (didn't have the technology)... If I remember correctly from the school days they rubbed off their stubble with a pumice rock (lava rock).
How Did Romans Shave?