Matt
I know what you mean about the cost of all the kit you need to maintain a straight razor once you have one. Once acquired though you shouldn't ever need to buy replacements if cared for.
I'm new to the straight razor myself and it is a skill that I do not possess yet. Putting an extremely sharp blade to your face is a bit

, I haven't sliced off any facial parts yet though.
Get yourself a razor and strop, then get the other bits and pieces as you go along, it aint cheap but it is fun learning a new skill.
Also in these days of concerns about non-sustainable resources, straight razors are kinder to the planet

(climbs down off soapbox)