Is this the oxygen cylinder you're talking about?
That is super expensive for what you get ($9.97 for 1.4 they say oz, but I think they mean cubic feet) and it probably would not last you very long.
I would suggest you find a welding shop and see about renting a K tank. And yes, you will need an oxygen regulator. It has to be a regulator specifically for oxygen.