If the 4.5" refers to the OD of the pipe, then these people (and many other industrial pipe & fitting suppliers) have them:
https://www.valvestubesfittings.com/welding-pipe-fittings/butt-weld-fittings-bs1965-en10253/en-10253-butt-weld-45-degree-elbows-long-radius
They will be in carbon steel (or stainless, if you are feeling affluent), so ensure that you have a suitable weld procedure for welding the elbow to the pipe!
Chris G
ETA Confusion may be caused because many pipe fittings are specified by the Nominal Bore of the pipe, not its OD.