One last idea I haven't seen mentioned yet is simply wrapping safety wire around the pickup tube, and tying it off tight to the body of the pump. In my old aircraft mechanic days, we used safety wire on everything. I saw the opportunity with the Pontiac oil pump pickup years ago, and have done it a few times since with no issues.
Wrap the wire tight around the outlet tube right next to where it presses into the pump body, pull it taught around the body of the pump a couple turns, and then twist the safety wire tight. Even though the wire may have a little 'give' over time, it won't give enough to allow the pickup to come out of the pump. Haven't seen this method fail yet, and requires minimal effort and zero cost for the piece of mind. Probably the simplest 'fix' I've seen too.
In lieu of welding or drilling/tapping/screw install, just another idea that has been successful for me.
Hope that helps.
__________________
Eric Mitten
'74 Bonneville 4dr Sedan (455/TH400/2.93 open)
'72 LeMans GT (455/M-13/3.23 [8.5"] posi)
'71 GTO Hardtop (400/TH400/3.07 12 bolt posi)
‘71 GTO Convertible (455HO/TH400/3.23 posi)
'67 GTO Coupe (455/ST-10/2.93 posi)
Deuteronomy 8:3