You must have messed with the fuel sending unit when installing the fuel pump.
The fuel sending unit is in the gas tank and from your description I suspect when you installed the fuel pump it wasn't installed in the proper orientation and the float is hanging up on the bracket or wiring.
You need to drop the tank again and inspect.
A forum community dedicated to Ford Mustang owners and enthusiasts. Come join the discussion about performance, production numbers, VIN decoders, modifications, troubleshooting, power adders, DIY tutorials, and more!