All 120V electrical appliances in the USA are IEC Class 1 (basic insulation), or Class II (double insulation) like a plastic 1/4" drill housing.*
Per the International Electrotechnical Commission (IEC), "A safety ground is required for all Class I devices."
This requirement did not exist when Bob Carver/Phase Linear Corp. was designing amplifiers. These amps, from the "vintage" era, only have a simple two-prong plug. In that case you would try one way in the socket, then try the other, and use the one that gives you the least amount of hum. Later, amplifiers would have a polarized plug with one blade wider than the other. The wide one is the neutral side, and the narrow is the hot.
Look at any modern amplifier and you will see a three-prong plug.
If your grounded audio component (which is Class I) is making more measurable noise when it is safely Grounded (you can use a Ground defeat plug to check) it is not because the noise is inside the audio component. The noise is coming from outside the audio component.
If the noise is enough to make a difference, say 0.02% higher, then you need to eliminate the source of noise because it is also affecting other audio components that may or may not be safety Grounded.
Worst case scenario is a faulty power supply or loose Ground in an appliance that will eventually shock you or start a fire.
Best case is a noisy fluorescent ballast that is getting ready to fail.
If you want to find the noise, connect your measuring equipment to the device under test (DUT). and systematically turn off all lights, unplug all appliances, disconnect anything with a cord, or turn off circuit breakers - one at a time to locate the source of the noise.
You will likely find one or more devices that have a Grounding issue. The only other possibility is a noisy Ground coming from the electric company; they will come to your location for free to determine the cause because they know the importance and safety of a good ground. Often the copper wire running down the nearby power pole into the Earth has been broken.
A quick note on Ground Loops. Do not break a ground loop by defeating a 3-prong plug. This is only one side of the Ground Loop. The other side of the Ground Loop is the interconnect cable. To properly break the Ground Loop, ensure the interconnect cables shield is not connected to the chassis of at least one device. This is a little harder to do than snipping off the Ground Pin on your electrical plug, but it will not kill you.
* Class I - where user protection from electric shock is achieved through a combination of insulation and a protective earthing/ground.
Class II - where user protection from electric shock is achieved through two levels of insulation (either double or reinforced), without the need for earthing.
Class III - where the input is connected to a safety extra-low voltage (SELV) circuit meaning no further protection, such as earthing, is required.