In more detail
A z of 2 gives a two-sided p of 0.0455 and a z of 1.96 gives 0.05, the usual threshold. A small p suggests the data are unlikely under "no effect" but says nothing about the size or importance of the effect.
A p-value is the probability of seeing results at least as extreme as yours if there were really no effect; it is not the probability the result is true.
Last reviewed:
A z of 2 gives a two-sided p of 0.0455 and a z of 1.96 gives 0.05, the usual threshold. A small p suggests the data are unlikely under "no effect" but says nothing about the size or importance of the effect.