This paper reports an experimental study of the System Fidelity Factor (SFF) of UWB-WBAN antennas in an on-body environment. This study also investigates the influence in the SFF due to the antenna polarization with respect to the body. For this purpose, two antennas having different polarizations are compared: a mono-cone antenna with the polarization perpendicular to the wearer and a printed monopole with the polarization either parallel or perpendicular to the wearer. A phantom made of pork meat was considered as a model for the wearer’s body, and five different communication scenarios involving each pair of antennas were considered. On-body experimental results show that the time domain behaviour of the transmission is better for two different antenna types having the same polarization but, more importantly, that the SFF (and thus the time domain fidelity of the signal) is better for a link having a polarization perpendicular to the body.