It sounds like you have at least one bad connection somewhere, but you probably guessed that yourself. (mechanics.stackexchange.com)
No lag was evident whilst charging and the connections on each end have a solid feel to them with no evidence of bad connections on either controller or console. (xboxoneuk.com)
While talking about the call quality, it was quite good; I didn't experience bad connection, even when I was talking with Bluetooth paired headphones. (phoneradar.com)