Newport took a deserved lead through Shane McLoughlin’s 11th-minute penalty before Hakeeb Adelakun levelled from the spot after the half-hour mark.
Paul Glatzel, Harry Smith and Kabongo Tshimanga scored from the 87th minute onwards as Tranmere finished with nine men.