Newcastle took with lead with 28 minutes gone when Yoan Gouffran reacted first to Mike Williamson's knock-down to round keeper Paulo Gazzaniga and slide the ball into the empty net for his fourth goal in as many games at St James' Park.
But the Magpies failed to build upon their lead and with the Saints a much more dangerous proposition after the half-time introduction of Adam Lallana, they drew level with 25 minutes remaining.
Jay Rodriguez exchanged passes with Steven Davis, who had hit the post seconds earlier, before coolly beating Tim Krul.
Both sides went for a winner as time ran down but in a stormy conclusion, referee Mike Jones was left with a bloody nose after being caught accidentally by Magpies midfielder Moussa Sissoko.
Alan Pardew: "The ref has got a bloody nose, he is trying to patch himself up for the Christmas party.
"But he took it in good heart, really, I have to say. He realised it was a little bit of a flick out at the goalie, who had flicked out at him [Sissoko].
"It was all a bit silly, but unfortunately he ended up with a bloody nose."
However, Pardew was left ruing two glaring misses by striker Loic Remy, who has now gone four games without a goal.
He said: "We had two big chances today that fell to Loic.
"I felt he played well today but those two chances, I expect him to take and that can be the difference in a game that is as tight as that.
"It probably cost us today."