Remy's brace at Cardiff City Stadium took his tally to five goals in his last three games and he has made an instant impact since moving to St James' Park from QPR on a season-long loan.
Pardew had attempted to bring in Remy in January, but the France international eventually joined QPR's failed bid to avoid relegation to the Championship.
Rs' boss Harry Redknapp said earlier this week he would be happy to see Remy join the Magpies permanently at the end of the season and does not expect the forward to return to Loftus Road.
His current form may mean Pardew finds he has competition for his signature, but he made his appreciation of the player clear.
"I wish he had joined in January," he said.
"I still remember the night clearly when we thought we had done the deal.
"We had a nice glass of wine, gave ourselves a nice, hearty, warm handshake and the next day he wasn't there.
"But sometimes in life you have to wait. If you wait long enough it comes around.
"We are really pleased to have him, I thought he was excellent. Not just his two goals, but his work-rate and everything he did was competent.