"I remember coming here before with Liverpool and we won 6-0 and played very well," said Rodgers.
"We've come here today with equally as good a performance, not scored the goals, but certainly with the control in the game and the quality in our game, played very, very well.
"But we can play better. We will improve the longer we work together - because it's only been 10 months or so.
"The potential in the group really excites me, but we have to keep that consistency and that hunger to want to be better."
Newcastle remain in mid-table but their points cushion above the relegation zone is down to five.
There are no such concerns for Leicester, though, with this win keeping them in second, ahead of Manchester City.
It was also Leicester's seventh away Premier League win of the season - only unbeaten leaders Liverpool have managed more.