This goal could have easily seen Arsenal out, but signs of the positive changes Unai Emery has made began to show through.
Here's how the players rated in an entertaining encounter at the Emirates. By the beginning of September, he'd worked his way back into the starting XI, which coincided with a remarkable run of form that saw the club win 14 of 15 matches in all competitions coming into their game with Liverpool.
Milner scored what was Liverpool's only goal of the game with a well-taken effort to beat Bernd Leno in the Arsenal goal.
Virgil van Dijk was unmarked in the box as he controlled the ball from Mohamed Salah's cross into the box. But when it came to the decisive ball, the Spaniard had little luck with Liverpool defending well.
It wasn't Leno's first misjudgment.
Mane also refused to criticise the officials after he had a goal disallowed for offside during the first half at the Emirates Stadium.
"Milly is like wine, a very good red one".
"Under Emery, they have won more points from losing positions than any other team, so the fans stay with the players".
At the other end of the pitch, Henrikh Mkhitaryan nearly put the hosts 1-0 up, with the Armenian's header drifting just wide. However, the Armenian was otherwise wasteful in attack, making the wrong decisions when Liverpool were there to be attacked. Really needed to do better once Arsenal went behind.
Klopp acknowledged the courage in Emery's style when he said: "Arsenal did this before this year when they pretty much brought on all of their strikers". Despite looking the stronger side, though, the Gunners were wasteful in front of goal, failing to make good on their advantage.
Danny Welbeck (for Kolasinac 81) - 5 - His presence gave Liverpool defenders something to think about. Alisson forced him wide, but Lacazette was able to turn and, having worked the ball onto his right foot, curled a shot into the far corner.
But Lacazette provided the equaliser for Arsenal on 81 minutes.
"There is no point putting more pressure on ourselves".
Joe Gomez - 7 - Looked his usual confident self throughout, forming an nearly unstoppable partnership alongside Van Dijk. Liverpool tried a 4-3-3 in the first half and a 4-2-3-1 in the second, but in both it struggled to impose itself, hampered perhaps by the absence of either Jordan Henderson or Naby Keita (or both) in midfield.