The 27-year-old is now England's chief set-piece operator and last season for Spurs he chipped in with nine assists, something that highlights how much of an attacking threat he can be.
After the final score remained 1-1, even after extra time, it took a tense penalty shootout to decide the clash.
There was controversy in the first 45 minutes when Colombian midfielder Wilmar Barrios only got a yellow card after a VAR review, having headbutted England's Jordan Henderson in the penalty area.
England will play Sweden at 2am Sunday in their quarter-final match.
The last time England played in a World Cup quarter-final was in 2006 against Portugal.
Skipper Harry Kane, Kieran Trippier, Marcus Rashford and Eric Dier successfully converted from the spot to book a place in the next round, continuing England's thrilling Russian adventure.
He said: "At full time I was telling people around me, "Yes we are going to win on penalties" - I didn't believe it".
The Everton man saved a kick in the shootout to hand the English side a ticket to the last eight of the competition in Russian Federation.
"It looks like it is great fun, they are all playing for each other, with freedom and that is the greatest compliment I could give them".
You could see the concentration on his face after Pickford had made the stunning save - Dier knew he had a job to finish. "I don't care if I'm not the biggest 'keeper because it's about being there in the moment and making the save and I was". "I have the power and agility".
"To get knocked down like we did, it's hard to come back from that, but we were ready, we stayed calm, stuck to our plan and never panicked".
"We showed resilience to come back from huge disappointment and kept calm".