England finally ended their penalties curse when they beat Colombia 4-3 in a shootout after drawing their World Cup last-16 clash 1-1 following extra time after the South Americans equalised in the 93rd minute.
England had previously lost all three World Cup shootouts and three of four in the European Championship but prevailed on Tuesday when Mateus Uribe and Carlos Bacca failed to convert, leaving Eric Dier to win the game for England.
It was the first time Colombia had been involved in a World Cup shootout and they took first blood when Jordan Henderson missed his spot kick - but for once fortune smiled on England.
Earlier Harry Kane smashed in a 57th-minute penalty, his sixth goal of the tournament, and England looked to be through until Yerry Mina headed an equaliser in the third minute of stoppage time.
It was England's first win in a knockout game since 2006 and earns them a quarter-final with Sweden, who were far from impressive in beating Switzerland 1-0 earlier on Tuesday.
Then comes a potential semi-final against hosts Russia or Croatia with Tuesday's win appearing to vindicate - just - coach Gareth Southgate's decision to field a second-string side in the the final group game loss to Belgium to secure an easier route.
Colombia's hopes suffered a huge setback before kickoff when key playmaker James Rodriguez was ruled out with a calf injury and without him they took a defensive approach and never rarely threatened.
England were always the more purposeful side but they lacked the key final ball and needed a gift to take the lead.
The South Americans had been getting away with blatant holding and wrestling at each of England's many corners and the referee's patience finally snapped when Carlos Sanchez hauled down tournament leading scorer Kane once too often.
After four minutes of mayhem as the Colombians protested, Kane kept his cool and smashed in his third spot kick of Russia 2018.
When Juan Cuadrado blazed horribly over the bar with the goal gaping 10 minutes from time with Colombia's first chance of the match it looked all over for them but there was a fiery sting in the tail of normal time.
England keeper Jordan Pickford made a superb save to touch wide a furious long shot by Uribe but from the following corner - Colombia's first of the match - giant defender Mina rose highest to head in the equaliser and send the massed Colombian fans into a frenzy.
England substitute Dier missed the best chance of the extra period when he headed over the bar but he made up for it in emphatic fashion with the winning penalty in the shootout.
PENALTY SCOREBOARD: COLOMBIA 3-4 ENGLAND
* Eric Dier scored for England
* Carlos Bacca's shot saved by England's Jordan Pickford
* Kieran Trippier scored for England
* Mateus Uribe hit the England crossbar
* Jordan Henderson's shot saved by Colombia keeper David Ospina
* Luis Muriel scored for Colombia
* Marcus Rashford scored for England
* Juan Cuadrado scored for Colombia
* Harry Kane scored for England
* Colombia to shoot first - Radamel Falcao scored
* It's time for penalty shoot-out in Moscow
End of Extra-time: It's still 1-1. Shoot-out to decide the tie now
It's the first occasion in the World Cups that three Round of 16 matches will be decided by penalties
120' - One minute added as stoppage time
119' - Colombia keeper David Ospina punched it away. Danny Rose with a long cross-in from a set piece
118' - Yellow Card! Colombia's Juan Cuadrado booked for a foul on Danny Rose
117' - Colombia's Radamel Falcao shouted for a corner but ref pointed for a goal kick for England
116' - Substitution! Santiago Arias is replaced by Cristian Zapata for Colombia
114' - Corner for England. Eric Dier headed it over the Colombia crossbar from close range. Chance missed.
113' - Substitution! Change for England: Kyle Walker is replaced by Marcus Rashford
112' - Dany Rose's cross across the Colombia goal went just wide
111' - Throw in for England on the left flank of Colombia box. Danny Rose with the throw as England lurked around Colombia area
108' - Jordan Pickford had to rush out of the England box to clear the ball away with Falcao in front of him
106' - Jamie Vardy was caught off-side inside the Colombia penalty box
Second half of ET underway...
First half of ET ends: It's 1-1 between Colombia and England in Moscow
105' - One minute added as stoppage time
104' - Radamel Falcao headed it wide from close range. Colombia the better side so far in the extra time
102' - Substitution! Ashley Young is replaced by Danny Rose for England
101' - Corner for Colombia. This time Yerry Mina headed it wide of England goal
98' - Carlos Bacca shot the ball into the net, but the whistled was already blown to fetch out an extra ball from the middle
95' - Jordan Pickford collected the ball from a Colombia cross-in. Johan Mojica with a low cross-in from the left
End of second half: It's 1-1 after regulation time. Extra-time to follow now
Colombia's Yerry Mina scored a dramatic equaliser against England in injury-time just as it seemed the South Americans were heading out of the World Cup at the last-16 stage. Harry Kane scored a second-half penalty to put England into the lead but they could not hold on and Mina headed in from a corner in the 93rd minute.
90+3' - GOAL! Yerry Mina scored the equaliser for Colombia
Young Yerry Mina jumped high to head in the ball into the net and kept Colombia alive in the contest.
90+3' - SAVE! Jordan Pickford made a diving save. Corner for Colombia
90+1' - Jordan Henderson took some time to stand up after a foul on him
90' - Five minutes added as stoppage time
88' - Substitution! Raheem Sterling is replaced by Jamie Vardy for England
88' - Substitution! Colombia with another change: Juan Fernando Quintero is replaced by Luis Muriel
87' - This time Radamel Falcao's low shot from the edge of the England box went straight to Jordan Pickford
86' - Colombia captain Radamel Falcao failed to connect it properly and headed it wide. Good cross-in from the left flank by Juan Cuadrado
84' - Harry Maguire again headed it over the Colombia crossbar after receiving a Kieran Trippier delivery from a free-kick
81' - MISSED! Juan Fernando Quintero shot it over the England crossbar from the right top of the box. Colombia got the opportunity after Kyle Walker's blunder in the England final third
80' - Substitution! First change for England: Dele Alli is replaced by Eric Dier
79' - Substitution! Carlos Sanchez is replaced by Mateus Uribe for Colombia
77' - Shout for a penalty by England after Jesse Lingard was brought down inside the Colombia box. Ref not intereted
75' - Ashley Young's cross-in from a free-kick was too long for Harry Kane, who was also caught off-side
73' - Jesse Lingard's shot was blocked out for an England corner. Harry Maguire headed it over the Colombia crossbar after jumping high to connect Ashley Young's delivery
69' - Yellow Card! England's Jesse Lingard is booked for a foul on Carlos Sanchez
67' - England's Ashley Young is down near the Colombia box. Medical attention for the veteran
64' - Yellow Card! Another Colombian booked now - Substitute Carlos Bacca cautioned for a foul on John Stones
63' - Yellow Card! Colombia's Radamel Falcao is booked now
61' - Substitution! Colombia made a change: Jefferson Lerma is replaced by Carlos Bacca
57' - GOAL! Harry Kane put England in the lead
Harry Kane converted the spot kick for his sixth goal of the tournament. England in the lead now just nefore the hour mark
56' - Yellow Card! England midfielder Jordan Henderson is booked for unnecessarily arguing with Colombian players
54' - PENALTY for England. And it's a Yellow Card for Colombia's Carlos Sanchez for holding down Harry Kane inside the box
53' - Ashley Young's cross-in from the set piece was headed out for an England corner
52' - Yellow Card! Colombia's Santiago Arias booked for a foul on Harry Kane
50' - Dele Alli down outside the Colombia box, ref says move on. No foul
47' - A slow start to the second half. Ball roaming around the half line
Second half underway...
HT - It's goalless between Colombia and England at the halftime break
Colombia were holding England 0-0 at halftime. The tournament's leading scorer Harry Kane came close to adding to his five goals for England at the finals in Russia but his 16th minute header at the far post flew over the bar as his side had Colombia on the back foot for much of the half.
45+3' - And on the other end, Jesse Lingard volleyed it over the Colombia crossbar from the top of the box
45+2' - Juan Fernando Quintero's weak attempt from the edge of England box was straight to keeper Jordan Pickford
45' - Three minutes added as stoppage time
45' - Harry Kane tried a long ranger from outside the Colombia box, went well wide of the goal
42' - Kieran Trippier shot it just wide of near post from the set piece
41' - Yellow Card! Colombia's Wilmar Barrios booked for a tussle during the making of wall for England freekick. Will miss next game if they progress
38' - Free-kick for England from a dangerous position on the left top of the Colombia box. For a foul on Harry Kane
35' - Juan Fernando Quintero's through pass into the England box was cleared out by John Stones
33' - Juan Fernando Quintero's effort from distance went wide of England goal
30' - Free-kick for Colombia in their own half after a foul on Radamel Falcao
28' - Kieran Trippier's delivery from the corner was headed out to safety by Colombia. Kyle Walker then denied Colombia a counter run with quick back pass to keeper Jordan Pickford
27' - Ashley Young's delivery was headed out. Corner for England
26' - Free-kick for England after Dele Alli was brought down in the Colombian half
22' - Johan Mojica's long ranger went well over the England crossbar. A decent move by Colombia into the England final third
20' - Kieran Trippier lost the possession near the top of Colombia box after a good build-up by England
16' - OVER! Harry Kane headed it just over the Colombia crossbar from a tight angle. Good across pass from Kieran Trippier from the right
13' - Raheem Sterling's shot from the edge of Colombia box was blocked out
10' - England won another corner. It ended with a free-kick for Colombia inside their penalty area for a foul.
8' - Second corner for England. Kieran Trippier's delivery was headed out by Yerry Mina
7' - Corner for England. No problem for Colombia keeper David Ospina, collected the ball calmly
6' - Ashley Young's shot from the set piece was punched out by Colombia goalkeeper David Ospina
5' - Free-kick for England near the Colombia box on the right flank
3' - England with early possession, but no incursion into the opponent's penalty area yet
Here we go... KICK-OFF TIME
* Colombia have never beaten England before. Will they create history tonight?
*Time for National Anthems*
Colombia (4-2-3-1): David Ospina; Santiago Arias, Davinson Sanchez, Yerry Mina, Johan Mojica; Wilmar Barrios, Carlos Sanchez; Juan Cuadrado, Juan Fernando Quintero, Jefferson Lerma; Radamel Falcao (capt). Coach: Jose Pekerman (ARG)
England (3-5-2): Jordan Pickford; Kyle Walker, Harry Maguire, John Stones; Kieran Trippier, Ashley Young, Jordan Henderson, Jesse Lingard, Dele Alli; Raheem Sterling, Harry Kane (capt). Coach: Gareth Southgate (ENG)
Referee: Mark Geiger (USA)
James Rodriguez will not start for Colombia against England in the round of 16 because of a calf muscle injury. The attacking midfielder went off hurt in Colombia's 1-0 win over Senegal in the group stage, although coach Jose Pekerman indicated that Rodriguez could be fit to take on England. The more defensive Jefferson Lerma starts in his place. The only other change for Colombia from the starting lineup which beat Senegal to qualify for the knockout stages is Mateus Uribe being replaced by the more defensive Wilmar Barrios in the center of midfield.
Dele Alli is back in England's lineup after missing two games with injury. The Tottenham midfielder returns as coach Gareth Southgate reverts to the lineup which beat Tunisia 2-1 in England's opening group game. Southgate has made eight changes to the lineup that lost the last group game to Belgium. Midfielder Fabian Delph is skipping the game because he has traveled home to England to be with his wife for the birth of the couple's baby.
The winner of the Colombia-England game will advance to a quarterfinal match against Sweden.