Blue Square Conference South club Havant and Waterlooville beat Swansea 4-2 to make sure of a dream trip to Anfield on January 26 in the fourth round of the FA Cup.
Richard Paquette, Jamie Collins and Rocky Baptiste gave the Hampshire side a three-goal lead, before Guillem Bauza pulled a goal back for the League One leaders in the 39th minute.
Jason Scotland made it 3-2 - but Tom Jordan's 65th-minute goal made sure of victory for Havant and Waterlooville.
New Newcastle boss Kevin Keegan watched the Magpies beat Stoke 4-1 at St James' Park to set up a fourth-round trip to Arsenal.
Michael Owen and Claudio Cacapa gave the hosts a two-goal lead, with James Milner and Damien Duff finishing off the Coca-Cola Championship side in the second half.
However, former Sunderland striker Liam Lawrence had the last word, denying Shay Given a clean sheet with a goal a minute from time.
Manchester City will travel to Sheffield United in the fourth round after beating West Ham with a 73rd-minute goal from Brazilian midfielder Elano.
And Hereford set up a fourth-round tie at home to Cardiff with a 1-0 victory over Tranmere at Edgar Street, with Simon Johnson scoring in the 72nd minute.