Conference strugglers Tamworth booked their place in the third round with a 2-1 victory over League One Hartlepool.
Mark Cooper's side provided the biggest shock of the day by taking a 2-0 lead and holding off the home side's comeback at the Victoria Ground.
Jake Edwards converted Kyle Storer's cross after 33 minutes to put the Lambs in front. Soon after the restart, Matt Redmile headed in a cross from on-loan Birmingham City winger Carl Motteram to make it 2-0 and despite Chris Llewellyn's 51st-minute penalty after Edwards' foul, the Lambs held on for a famous victory.
League Two Chester heaped more misery on League One visitors Nottingham Forest with a 3-0 win at the Deva Stadium.
A crude foul by Gary Holt on Ryan Lowe handed Keith Curle's side a penalty after 38 minutes which saw the Forest defender sent off. Lowe got up to place the penalty and put his side ahead. Lowe made it 2-0 less than five minutes into the second half and Marcus Richardson completed Forest's humiliation.
Hereford's hopes ended abruptly as they lost 2-0 to Stockport and Cheltenham and Oxford will contest a replay after a 1-1 draw. Steve Guinan put Cheltenham ahead before Eric Sabin's equaliser.
Burton's home tie with Burscough was postponed due to a waterlogged pitch while Aston Villa's Carling Cup conquerors, Doncaster, beat Boston 2-1 at York Street.
Defender Dave Mulligan scored a goal in each half for Rovers to set up a tie away to Port Vale or Bristol Rovers in the next round.