Striker Tom Pope scored his tenth of the season but a late Yeovil equaliser meant Vale will have to win the replay to reach the third round.
Manager Neil Aspin made one change bringing in Michael Tonge for Marcus Harness. However, with three veterans in Tonge, Pugh and Kay in midfield, Tom Pope was left isolated too often upfront and a dire first-half saw few chances for either side.
Aspin made changes at the interval bringing on Anton Forrester and Tyler Denton. The changes sparked Vale into life and it was Denton who provided the breakthrough. The on-loan Leeds player’s cross found Pope who made no mistake to score his tenth goal of the season.
Vale had further changes for substitutes Denton and Forrester but to no avail. The Valiants were to rue not taking their chances when Jordan Green headed home on 89 minutes to secure a draw for the visitors.
It means that although Vale are in the draw for the third round they will have to win a tough away tie at Yeovil to progress.
Vale: Boot, Gibbons, Smith, Anderson, Gunning, Worrall (Harness), Montano (Forrester), Kay, Pugh (Denton), Tonge, Pope
Subs: Hornby, Turner, Reeves, Barnett