Micky Adams named an unchanged starting eleven but Gareth Owen and Rob Taylor returned to the squad and were both named on the bench.
And Vale got off to a dream start as Morsy scored after just 14 seconds. It was his third senior goal for the Valiants.
Vale were largely on top after that early strike but were unable to add to their lead. And the home side made them pay when they equalised on the half-hour mark. Kevin Ellison got past Doug Loft and managed to fire home past Neal.
Vale could have regained the lead early in the second half, but Barry Roche pulled off a fine save from Vincent’s effort.
Vale brought on Rob Taylor for his first appearance of the season and Darren Murphy for his Football League debut as both sides tried to find the crucial second goal.
And with two minutes to go, Morsy’s free-kick was deflected over and from the resulting corner-kick, defender McCombe netted with a header for his first goal of the season.
And Vale wrapped it up in injury time as Vincent and Pope broke clear. Vincent hit the post but Pope was on hand to score his second league goal of the season and secure a welcome three points.
Vale: Neal, Duffy, McCombe, McDonald, Loft, Myrie-Williams (Taylor), Morsy, Shuker (Murphy), Vincent, Pope, Dodds (Williamson)
Subs: Johnson, Owen, Lloyd, Davis