Matty McNeil and Matty McGinn both scored twice as Southport triumphed in a thrilling game at Kidderminster.
Harriers took the lead through Michael Briscoe but the visitors drew level from McNeil's superb volley.
The forward then headed in his second for Southport but Nick Wright rifled in to level the scores.
McGinn drilled home before adding a penalty given for a handball by Briscoe, meaning Marc Williams' header was a mere consolation for Harriers.
Kidderminster manager Steve Burr told BBC Hereford and Worcester: "I thought they [Southport] might have come with a 4-5-1 formation from the reports that we had got back.
"But like us they lined up with a 4-4-2 and I thought they had the better of the second half in which they put us under a lot of pressure.
"Overall I was pleased that the lads kept going and the lads showed a lot of resilience as Saturday took a lot out of us but there are no excuses but I felt tonight we looked quite strong."
Southport manager Liam Watson told BBC Radio Merseyside:
"We could have come here after not getting a point on Saturday and gone a goal down and started to feel sorry for ourselves.
"But we had to get something tonight.
"If I had been offered a point at the start of the game I'd have probably taken it.
"So to come away having scored four goals is brilliant."
Kidderminster: Lewis, Shaw, Briscoe, Albrighton, Mike Williams, Hankin (Marc Williams 68), Byrne, Briggs, Gittings (Blair 75), Wright, McPhee. Subs Not Used: Stevens, Griffiths, Sharpe.
Bookmark with:
What are these?