Veteran Dean Windass cashed in on a rebound to put Hull ahead after three minutes, but David Norris was quickly on the mark for Plymouth's equaliser.
Rory Fallon's header in first-half injury time put Plymouth in front.
Dean Marney restored equality again after 49 minutes, scoring after Romain Larrieu saved Windass's penalty, but Ebanks-Blake had the last word.
Plymouth manager Ian Holloway:
"I don't like conceding goals and the first goal was copybook. But it was terrific we managed to go in at half-time 2-1 up. "But then we committed hari-kiri - no way should anyone of their players get
to the rebound first.
"You're only as good as your attitude but I thought our attitude was spot on -
that's what I love about my players."
Hull: Myhill, Ricketts, Coles, Delaney, Dawson, Marney, Ashbee, Hughes (Livermore 64), Garcia, Windass (Bridges 79), Barmby (McPhee 72).
Subs Not Used: Duke, Turner.
Booked: Barmby, Delaney, Windass.
Goals: Windass 3, Marney 49.
Plymouth: Larrieu, Connolly, Doumbe, Seip, Sawyer, Halmosi (Hodges 90), Norris, Nalis, Buzsaky, Hayles (Ebanks-Blake 75), Fallon (Chadwick 79).
Subs Not Used: McCormick, Timar.
Booked: Halmosi.
Goals: Norris 15, Fallon 45, Ebanks-Blake 81.
Att: 16,633.
Ref: G Laws (Tyne & Wear).
Bookmark with:
What are these?