Ten-man Chester held on for a draw in the FA Cup second round after having two-goal Lee Steele sent off.
Substitute Steele gave Chester a 61st-minute lead with a low shot but Andy Bishop soon headed Bury level.
Richie Baker then drilled home a shot from 20 yards to put Bury ahead before Steele equalised from close range.
But Chester had to hang on for the last 16 minutes on 10 men after Steele was shown a red card for over-celebrating after jumping into the away stand.
Bury: Warrington, Scott, Fitzgerald, Challinor, Kennedy, Pugh, Mattis, Baker, Buchanan, Hurst (Speight 79), Bishop.
Subs Not Used: Woodthorpe, Youngs, Barry-Murphy, Adams.
Booked: Buchanan, Speight.
Goals: Bishop 66, Baker 69.
Chester: Danby, Westwood, Linwood, Artell, Stephen Vaughan, Hand, Martinez, Sandwith (Bennett 46), Wilson, Walters, Semple (Steele 46).
Subs Not Used: Bolland, Marples, Palethorpe.
Sent Off: Steele (74).
Booked: Wilson, Westwood, Steele, Martinez.
Goals: Steele 63, 73.
Att: 3,428.
Ref: K Woolmer (Kettering).