Plot hole: In the middle of chasing the Doctor, Stor abandons the idea of controlling Gallifrey in favour of destroying it for no readily apparent reason.
Plot hole: Leela's decision to stay with Andred is very sudden. They barely speak during the serial.
Answer: It was never destroyed on-screen; it was intact at the end of the TV movie, and destroyed by the start of the 2005 series. It was destroyed in the novel "The Ancestor Cell," but in a completely different manner to what happened in the series.
DaveJB