Plot hole: After Kara and Alex are run off the road, Kara is convinced by "Noel Neill", revealed later to be J'onn, to stop using her powers. From context, J'onn had to have been summoned by Eliza, but in 2007, she would still think he's just Hank Henshaw; she doesn't learn he's not, or even that he's a shapeshifter, until 2016, as seen in season 1's "Myriad", well after Kara and Alex have grown up.
Plot hole: After Barry and Kara slow time everyone is slow, even Superman, but Oliver could move fast enough to shoot an arrow.
Answer: Yes, s02e22. As Kara leaves her office, she said "go get them, Supergirl" to herself. After season 1, the show switched from a CBS production to a CW production and filming moved from L.A. to Vancouver. Flockhart isn't really a fan of traveling to shoot, and didn't want to be away from her family for so long.
Bishop73