The Agreement Dissection - S4-E21
Continuity mistake: When the girls take Sheldon out dancing, he mentions that he considers himself a proficient dancer due to his Cotillion training when he was a boy. But in S1E7 The Dumpling Paradox, when Leonard suggests that they could have gone dancing with the girls, Sheldon said that nobody in the group - including him - could dance.
Answer: Because Raj's selective mutism seems to be caused by women that Raj sees (on some sort of conscious or subconscious level) as a potential sexual partner. An attribute that wouldn't apply to either his sister or mother.