What about abstract intelligence and creativity, which the IQ test doesn't properly gauge? You might also consider emotional intelligence (EQ) tests, which are a fairly recent invention. There may not be many women who are math geniuses, but I have seen many master female artists and writers. I think that creativity is also a type of intelligence.
Androgens and a complicated mix of hundreds of other hormones might play a big role in the way men and women use their brains. If you were to alter a man or woman's hormonal chemistry to resemble that of the opposite sex, you'd notice a big difference in their thoughts and behavior. A real test would be to see: do women given levels of androgenic hormones equivalent to a typical male (i.e. transsexuals) see an improvement in IQ? Do they see improved math skills? And how about a biological male who receives high doses of estrogen/androgen-blockers?
Another point, possibly related, is that men have more seratonin receptors in their brain than women. Also consider that men don't experience menstrual cycles. Women are sensitive to fluctuating estrogen levels, which affects seratonin receptors in the brain. Thus, it's common for women to suffer hormonal mood swings and bouts of depression, all which affects thought.
I think the proper conditions for intelligence come from an ideal chemical balance in the entire body, a peak of health so to speak. This balance is probably more natural in men, because they do not have menstrual cycles. For women, I think that hormonal changes drain mental clarity and confidence, and this may be part of the reason why women do more poorly on tests which require a stable concentration. But, I also think that problem might be corrected to an extent with healthy diet and exercise.
Another thing to think about is be the ways that men and women use their brains. The different areas of our brain can only become developed if we use them.