it only matters for special battles i think, certainly has no bearing on normal matchmaking.
I understand there is a special skill which means your male (or female) recieves a damage bonus if they face the opposite sex. Maybe there is one along the same principle for allignment.