Are the leaves rough on top? 

CLUE: mature fruit (on the female tree) is red to dark purple. 

It is a red mulberry.

Are the leaves smooth and glossy on top? 

CLUE: mature fruit (on the female tree) is white, pink or purple. 

It is a white mulberry.