I learned early in my college dendrology class that there is wide variation in the appearance of trees (as with humans). My professor had ever weird specimen in the county on our tests. Since the class was given in the fall semester leaves were soon on the ground and bark, branching, buds and overall appearance became the best (and only clues).
Just be glad that you are not trying to ID oaks.