Ostrya virginiana

Ironwood or eastern hop-hornbeam

http://www.uwgb.edu/BIODIVERSITY/herbarium/trees/ostvir01.htm

Might be a good native understory tree for the garden.