Gingko tree

Need information on how to lightly trim back a Gingko tree that is a bit too close to a structure. The tree is healthy but a small part of it is beginning to strike a wall which may eventually damage…