nannyberry shoots

Am getting rid of a nannyberry. Many little shoots all around. How to get rid of those, or will just taking down the main tree do the job?…