Pruning a pagoda dogwood

Can I prune a pagoda dogwood now (ie in June) or do I have to wait until next spring? The perennials planted below are being badly shaded and I wanted to remove the lower branches.…