Leafy sections in Cherry Blossoms

Can you tell me why my Cherry Blossom has branches with just leaves on it? Should these be removed and if so when is the best time to do this?