It's quite common to be distracted by sounds - the fact that you are noticing your attention being drawn to them is actually a sign that you're being mindful! Try allowing the sounds to be in the background, and to be aware of the sensations of the breath in the foreground. You don't need to get rid of the sounds, just relax with them in the background. It's like looking into a crowd of people and seeing your friend in the group. You can look at your friend without needing to get rid of all the people around her.