Think of it this way: you have the right to listen to your music as loud as you want, but that right ends with my right to enjoy my peace and quiet. Unfortunately, we need sound ordinances and "quiet hours" because some people can't seem to figure out that they share a planet with 7+ billion other people.
Now take all that, and apply it to your relationships: are you a loud music type? Or a quiet-hour type?
If you tell me to "just wear earplugs", the conversation is forfeited.