Freedom without responsibility?

I have always felt that freedom is a right that should be treated responsibly. Used in such a manner that it does not infringe on the rights of others. Example, groups protesting at funerals of our fallen military. Groups forcing their will on others through slander, threats, intimidation. Why is freedom of speach so loosley interpreted, and groups like the ones disrupting funeral services allowed to continue?