Why is "infringing on the rights of others" the standard to judge the acceptability of an action?

Okay, this is spiraling into the 'just plain dumb' catagory of questions.

Answer the question. It has a purpose.

Is "infringement on the rights of others" your "golden rule" against which you judge the morality or acceptability of an action?