a question??

So the other day in church we were talking about agency and someone made a comment about choices and how sometimes our agency is taken away from us by others actions..and I am having a hard time wrapping my mind around it. Can our agency be taken away from us? Doesn't that go against the whole purpose of the plan and everything? Maybe I am reading too much into this but if I could get y'alls perspective on it that would be GREAT!!