How far is too far?

Yes, arguing a case with someone can be a good way of testing one's position, and can lead to new insights, even if the person you're arguing with is unreasonable. However, if the person is being slippery and trying to avoid the issues rather than argue them, it can be more frustrating than productive.

Agreed. When I've had enough I try to follow Tim's strategy