There's lots to leverage on the body if you know how to do it. For example, you can break an arm by holding someone's wrist and pushing his elbow forward; you can get someone down by pushing his shoulder forward and a swiping kick back through his leg.
I didn't realize this at all before I started karate. It's a great way to know how the body works :)