take a look at the shaft where it goes into the brake drum. take it clear out and clean it really good, use sand paper to get all the dirt and stuff off. my brakes were doing the same thing, and i cleaned the shaft and it fixed everything.
-Aaron
-Aaron