Ok, we really gotta know exactly where it's coming from because different parts mean different problems.
if you don't think it's coming from any where below you( like the t-case) then that's good. If the hub lockers are old then they prob need a new kit put in. Chances are that 1. There is dirt in there 2. The rings are falling apart. To me it sounds like number 2. To check the hubs you'll need to pull them out, any damage will be obvious. Should be easy to pull them out.
Oh, one more thought! Are you sure it's not more of a rumble????