sometimes its clear whats afffecting your score, if its low and theres only a few suspects as to why.
if the balance fluctuates you can watch it for a few months and see what the affect is. even if it fluctuates only a few percent, if its weighing it down you should see some difference in the score which will give you an idea as to how much a big balance decrease would affect.