"So, it is just the combination of sensors during the adjustment process, isn't it?"

yes, it is.

"Maybe, you have a wrong configuration, i.e. you haven't divided the directions into separat groups (each group represents a set of directions that has one unknown orientation). Maybe, your stochastic model is not correct. Maybe, there are some outliers... etc."

Maybe.

Thanks for your answer !