To convert a number from decimal to another, we use division. To convert from some system to decimal, we use multiplication by digits. Moreover, if we want to translate from one (non-decimal) to another (non-decimal), then we need a decimal ... Why is the decimal system so special?
I think you are confusing a particular representation from a number's value, and the value with the base it is usually expressed in (decimal), which is the only thing special about it.