"Why is that"
Because binary floating point numbers have finite precision, which has the effect that arithmetic operations on them necessarily accumulate floating point error. You (the programmer) need to understand that, and take that into account in your algorithms.
"and how can it be avoided?"
It can't be avoided (if you want to store data using binary floating point numbers).
This is worth reading as well:
