Slide an error below or above zero and see its size with the minus sign dropped. An error of -4 costs exactly the same as +4, with no squaring.
Mean Absolute Error just drops the minus sign. An error of −4 costs the same as an error of +4 — no squaring, no extra punishment.