[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

Definitions of "quantum" and "preferred exponent"



The definition of "quantum" in the draft 1.4.0 seems to be wrong:

  quantum: The quantum of a finite floating-point representation is
  the value of a unit in the last position of its significand. This
  is equal to the radix raised to the exponent q.

This is proportional to the radix raised to the exponent q (when the
precision is fixed), but not equal.

The definition of "preferred exponent" is also strange (what does
"which best preserves the quantum of the operands" mean?).

-- 
Vincent Lefèvre <vincent@xxxxxxxxxx> - Web: <http://www.vinc17.org/>
100% accessible validated (X)HTML - Blog: <http://www.vinc17.org/blog/>
Work: CR INRIA - computer arithmetic / Arenaire project (LIP, ENS-Lyon)

754 | revision | FAQ | references | list archive