[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

Re: roundTiesToEven in precision 1



From: Dan Zuras Intervals <intervals08@xxxxxxxxxxxxxx>
Subject: Re: roundTiesToEven in precision 1 Date: Tue, 24 Mar 2009 21:28:59 
-0700


      Vincent,

      I'm not quite sure what you mean by precision 1 but the
      context of your question suggests that 754 breaks down
      when p = 1.

      So, if you are suggesting that things break down when
      one goes to so small a precision, I think this is likely.

      We debated making some statement about this in the text
      of the standard but as the whole purpose of extended &
      extendable precisions was to go beyond the other precisions
      available, we thought it an unnecessary thing to point out.

Well, this is a bit important as precision 1 can be used for output
by other standards, e.g. the ISO C standard. And this is what my
program was showing.

      Still, I believe you are correct.

      Yours,

                              Dan

Regards,

-- 
Vincent Lefèvre <vincent@xxxxxxxxxx> - Web: <http://www.vinc17.org/>
100% accessible validated (X)HTML - Blog: <http://www.vinc17.org/blog/>
Work: CR INRIA - computer arithmetic / Arenaire project (LIP, ENS-Lyon)


754 | revision | FAQ | references | list archive