嗨Frank，是的，DMM中有一个算法可以根据模式（DC，AC等），分辨率，读取速度等计算显示的位数.DMM不会返回任何可用的信息。
一个程序员来弄清楚它实际显示的位数。
返回的数据格式为+ n.nnnnnnnnEn -nn。
没有任何关于有效位数的线索，由程序员（例如，BenchVue，还有任何其他自行开发的应用程序）来使用他们认为合适的数据。
通常，人们只是根据限制测试一个值，因此将15个字符的字符串转换为浮点或双精度数，然后进行比较。
例如，如果您正在针对限制测试value = float（“1.19845660E-00”），则通常采用“if（value> 1.0）”的形式和（值计算所有可能的重要组合并非易事
DMM可以返回的数字。如果DMM返回该信息会很好，因为它知道它。所以我建议将其作为DMM设计者的增强。但是有很多工具，所有这些都是
在我们取得任何实际进展之前，我们必须这样做。布莱恩
以上来自于谷歌翻译
以下为原文
Hi Frank,
Yes, there is an algorithm in the DMM that figures out how many digits to display, based on mode (DC, AC, etc.), resolution, reading speed, etc. The DMM does not return any information that's usable by a programmer to figure out how many digits it actually displayed. The data that's returned is of the form +n.nnnnnnnnE-nn. Without any clue as to how many significant digits are valid, it is up to the programmer (e.g., BenchVue, but also any other homegrown app) to use the data as they see fit.
Often, one is simply testing a value against limits, so the 15 character string is converted to a floating point or double precision number and then compared. For example, if you were testing value = float("1.19845660E-00") against limits, it would typically be of the form "if (value > 1.0) and (value < 1.2) then call pass() else call fail ()". If the DMM was displaying 1.1985 VDC, it really wouldn't matter.
It is not trivial to calculate all the possible combinations of significant digits that a DMM can return. It would be nice if the DMM returned that info, since it knows it. So I have suggested that as an enhancement to the DMM designers. But there are a lot of instruments out there, and all of them would have to do that before we could make any real headway.
Brian
嗨Frank，是的，DMM中有一个算法可以根据模式（DC，AC等），分辨率，读取速度等计算显示的位数.DMM不会返回任何可用的信息。
一个程序员来弄清楚它实际显示的位数。
返回的数据格式为+ n.nnnnnnnnEn -nn。
没有任何关于有效位数的线索，由程序员（例如，BenchVue，还有任何其他自行开发的应用程序）来使用他们认为合适的数据。
通常，人们只是根据限制测试一个值，因此将15个字符的字符串转换为浮点或双精度数，然后进行比较。
例如，如果您正在针对限制测试value = float（“1.19845660E-00”），则通常采用“if（value> 1.0）”的形式和（值计算所有可能的重要组合并非易事
DMM可以返回的数字。如果DMM返回该信息会很好，因为它知道它。所以我建议将其作为DMM设计者的增强。但是有很多工具，所有这些都是
在我们取得任何实际进展之前，我们必须这样做。布莱恩
以上来自于谷歌翻译
以下为原文
Hi Frank,
Yes, there is an algorithm in the DMM that figures out how many digits to display, based on mode (DC, AC, etc.), resolution, reading speed, etc. The DMM does not return any information that's usable by a programmer to figure out how many digits it actually displayed. The data that's returned is of the form +n.nnnnnnnnE-nn. Without any clue as to how many significant digits are valid, it is up to the programmer (e.g., BenchVue, but also any other homegrown app) to use the data as they see fit.
Often, one is simply testing a value against limits, so the 15 character string is converted to a floating point or double precision number and then compared. For example, if you were testing value = float("1.19845660E-00") against limits, it would typically be of the form "if (value > 1.0) and (value < 1.2) then call pass() else call fail ()". If the DMM was displaying 1.1985 VDC, it really wouldn't matter.
It is not trivial to calculate all the possible combinations of significant digits that a DMM can return. It would be nice if the DMM returned that info, since it knows it. So I have suggested that as an enhancement to the DMM designers. But there are a lot of instruments out there, and all of them would have to do that before we could make any real headway.
Brian
举报
