| To: | Martin Spier <mspier@xxxxxxxxxxx> |
|---|---|
| Subject: | Re: Floating point problem |
| From: | fche@xxxxxxxxxx (Frank Ch. Eigler) |
| Date: | Mon, 28 Jul 2014 08:39:59 -0400 |
| Cc: | pcp@xxxxxxxxxxx, Amer Ather <aather@xxxxxxxxxxx>, Coburn Watson <cwatson@xxxxxxxxxxx>, Brendan Gregg <bgregg@xxxxxxxxxxx> |
| Delivered-to: | pcp@xxxxxxxxxxx |
| In-reply-to: | <CAEp4+dU2kE9JJztBPc=N5oSyoEyBvN5Of19rohC3DxXGeomuRw@xxxxxxxxxxxxxx> (Martin Spier's message of "Fri, 25 Jul 2014 17:58:51 -0700") |
| References: | <CAEp4+dU2kE9JJztBPc=N5oSyoEyBvN5Of19rohC3DxXGeomuRw@xxxxxxxxxxxxxx> |
| User-agent: | Gnus/5.1008 (Gnus v5.10.8) Emacs/21.4 (gnu/linux) |
mspier wrote:
> Ran into a small problem with "value" floating point precision on pmwebd json
> responses.
> [...]
> "instances": [
> {
> "value": 7.94874E+10
> }
> [...]
Neither fche/pmwebd nor dev branch pmwebds appear to do any
unnecessary casting of pmExtractValue'd integers to floating
point, so that transformation must be done beneath pmwebd.
- FChE
|
| <Prev in Thread] | Current Thread | [Next in Thread> |
|---|---|---|
| ||
| Previous by Date: | pcp updates: pmiostat, Mark Goodwin |
|---|---|
| Next by Date: | Re: [pcp] Floating point problem, Martin Spier |
| Previous by Thread: | Re: [pcp] Floating point problem, Ken McDonell |
| Next by Thread: | [Bug 1061] New: mmv pmda sensitive to TOCTOU for shmem metadata extraction, bugzilla-daemon |
| Indexes: | [Date] [Thread] [Top] [All Lists] |