diff options
| author | Liam Beguin <[email protected]> | 2022-02-12 21:57:33 -0500 |
|---|---|---|
| committer | Jonathan Cameron <[email protected]> | 2022-02-27 13:38:16 +0000 |
| commit | f5fc003d48033559314f1c9de8198f58f14ed557 (patch) | |
| tree | 40f62414836f50503b083c7113ebe3777631b47a /tools/perf/scripts/python/libxed.py | |
| parent | a29c3283653b80b916c5ca5292c5d36415e38e92 (diff) | |
iio: afe: rescale: fix accuracy for small fractional scales
The approximation caused by integer divisions can be costly on smaller
scale values since the decimal part is significant compared to the
integer part. Switch to an IIO_VAL_INT_PLUS_NANO scale type in such
cases to maintain accuracy.
Signed-off-by: Liam Beguin <[email protected]>
Reviewed-by: Peter Rosin <[email protected]>
Reviewed-by: Andy Shevchenko <[email protected]>
Link: https://lore.kernel.org/r/[email protected]
Signed-off-by: Jonathan Cameron <[email protected]>
Diffstat (limited to 'tools/perf/scripts/python/libxed.py')
0 files changed, 0 insertions, 0 deletions