#

precision

Here are 352 public repositories matching this topic...

Dominik-Workshop / Electronic_load

Digitally controlled electronic load, 2022

programmable atmega328p qtcreator electronic load diy precision qtdesigner

Updated Nov 21, 2024
HTML

giocip / num7

SUPREME PRECISION GENERAL PURPOSE ARITHMETIC-LOGIC DECIMAL CLASS

python math micropython financial arbitrary-precision arithmetic decimal raspberry school-education floating-point precision ieee754

Updated Nov 20, 2024
Python

dereuromark / cakephp-decimal

CakePHP Decimal type handling using Decimal value object.

php cakephp decimal precision

Updated Nov 19, 2024
PHP

JuliaMath / DoubleFloats.jl

math with more good bits

performance math julia accuracy floating-point precision extended-precision doubledouble

Updated Nov 18, 2024
Julia

vspaz / jsondiff

jsondiff is a json diff utility. It can compare two JSON files, using strings, prefixes, or regex to filter required/optional fields, and apply relative or absolute precision tolerance per each numeric field or globally; prints the diff between 2 json files. It can optionally accept a config with required or optional fields.

python diff regex filter cython python3 tolerance precision jsondiff comparison-tool json-compare json-comparison jsondiffviewer

Updated Nov 17, 2024
Python

eobermuhlner / big-math

Advanced Java BigDecimal math functions (pow, sqrt, log, sin, ...) using arbitrary precision.

arbitrary-precision complex-numbers bigdecimal mathematical-functions precision newton-raphson taylor-series big-math

Updated Nov 17, 2024
Java

ducflair / duc

Duc is a binary file format conceived for a new era of CAD design.

design binary file cad precision 2d

Updated Nov 15, 2024
TypeScript

stdlib-js / constants-float32-ln-two

Natural logarithm of 2 as a single-precision floating-point number.

Updated Nov 13, 2024
JavaScript

stdlib-js / constants-float32-e

Euler's number.

nodejs javascript node euler math stdlib mathematics const e node-js floating-point constant precision ieee754 single napier float32

Updated Nov 11, 2024
JavaScript

karenpayneoregon / sql-server-datetime2

Learn about using datetime2 precision

csharp datetime datatable sqlserver precision datetime-format datareader efcore7 datetime2

Updated Nov 8, 2024
C#

emircanakyuzz / Makine_Ogrenmesi_Algoritmalari-Machine_Learning_Algorithms

Bu çalışmamda "Makine Öğrenmesi" algoritmaları üzerine çalıştım. Bu algoritmaları veri seti üzerinde uygulayarak tahminlerde bulundum ve sonuçları analiz ettim.

python machine-learning specificity artificial-intelligence naive-bayes-classifier accuracy recall support-vector-machines roc-curve precision k-nearest-neighbours f1-score multilayer-perceptron

Updated Nov 7, 2024
Python

Alexhuszagh / rust-lexical

Fast numeric to- and from-string conversion routines.

rust encoding parsing string-conversion floating-point std precision no-std

Updated Nov 2, 2024
Rust

stdlib-js / array-typed-complex

Create a complex number typed array.

nodejs javascript data node types vector matrix array stdlib structure ndarray node-js typed precision double double-precision typed-array complex64array complex128array

Updated Nov 1, 2024
JavaScript

stdlib-js / math-base-special-rempio2

Compute `x - nπ/2 = r`.

nodejs javascript node math stdlib mathematics pi node-js precision division remainder pio2

Updated Nov 1, 2024
JavaScript

stdlib-js / constants-float32-ninf

Single-precision floating-point negative infinity.

nodejs javascript node math stdlib mathematics const node-js floating-point constant precision infinity float inf negative ieee754 single float32 ninf

Updated Nov 1, 2024
JavaScript

stdlib-js / constants-float32-pinf

Single-precision floating-point positive infinity.

nodejs javascript node math stdlib mathematics const positive node-js floating-point constant precision infinity float inf ieee754 single pinf float32

Updated Nov 1, 2024
JavaScript

stdlib-js / constants-complex128-nan

Canonical double-precision complex floating-point NaN.

nodejs javascript node math stdlib mathematics const complex node-js floating-point constant precision double nan dbl float64 cmplx complex128 cmplx128

Updated Nov 1, 2024
JavaScript

stdlib-js / constants-complex128-zero

Double-precision complex floating-point zero.

nodejs javascript node math stdlib mathematics const complex node-js floating-point constant precision zero double dbl float64 cmplx complex128 cmplx128

Updated Nov 1, 2024
JavaScript

stdlib-js / constants-complex64-nan

Canonical single-precision complex floating-point NaN.

nodejs javascript node math stdlib mathematics const complex node-js floating-point constant precision float nan float32 cmplx complex64 cmplx64

Updated Nov 1, 2024
JavaScript

stdlib-js / constants-complex64-zero

Single-precision complex floating-point zero.

nodejs javascript node math stdlib mathematics const complex node-js floating-point constant precision zero float float32 cmplx complex64 cmplx64

Updated Nov 1, 2024
JavaScript

Improve this page

Add a description, image, and links to the precision topic page so that developers can more easily learn about it.

Curate this topic

Add this topic to your repo

To associate your repository with the precision topic, visit your repo's landing page and select "manage topics."