Tech »  Topic »  Tensordyne Claims 8x AI Efficiency Boost Over NVIDIA With Logarithmic Math

Tensordyne Claims 8x AI Efficiency Boost Over NVIDIA With Logarithmic Math


About a year ago, an AI startup known as Recogni announced a patented number system for AI math, known as Pareto. Pareto is a logarithmic system, meaning that it stores numbers using their logarithmic representation rather than their absolute values. This can be highly advantageous for AI, because it drastically simplifies the math you need to do to multiply two values; instead of A×B, it becomes log(A)+log(B). For computers, addition is much simpler than multiplication, and require a lot less silicon (and thus less power) to perform.

Tensordyne's method uses a logarithmic number representation instead of floating-point or integer numbers. This has a big advantage: it allows them to perform AI inference using primarily additions instead of multiplication operations. Because AI compute is primarily composed of matrix multiplication, this radically simplifies the workload, and allows the functional units of Tensordyne's chip to be significantly ...


Copyright of this story solely belongs to hothardware.com . To see the full text click HERE