With a tensor language prototype, “speed and correctness do not have to compete … they can go collectively, hand-in-hand.”
High-general performance computing is essential for an ever-growing range of tasks — such as picture processing or different deep mastering purposes on neural nets — the place a single ought to plow as a result of immense piles of info, and do so fairly swiftly, or else it could just take ridiculous amounts of time. It’s widely thought that, in carrying out functions of this kind, there are unavoidable trade-offs involving pace and reliability. If pace is the prime priority, in accordance to this view, then dependability will probable suffer, and vice versa.
Having said that, a crew of scientists, dependent primarily at A Tensor Language” (ATL), last month at the Principles of Programming Languages conference in Philadelphia.
“Everything in our language,” Liu says, “is aimed at producing either a single number or a tensor.” Tensors, in turn, are generalizations of vectors and matrices. Whereas vectors are one-dimensional objects (often represented by individual arrows) and matrices are familiar two-dimensional arrays of numbers, tensors are n-dimensional arrays, which could take the form of a 3x3x3 array, for instance, or something of even higher (or lower) dimensions.
The whole point of a computer algorithm or program is to initiate a particular computation. But there can be many different ways of writing that program — “a bewildering variety of different code realizations,” as Liu and her coauthors wrote in their soon-to-be published conference paper — some considerably speedier than others. The primary rationale behind ATL is this, she explains: “Given that high-performance computing is so resource-intensive, you want to be able to modify, or rewrite, programs into an optimal form in order to speed things up. One often starts with a program that is easiest to write, but that may not be the fastest way to run it, so that further adjustments are still needed.”
As an example, suppose an image is represented by a 100×100 array of numbers, each corresponding to a pixel, …
Read More