poster

Introduction to TTL, an Open Source Tensor and Tiling Library for OpenCL

Authors:

Christopher Gearing,

Ayal ZaksAuthors Info & Claims

IWOCL '23: Proceedings of the 2023 International Workshop on OpenCL

Article No.: 32, Page 1

https://doi.org/10.1145/3585341.3587953

Published: 18 April 2023 Publication History

Get Access

Abstract

OpenCL has an Image data type to represent multi-dimensional arrays of image data for processing in device Kernels. Whilst providing powerful functionality for image processing, they are designed towards the capabilities of GPUs and provide closed opaque functionality and data formats. This presentation presents a recently released Open-Source library, “Tensor and Tiling library”. TTL has been created to support multi-dimensional data for non-GPUs. Like the GPU Image type, the TTL tensor type has built-in attributes to describe its shape, layout and underlying data. The library provides methods for reading, writing, reasoning about the relative positioning of related Tensors, and attributes of the data beyond the extent of the Tensor.

OpenCL C provides asynchronous data copy functions built into the language, allowing data transportation between the host and device memory systems. Many usage patterns where the devices have limited memory require the data to be Tiled and then pipelined through the device. Whilst the OpenCL primitives make this pipelining possible, the pipelining code can be a significant part of the development effort when the actual value added is the algorithm implementation itself. The TTL library offloads the tiling and pipelining boilerplate code allowing the programmer to focus on algorithm development.

The presentation will present the Tensor and Tiling library.

The library today is temporarily hosted at https://gitlab.khronos.org/opencl/ttl and, by the time of IWOCL 2023, will be finally hosted at https://github.com/KhronosGroup

Index Terms

Introduction to TTL, an Open Source Tensor and Tiling Library for OpenCL
1. Computing methodologies
  1. Parallel computing methodologies
    1. Parallel programming languages

Recommendations

A coordinated tiling and batching framework for efficient GEMM on GPUs
PPoPP '19: Proceedings of the 24th Symposium on Principles and Practice of Parallel Programming

General matrix multiplication (GEMM) plays a paramount role in a broad range of domains such as deep learning, scientific computing, and image processing. The primary optimization method is to partition the matrix into many tiles and exploit the ...
Data-reuse Optimizations for pipelined Tiling with Parametric Tile Sizes
PACT '14: Proceedings of the 23rd international conference on Parallel architectures and compilation

Loop tiling is a loop transformation widely used to improve spatial and temporal data locality, to increase computation granularity, and to enable blocking algorithms, which are particularly useful when offloading kernels on platforms with small ...
HPTT: a high-performance tensor transposition C++ library
ARRAY 2017: Proceedings of the 4th ACM SIGPLAN International Workshop on Libraries, Languages, and Compilers for Array Programming

Recently we presented TTC, a domain-specific compiler for tensor transpositions. Despite the fact that the performance of the generated code is nearly optimal, due to its offline nature, TTC cannot be utilized in all the application codes in which the ...

Comments

Information & Contributors

Information

Published In

IWOCL '23: Proceedings of the 2023 International Workshop on OpenCL

April 2023

133 pages

ISBN:9798400707452

DOI:10.1145/3585341

Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 18 April 2023

Check for updates

Author Tags

Qualifiers

Poster
Research
Refereed limited

Conference

IWOCL '23

IWOCL '23: International Workshop on OpenCL

April 18 - 20, 2023

Cambridge, United Kingdom

Acceptance Rates

Overall Acceptance Rate 84 of 152 submissions, 55%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

0
Total Citations
33
Total Downloads

Downloads (Last 12 months)11
Downloads (Last 6 weeks)0

Reflects downloads up to 08 Feb 2025

Other Metrics

View Author Metrics

Citations

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

HTML Format

View this article in HTML Format.

HTML Format

Abstract

Index Terms

Recommendations

A coordinated tiling and batching framework for efficient GEMM on GPUs

Data-reuse Optimizations for pipelined Tiling with Parametric Tile Sizes

HPTT: a high-performance tensor transposition C++ library

Comments

Information

Published In

Publisher

Publication History

Check for updates

Author Tags

Qualifiers

Conference

Acceptance Rates

Contributors

Other Metrics

Bibliometrics

Article Metrics

Other Metrics

Citations

Login options

Full Access

View options

PDF

eReader

HTML Format

Share

Share this Publication link

Share on social media

Affiliations