research-article

GPUs and the Future of Parallel Computing

Authors:

David GlascoAuthors Info & Claims

IEEE Micro, Volume 31, Issue 5

Pages 7 - 17

https://doi.org/10.1109/MM.2011.89

Published: 01 September 2011 Publication History

Abstract

This article discusses the capabilities of state-of-the art GPU-based high-throughput computing systems and considers the challenges to scaling single-chip parallel-computing systems, highlighting high-impact areas that the computing research community can address. Nvidia Research is investigating an architecture for a heterogeneous high-performance computing system that seeks to address these challenges.

Cited By

View all

Wan YXie XChen JXie KYi DLu YGai K(2024)ADS-CNNFuture Generation Computer Systems10.1016/j.future.2024.04.038158:C(138-149)Online publication date: 1-Sep-2024
https://dl.acm.org/doi/10.1016/j.future.2024.04.038
Schneider H(2024)The emergence of compositionality in a brain-inspired cognitive architectureCognitive Systems Research10.1016/j.cogsys.2024.10121586:COnline publication date: 1-Aug-2024
https://dl.acm.org/doi/10.1016/j.cogsys.2024.101215
Zhang DLang QWang RShen L(2023)Extension VM: Interleaved Data Layout in Vector MemoryACM Transactions on Architecture and Code Optimization10.1145/363152821:1(1-23)Online publication date: 7-Nov-2023
https://dl.acm.org/doi/10.1145/3631528
Show More Cited By

Recommendations

On the Efficacy of a Fused CPU+GPU Processor (or APU) for Parallel Computing
SAAHPC '11: Proceedings of the 2011 Symposium on Application Accelerators in High-Performance Computing

The graphics processing unit (GPU) has made significant strides as an accelerator in parallel computing. However, because the GPU has resided out on PCIe as a discrete device, the performance of GPU applications can be bottlenecked by data transfers ...
Performance Tuning of Matrix Multiplication in OpenCL on Different GPUs and CPUs
SCC '12: Proceedings of the 2012 SC Companion: High Performance Computing, Networking Storage and Analysis

OpenCL (Open Computing Language) is a framework for general-purpose parallel programming. Programs written in OpenCL are functionally portable across multiple processors including CPUs, GPUs, and also FPGAs. Using an auto-tuning technique makes ...
An OpenCL micro-benchmark suite for GPUs and CPUs

Open computing language (OpenCL) is a new industry standard for task-parallel and data-parallel heterogeneous computing on a variety of modern CPUs, GPUs, DSPs, and other microprocessor designs. OpenCL is vendor independent and hence not specialized for ...

Comments

Information & Contributors

Information

Published In

IEEE Micro Volume 31, Issue 5

September 2011

79 pages

ISSN:0272-1732

Issue’s Table of Contents

Publisher

IEEE Computer Society Press

Washington, DC, United States

Publication History

Published: 01 September 2011

Author Tags

Qualifiers

Research-article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

196
Total Citations
View Citations
0
Total Downloads

Downloads (Last 12 months)0
Downloads (Last 6 weeks)0

Reflects downloads up to 01 Sep 2024

Other Metrics

View Author Metrics

Citations

Cited By

View all

Wan YXie XChen JXie KYi DLu YGai K(2024)ADS-CNNFuture Generation Computer Systems10.1016/j.future.2024.04.038158:C(138-149)Online publication date: 1-Sep-2024
https://dl.acm.org/doi/10.1016/j.future.2024.04.038
Schneider H(2024)The emergence of compositionality in a brain-inspired cognitive architectureCognitive Systems Research10.1016/j.cogsys.2024.10121586:COnline publication date: 1-Aug-2024
https://dl.acm.org/doi/10.1016/j.cogsys.2024.101215
Zhang DLang QWang RShen L(2023)Extension VM: Interleaved Data Layout in Vector MemoryACM Transactions on Architecture and Code Optimization10.1145/363152821:1(1-23)Online publication date: 7-Nov-2023
https://dl.acm.org/doi/10.1145/3631528
Zheng BYu CWang JDing YLiu YWang YPekhimenko G(2023)Grape: Practical and Efficient Graphed Execution for Dynamic Deep Neural Networks on GPUsProceedings of the 56th Annual IEEE/ACM International Symposium on Microarchitecture10.1145/3613424.3614248(1364-1380)Online publication date: 28-Oct-2023
https://dl.acm.org/doi/10.1145/3613424.3614248
Yang WZhang CPan MChandra SBlincoe KTonella P(2023)Understanding the Topics and Challenges of GPU Programming by Classifying and Analyzing Stack Overflow PostsProceedings of the 31st ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering10.1145/3611643.3616365(1444-1456)Online publication date: 30-Nov-2023
https://dl.acm.org/doi/10.1145/3611643.3616365
Arora ABhamburkar ABorda AAnand TSehgal RHanindhito BGaillardon PKulkarni JJohn L(2023)CoMeFa: Deploying Compute-in-Memory on FPGAs for Deep Learning AccelerationACM Transactions on Reconfigurable Technology and Systems10.1145/360350416:3(1-34)Online publication date: 27-Jul-2023
https://dl.acm.org/doi/10.1145/3603504
Wang DLou JJin NMascarenhas EMahapatra RKinzer SGhodrati SYazdanbakhsh AEsmaeilzadeh HKim NSolihin YHeinrich M(2023)MESA: Microarchitecture Extensions for Spatial Architecture GenerationProceedings of the 50th Annual International Symposium on Computer Architecture10.1145/3579371.3589084(1-14)Online publication date: 17-Jun-2023
https://dl.acm.org/doi/10.1145/3579371.3589084
Singhal RSaraswat VDeshmukh SSubramoney SSomappa LBaghini MGanguly U(2023)Enhanced regularization for on-chip training using analog and temporary memory weightsNeural Networks10.1016/j.neunet.2023.07.001165:C(1050-1057)Online publication date: 1-Aug-2023
https://dl.acm.org/doi/10.1016/j.neunet.2023.07.001
Nasiri HDarjani AKavand NGoudarzi M(2023)H-Storm: A Hybrid CPU-FPGA Architecture to Accelerate Apache StormJournal of Grid Computing10.1007/s10723-023-09692-921:4Online publication date: 7-Nov-2023
https://dl.acm.org/doi/10.1007/s10723-023-09692-9
Su QGeng CPekhimenko GSi X(2023)TorchProbe: Fuzzing Dynamic Deep Learning CompilersProgramming Languages and Systems10.1007/978-981-99-8311-7_15(310-331)Online publication date: 26-Nov-2023
https://dl.acm.org/doi/10.1007/978-981-99-8311-7_15
Show More Cited By

View Options

View options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Abstract

Cited By

Recommendations

On the Efficacy of a Fused CPU+GPU Processor (or APU) for Parallel Computing

Performance Tuning of Matrix Multiplication in OpenCL on Different GPUs and CPUs

An OpenCL micro-benchmark suite for GPUs and CPUs

Comments

Information

Published In

Publisher

Publication History

Author Tags

Qualifiers

Contributors

Other Metrics

Bibliometrics

Article Metrics

Other Metrics

Citations

Cited By

View options

Get Access

Login options

Full Access

Figures

Other

Share

Share this Publication link

Share on social media

Affiliations