← sources

Research paper: HyAtten: Hybrid Photonic-Digital Architecture for Accelerating Attention Mechanism

source: semantic-scholarpublished 2025-03-31 00:00ingested 2026-06-01 11:16

extract

Query: photonic computing transformer accelerator Authors: Huize Li, Dan Chen, Tulika Mitra Citations: 0 The wide adoption and substantial computational resource requirements of attention-based Transformers have spurred the demand for efficient hardware accelerators. Unlike digital-based accelerators, there is growing interest in exploring photonics due to its high energy efficiency and ultra-fast processing speeds. However, the significant signal conversion overhead limits the performance of photonic-based accelerators. In this work, we propose HyAtten, a photonic-based attention accelerator with minimize signal conversion overhead. HyAtten incorporates a signal comparator to classify signals into two categories based on whether they can be processed by low-resolution converters. HyAtten integrates low-resolution converters to process all low-resolution signals, thereby boosting the parallelism of photonic computing. For signals requiring high-resolution conversion, Hy-Atten uses digital circuits instead of signal converters to reduce area and latency overhead. Compared to state-of-the-art photonic-based Transformer accelerator, HyAtten achieves 9.8x performance/area and 2.2 x energy-efficiency/area improvement.

retained text

No document body was retained for this record — only its metadata was stored.