A latency-conscious SMT branch prediction architecture. (15th March 2006)

• Record Type: Journal Article
• Authors: Falcon, Ayose; Santana, Oliverio J.; Ramirez, Alex; Valero, Mateo
• Is Part Of: International journal of high performance computing and networking. Volume 2:Number 1(2004)
• Page Start: 11
• Page End: 21
• Publication Date: 2006-03-15
• Subjects: SMT processors -- simultaneous multithreading -- fetch engine -- branch prediction delay -- decoupled predictor -- predictor pipelining -- memory latencies -- multiple threads -- interthread pipelined branch predictor -- high performance computing; High performance computing -- Periodicals; Computer networks -- Periodicals; High performance computing; Periodicals; 004.05
• Languages: English
• ISSNs: 1740-0562

Abstract

Executing multiple threads has proved to be an effective solution to partially hide latencies that appear in a processor. When a thread is stalled because of a long-latency operation is being processed, such as a memory access or a floating-point calculation, the processor can switch to another context so that another thread can take advantage of the idle resources. However, fetch stall conditions caused by a branch predictor delay are not hidden by current simultaneous multithreading (SMT) fetch designs, causing a performance drop due to the absence of instructions to execute. In this paper, we propose several solutions to reduce the effect of branch predictor delay in the performance of SMT processors. Firstly, we analyse the impact of varying the number of access ports. Secondly, we describe a decoupled implementation of an SMT fetch unit that helps to tolerate the predictor delay. Finally, we present an interthread pipelined branch predictor, based on creating a pipeline of interleaved predictions from different threads. Our results show that, combining all the proposed techniques, the performance obtained is similar to that obtained using an ideal, 1-cycle access branch predictor.