Embedded Computer Architecture

2021 - 2022 (Second Quartile)

Code :         5SIA0
Credits
:      5 ECTS
Lecturers : Prof. dr. Henk Corporaal
Tel. :           +31-40-247 5195 (secr.) 5462 (office)
Email:        H.Corporaal at tue.nl

Project assistance
:
- Ali Banagozar (a.banagozar at tue.nl), specifically for the CGRA lab
- Sun Wei (w.sun at tue.nl), for the GPU lab
- Patrick Wijnings (p.w.a.wijnings at tue.nl), for lab on Architecture Exploration

with some (background) help from:
- Barry de Bruin (e.d.bruin at tue.nl)

News

Information on the course:

Description

When looking at future embedded systems and their design, especially (but not exclusively) in the multi-media and machine learning domains, we observe several problems: In order to solve these problems we foresee the use of programmable multi-processor platforms, having an advanced memory hierarchy, this together with an advanced design trajectory. These platforms may contain different processors, ranging from general purpose processors, to processors and accelerators which are highly tuned for a specific application or application domain. This course treats the design principles of the current advanced processor architectures, shows how to program them, and compares their efficiency in terms of cost, power and performance. Furthermore the tuning of processor architectures is treated. 

Several advanced Multi-Processor Platforms, combining discussed processors, are treated. A set of 3 mandatory very advanced lab exercises complements this course.

Purpose:
This course aims at getting an understanding of the processor architectures which will be used in future multi-processor platforms, including their memory hierarchy, especially for the embedded domain. Treated processors range from general purpose to highly optimized ones. Trade-offs will be made between performance, flexibility, programmability, energy consumption and cost. It will be shown how to tune processors in various ways.

Studying the architecture, organization and use of the newest (micro)processors currently on the market, and the latest research developments in computer architecture. Architectures exploiting instruction-level parallelism (ILP), data-level parallelism (DLP, like exploited by GPUs), thread-level and task-level parallelism are treated. Starting from basic architecture concepts we will end with discussing the latest commercial processors.

This course also treats how processors can be combined in a multiprocessing platform, e.g. by using a Network-on-Chip. Inter-processor communication issues will be dealt with. Furthermore some loop transformation techniques needed for exploiting ILP, parallelism and data reuse, will be treated.
Note, code generation will be far more extensively treated in a special course on Parallelization, Compilers and Platforms; 5LIM0.

Special emphasis will be on quantifying design decisions in terms of energy, performance and cost. The intention of the course is to give students the ability to understand the design principles and operation of new (multi-)processor architectures, and evaluate them both qualitatively and quantitatively. Although we treat several examples, the emphasis will be on architecture concepts. Furthermore, 3 intensive lab exercises are part of course; they will learn you the design space of multi- and graphics processors.

We may invite several guest lectures treating State-of-the-Art topics in the computer architecture area.

Topics:


Book and Handouts

The lecture slides will be made available during the course; see also below.
Papers and other reading material.

Book:

Course bookComputer Architecture: A quantitative approach
Hennessy and Patterson
6th Edition (make sure you have this edition!)
November 2017
Especially study Chapters 1-5, and 7, and Appendices A-C,
Background reading E, F and K




Alternative book, less recent but more conceptual, strongly recommended for background reading:

PAlternative course bookarallel Computer Organization and Design 
Authors: Michel Dubois, Murali Annavaram, and Per Stenström

Cambridge university press
October 2012





In addition: Learn Chapter 2
on Computer Architecture Trends
taken from the book "Microprocessor Architectures, from VLIW to TTA"
          by Henk Corporaal, publisher John Wiley, 1998.

Slides (per topic; see also the course description)

Note: all slides will be updated during the course
Chapter numbers correspond, unless mentioned otherwise, to the book of Dubois. Related chapters from Hennessy and Patterson's book are mentioned in the slide sets.

Slides and material corresponding to labs: Go to oncourse.tue.nl for all the lab material !!

Hands-on lab work

note: lab courses will be updated during the course;
check especially the oncourse.tue.nl site !!


Becoming a very good Computer Architect you have to practice a lot. Therefore, as part of this course we have put a lot of effort in preparing 3 very interesting lab assignments. For each lab there is a website with all the required documentation and preparation material. These lab assignments can be made (largely, but check the wiki pages) on your own laptop, with for certain parts, remote access to our server systems.
For every lab you have to write a report, which has to be sent to one of the course assistants, or via the oncourse web site (always check the lab specific instructions).

Lab DSE: Using GEM5 simulator for architecture design space exploration (DSE)

In this lab, you'll get some hands-on experience using the GEM5 simulator; see also the Gem5 slides.
The main goal of this lab is to learn how a simulator can be exploited for exploring the impacts of architectural modifications on performance, and in particular how design choices in processor and cache hierarchy impact the trade-off between energy efficiency and performance. Furthermore, you will learn: how to do basic power modelling of a full system; how to deal with a large amount of simulation parameters and big output data files; and how to write C code that optimally exploits a given cache hierarchy.

Lab GPU: Programming Graphic Processing Units

Graphic processing units (GPUs) can contain upto thousands of Processing Engines (PEs). They achieve performance levels of Tera FLops (10^12 floating point operations per second). In the past GPUs were very dedicated, not general programmable, and  could only be used to speedup graphics processing. Today, they become more-and-more general purpose and even appear in high end embedded systems. The latest GPUs of ATI/AMD and NVIDIA can be programmed in Cuda and/or OpenCL. For this lab we will use  GPUs together with the OpenCL (based on C) programming environment.

For details on the assignment see the oncourse site.
First study GPU lecture and the matrix multiplication example in the cookbook, before starting the real assignment.

Lab CGRA: Processor Design Space Exploration, based on the CGRA from TU/e

You will be asked to design and optimize a low power and very flexible CGRA, Coarse Grain Reconfigurable Array processor for a certain application.  You can both configure the CGRA and make a smart mapping of the application to this CGRA. In particular you have to trade-off performance and energy consumption.

Detailed documentation about these assignments will be put on our 5SIA0 oncourse.tue.nl website, you need to log in.


Student presentations guidelines

As part of this lecture you have to study a hot topic related to this course, and make a short slide presentation about this topic.
The slides have to be presented during the oral exam (usually in the beginning of Q3)

Guidelines are as follows:

Examination

The examination will be a written exam, online (using your laptop), about the treated course theory (all treated slides + corresponding parts of the used book), and the 3 labs. Maximum grading:
Note, the written exam includes many questions directly related to your labs.
When: in the exam period (check the time table).

In addition, as a small bonus (max 1 point), there will be a short oral presentation of a recent article you studied. This is not mandatory.


Related material and other links

Interesting older processor architectures:


Back to homepage of Henk Corporaal