CS561 Syllabus & Progress

Progress: material covered are displayed in blue (I will be updating this webpage from time to time)

You can save examples from a webpage from your browser. Do the following in Netscape:

     Click File -> Save As
     Complete the file name in the "Selection" box
       (Make sure you specify the right directory name and file name !)
     Click OK when the file name is right

Introduction to Computer Architecture

Logical view of a computer system: click here
What the computer can do with its main memory: click here
Structure of computer main memory: click here

How numerical information are stored inside a computer:

Positional value representation: click here
Representing unsigned integers: click here
Representing signed integers: click here
Representing floating point numbers: click here

CPU Architecture: (you need to know this for multi-threading)

General CPU architecture: click here
Operation of the CPU (what does the CPU do ?): click here

Instructing the computer to do something for you:

How to communicate with a computer (machine): click here
Steps from program development to execution: click here
DEMO programs: click here

Elementary Programming in C/C++

Compiling a C++ program:
- Compiling C++ programs/Pre-processor: click here
Types and Variables:
- Data Types: click here
- Constants and Comments: click here
- Simple variables: click here
- Declaring variables: click here
- Arithmetic Operators: click here
Program statements:
- Assignment Statement: click here
- Selection Statements (if, if-else, switch): click here
  - The Dangling-else ambiguity: click here
- Loop Statements: click here
Program and Subroutines/Functions:
- Subroutines and Functions: click here

Project 1: Bisection algorithm in C++ (passing functions as parameter) ----- click here

Software Engineering Topics

Managing program complexity:
- Introduction: click here
- Modular programming (with subroutines): click here
- Software reuse - the art of writing new software using old software: click here
- Building your own library of useful functions: click here
- Managing your program with the MAKE utility click here
Errors in numerical computational programs:
- DBX: a tool for locating errors in programs: click here
- The different kinds of errors in a numerical computational programs: click here
Performance enhancement:
- prof: profiling program execution: click here

Further C/C++ programming

Relationships between variables and functions:
- Scope and lifetime, global and local variable: click here
- Scope and lifetime of function parameters: click here
- Parameter passing mechanisms: click here
- The reference (&) and deference (*) operators: click here

Composite variables:
- Arrays: click here
  
  Project 2: Matrix inversion in C++ (arrays, passing arrays as parameter) ----- click here
- Structures (records): click here
- Linked structures: (According to course description and Prof. Nagy, it is now included)
  - Introduction to linked lists: click here
  - Insert at the head of a linked list: click here
  - Insert at the tail of a linked list: click here
  - Maintaining an ordered linked list: click here
  - Deleting from a linked list: click here
  Project 3: Insert and Delete in Ordered Linked list in C++ (pointer manipulation techniques) ----- click here
- Matrix-vector operations: click here
- Storing sparse matrices: click here

File I/O:
- Reading and writing formatted (text) files in C/C++: click here
- Reading and writing binary files in C/C++: click here
Elementary Object Oriented Programming Techniques:
- Object classes (data + functions): click here
- A matrix class click here
- Operator functions: click here
- Matrices and vectors: click here
  
  Project 4: Dense and Sparse matrices in C++ (define matrix * vector for dense and sparce matrix) ----- click here
- Private: enhanced protection: click here
- Friends: decreased protection: click here
- Constructor and destructor: click here
- Separate compilation with classes: click here
- Function and operator overloading: click here
- The assignment operator: click here
Advanced Object Oriented Programming Techniques:
- Algorithm and Data representation: click here
- Derived classes: click here
- Casting between parent and child class: click here
- Function polymorphism: click here
- Using polymorphism to improve program generality: click here
Project 5: Jacobi iteration in C++ (define + and * for matrix type) ----- click here
Misc. topics in inheritance
- Overriding variables: click here
- Inheritance and Access Qualifiers: click here

Elementary Programming in Fortran

Other resources:
Introduction: click here
Variables: click here
Statements:
- Assignment statment and Operators: click here
- Selections (if-statements): click here
- Loops (while, for-statements): click here
Intrinsic (built-in) Functions: click here
Functions, interfaces and include: click here

Project 5: Matrix inversion in Fortran (arrays and functions in Fortran) ----- click here

Further Programming in Fortran

Lifetime and Scope of variables:

Scope and lifetime, global and local variable: click here

Showing parameter passing in F90 by linking C and F90 programs:

Parameter passing in Fortran and Linking C and Fortran programs: click here

Data Structures in Fortran:

Selecting the right precision: click here
Pointer variables: click here
Arrays and Matrices:

Arrays as program variables: click here
Size and shape of arrays: click here
Arrays as parameters to functions: click here
Operations and Functions that manipulate arrays: click here
Slicing and dicing arrays in Fortran: click here
Functions that return an array: click here
Dynamic array variables: click here

User-defined types (Structures): click here

Linked structures:

Insert at the head of a linked list: click here

File I/O:

Reading and writing formatted (text) files in F90: click here

Function overloading in F90: click here

Operator functions: click here

Modules: click here
Using Scientific libraries
- The LAPack numerical analysis package: click here
Parallel Computers
- Introduction: click here
- SIMD - Single Instruction (stream) and Multiple Data (stream) computers: click here
- Interconnecting MIMD computers: click here
- Interconnecting Shared-Memory MIMD computers:
  - Cross Bar Switch: click here
  - The Delta Multi-stage Interconnection Network (MIN): click here
  - The Omega Multi-stage Interconnection Network: click here
- Interconnecting Message-Passing MIMD computers: click here
Programming Shared Memory MIMD using posix threads:
- Introduction to parallel programming: click here
- Introduction to threads: click here
- Creating posix-threads: click here
- A commonly used parallel program structure: click here
- Synchronization among threads: click here
- Further reading:
  - POSIX Thread Programming - LLNL: click here
  - Getting Started with POSIX Threads (online book): click here
  - I have downloaded an e-book on PThread Primer (online book): click here
Programming Shared Memory MIMD using OpenMP:
- The OpenMP API for C/C++: click here
- The OpenMP API for Fortran: click here
Programming Message-Passing MIMD using MPI:
- Algorithms on Message Passing MIMD: click here
- Programming Message Passing MIMD - MPI for C/C++:
  - Intro to MPI: click here
  - Blocking send and receive operations: click here
  - NON-Blocking send and receive operations: click here
  - Group communication - broadcast, scatter, reduce and gather operations: click here
- Programming Message Passing MIMD - MPI for Fortran
  - Intro to MPI: click here