Parallel Computing II

The catalog description of Parallel Computing II says: Parallel Computing II is a study of the principal trends in parallel algorithm design, through the analysis of algorithms used in various areas of application. Specific techniques that have gained widespread acceptance will be highlighted. The course will investigate the interplay between architecture and algorithmic structure and will discuss the effect that these issues have on the complexity and efficiency of parallel algorithms.

However, the course has been evolving and will be a collaborative learning effort that will focus on topics decided by the class as a whole. The programming assignments will focus on applying the techniques discussed in Parallel Computing I to current research efforts, some of these interdisciplinary in nature.

Table of Contents

• Syllabus
• Computing Facilities
• Keeping Up
• Assignments
• General Documentation
• Programming Assignment 1
• Programming Assignment 2
• Research Report Session
• Supplemental Course Evaluation Questions

Syllabus -- 20033

Keeping Up (736 only)

Computing Facilities

Assignments -- 20033

• General Documentation
  • Sun Online Documentation (Sun HPC ClusterTools 5 Collection)
  • Sun Perfomance Library User's Guide
  • Sun Online Documentation (Forte Developer 7 Collection)
  • file:///usr/local/Forte7/SUNWspro/prod/lib/locale/C/html/index.html - Forte(TM) Developer 7 Documentation Index
    (NOTE: You will need to be on a CS RIT machine to get to this. You may need to use your browser's Open file... menu selection)
  • Sun Perfomance Library User's Guide - Forte Developer 7

• Programming Assignment 1    (FAQ's) ( /usr/local/pub/ncs/parallel/Anhinga) (gradesheet)

  Supplementary Materials

  M2MI Information (The Anhinga Project)
  M2MI Javadoc
  Prof. Kaminsky's lecture notes Many-to-Many Invocation as an Object Oriented Paradigm for Parallel Programs
  Prof. Kaminsky's lecture notes OOPP: Object Oriented Parallel Programming with Java and M2MI (The one he did last quarter for us!)
  Source files for Prof. Kaminsky's example programs (directories particles, test, slides, and chat)

  Profiling OpenMP using GuideView directory

• Programming Assignment 2    (FAQ's) (gradesheet Part 1) (gradesheet Part 2) (final gradesheet)

  Supplementary Materials

  Profiling Information Sources

  • CONTIN To Do Lists and Status
  • Tasks and Timeline
  • Output specs
  • Initial data values

  • CONTIN developer pages

  • CONTIN source code, as a single file and split into separate routines
  • Auxiliary code snippets
  • MPIFortranExamples
  • A partial Xlist including the call tree for contin
  • A list of CONTIN routines, their locations and purpose
  • A listing of three CONTIN input routines

  • Intro to MPI (Dartmouth - references FORTRAN and C differences)
  • Fortran versus C with MPI (Appalachian State)
  • Multiprocessing by Message Passing MPI (A tutorial from BU that includes Fortran examples)
  • (IBM) MPI Programming Guide (look for Fortran in the titles)

  • CONTIN Test Cases
  • Image Files
  • Nan's Timing Excel file

  • Fortran 90 User's Guide
  • Fortran Programmer's Guide (F77 and F90)

  • (The Forte 7) Fortran Programming Guide
  • (The Forte 7) Fortran User's Guide
  • (The Forte 7) Fortran Library Reference
  • (The Forte 7) Fortran 95 Interval Arithmetic Programming Reference

Research Report Session

In the computer science and information technology recommended databases - just a few selected items, i.e., there's much more....

From IEEE Xplore

• Journals
  • IEEE - Computer (Search on parallel)
  • IEEE - Concurrency
  • IEEE - IEEE Parallel & Distributed Technology: Systems & Applications
  • IEEE - Parallel and Distributed Systems, IEEE Transactions on
• Proceedings
  • Advances in Parallel and Distributed Computing, 1997. Proceedings
  • Advances in Parallel and Distributed Systems, 1993., Proceedings of the IEEE Workshop on
  • Algorithms and Architectures for Parallel Processing, 1995 - 2002.
  • Databases in Parallel and Distributed Systems, 1988, 1990.
  • Databases, Parallel Architectures and Their Applications,. PARBASE-90, International Conference on
  • Design and Application of Parallel Digital Processors, 1988, 1991.
  • Fault-Tolerant Parallel and Distributed Systems, 1994., Proceedings of IEEE Workshop on
  • Frontiers of Massively Parallel Computation, 1988 - 1999.
  • High Performance Applications of Parallel Architectures, IEE Colloquium on
  • High-Level Parallel Programming Models and Supportive Environments, 1998. Proceedings. Third International Workshop on
  • Massively Parallel Computing Systems, 1994., Proceedings of the First International Conference on
  • Massively Parallel Processing Using Optical Interconnections, 1994 - 1997.
  • Massively Parallel Processing, 1992, 1998.
  • Massively Parallel Programming Models, 1997. Proceedings. Third Working Conference on
  • Medical Imaging: Transduction and Parallel Processing, IEE Colloquium on
  • Parallel Algorithms/Architecture Synthesis, 1995, 1997.
  • Parallel and Distributed Information Systems, 1991 - 1996.
  • Parallel and Distributed Processing Symposium, 1990 - 2002.
  • Parallel and Distributed Real-Time Systems, 1994 - 1997.
  • Parallel and Distributed Simulation, 1995 - 2002.
  • Parallel and Distributed Systems, 1994 - 2002.
  • Parallel and Large-Data Visualization and Graphics, 2001. Proceedings. IEEE 2001 Symposium on
  • Parallel Architectures and Compilation Techniques, 1996 - 2002.
  • Parallel Architectures for Image Processing Applications, IEE Colloquium on
  • Parallel Architectures for Image Processing, IEE Colloquium on
  • Parallel Architectures, Algorithms and Networks, 1994 - 2002.
  • Parallel Computing in Electrical Engineering, 2000, 2002.
  • Parallel Interconnects, 1999. (PI '99) Proceedings. The 6th International Conference on
  • Parallel Operation of Generating Plant within a Public Electricity Supply Network, IEE Colloquium on
  • Parallel Processing in Control - the Transputer and Other Architectures, IEE Colloquium on
  • Parallel Processing Symposium, 1991 - 1998.
  • Parallel Processing Workshops, 2001, 2002.
  • Parallel Processing, 1996 - 2002.
  • Parallel Processing: Industrial and Scientific Applications, IEE Colloquium on
  • Parallel Rendering Symposium, 1993
  • Parallel Rendering, 1997. PRS 97. Proceedings. IEEE Symposium on
  • Parallel Techniques for Information Retrieval, IEE Colloquium on
  • Parallel Visualization and Graphics Symposium, 1999. Proceedings. 1999 IEEE
  • Parallel, Distributed and Network-based Processing, 2002, 2003.
  • Practical Applications of Parallel Signal Processing, IEE Colloquium on
  • Programming Models for Massively Parallel Computers, 1993, 1995.
  • Recent Advances in Parallel Processing for Control, IEE Colloquium on
  • Scalable Parallel Libraries Conference, 1993, 1994.
  • Software Engineering for Parallel and Distributed Systems, 1997 - 2000.
  • VLSI for Parallel Processing, IEE Colloquium on

• Journals - Search on Parallel
• Magazines - Search on Parallel
• Transactions - Search on Parallel
• Proceedings
  • DPDS: International Symposium on Databases for Parallel and Distributed Systems
  • IOPADS: Workshop on I/O in Parallel and Distributed Systems
  • PADS: Workshop on Parallel and Distributed Simulation
  • PASCO: International Symposium on Parallel Symbolic Computation
  • PPEALS: Symposium on Principles and Practice of Parallel Programming
  • PPoPP: Principles and Practice of Parallel Programming
  • PRS: Parallel Rendering Symposium
  • PVG: Parallel and large-data visualization and graphics
  • SPAA: ACM Symposium on Parallel Algorithms and Architectures
  • SPDT: Symposium on Parallel and Distributed Tools
  • WPDD: Workshop on Parallel & Distributed Debugging

• Solutions to Parallel and Distributed Computing Problems: Lessons from Biological Sciences
• Advances in Distributed and Parallel Knowledge Discovery
• Oracle Parallel Server and Windows 2000 Advanced Server

Supplemental Course Evaluation Questions

Computer Science Department Policy on Academic Dishonesty

Those who behave in a dishonest or unethical manner in computer science courses, or in their dealings with the Computer Science Department, are subject to disciplinary action. In particular, dishonest or unethical behavior in the execution of assigned work in a computer science course will be treated as follows:

1. For a first offense the student involved will receive a grade of zero on the assignment.
   [A stronger penalty may be exacted if, in the judgement of the instructor, the offense involves a flagrant violation of basic ethical standards.]
2. For a second offense, in the same or a different course, the student will receive a failing grade for that course.
3. A third offense will be referred to judicial affairs.

Furthermore, the following action will be taken for each person involved in the incident, whether currently enrolled in the course or not:

If the student is a computer science major, a letter recording the incident will be placed in the student's departmental file; otherwise, the letter will be forwarded to the student's department chair or program coordinator.

Nan Schaller - Courses Page