Performance Evaluation, Spring 2002
This is the current plan for course contents and schedule. This is the general "bulletin board" for the lecture course, and it is updated continuously during the semester. It is advisable to check this page periodically.There is currently no good text book for this course. We will use Lazowska et al [LZGS 84], which is old, comprehensive, and out-of-print. Fortunately, it is freely available in the Web.
Course material will be in English. Lectures and practice sessions will be also in English if there is demand for it. Spring 2002 course will be lectured in Finnish as there was no demand for English lectures.
General
- You get homework points (HWP) from homeworks and possibly from computer programs, one HWP from a normal homework, and more from a more difficult one. You get extra points affecting your grade linearly so that about 40% of the maximum HWP will give you 1 point, and about 90% will give you the maximum 10 points.
- The final grade is determined from the term exam (max 50 points) and from the above mentioned extra points from homeworks and computer programs (max 10 points). However, you must get at least 25 points from the exam to pass.
- The newsgroup for this course is hy.opiskelu.tktl.ska.
- Lecture notes will be available in the Web. They do not contain all material covered in class and they are not a replacement for the text book. Lecture notes are developed during the semester, and they may be updated at any time.
- Copies of all additional material, not in lecture notes but shown in lectures, are in course folder in room A412.
- Current status
of HWPs collected
(including the exam
results
) is available in WWW. If you do not want your status shown here or if
something is missing, please contact the instructor. Similarly, the course
results
are in the Web.
Lectures, Exam
Lectures | 6.3-18.4.2002 | Wed 12-14, Thu 14-16 | (A516) | Teemu Kerola |
Practice sessions | 13.3-25.4.2002 | Wed 14-16 | (A516) | Teemu Kerola |
Term exam (bring calculator) |
13.5.2002 | Mon 15-19 | (Sali 1, päärakennus) | Teemu Kerola |
Schedule and Contents
The contents given here is very preliminary, based on the course as it was 1998 and on the text book used at that time. It will likely change somewhat before March.
Lecture notes and homeworks will appear (I.e., links will activate) here in due course.
- Lecture 1 (6.3): Admin, Review Probability Theory and Statistics
- Slides le0: pdf b/w 2/page 6/page color 1/page, ps 2/page
- Slides le1: pdf b/w 2/page 6/page color 1/page, ps 2/page
- References: [Law Kelton 91, Ch 4]
- Lecture 2 (7.3): Performance Evaluation Process, Models and Metrics
- Slides le2: pdf b/w 2/page 6/page color 1/page, ps 2/page
- References: [LZGS 84, Ch 1]
- HW 1 (14.3)
- Lecture 3 (13.3): Capacity Planning Process
- Slides le3: pdf b/w 2/page 6/page color 1/page, ps 2/page
- References: [LZGS 84, Ch 1-2]
- Lecture 4 (14.3): Performance Evaluation Models
- Slides le4: pdf b/w 2/page 6/page color 1/page, ps 2/page
- References: [LZGS 84, Ch 4]
- HW 2 (20.3)
- Lecture 5 (20.3): Intuitive Solutions for Simple Models
- Slides le5: pdf b/w 2/page 6/page color 1/page, ps 2/page
- References: [Jain 91, Ch 31]
- Lecture 6 (21.3): Operational Analysis
- Slides le6: pdf b/w 2/page 6/page color 1/page, ps 2/page
- References: [Denning Buzen 78] [LZGS 84, Ch 3 & 5]
- HW 3 (27.3)
- Lecture 7 (27.3): Analytical Solution Methods for Complex Models
- Slides le7: pdf b/w 2/page 6/page color 1/page, ps 2/page
- References: [Jain 91, Ch 35; LZGS 84, Ch 6]
- Lecture 8 (4.4): MVA, Hierarchical Modeling, Solution Packages
- Slides le8: pdf b/w 2/page 6/page color 1/page, ps 2/page
- References: [LZGS 84, Ch 6, 8, 16]
- HW 4 (10.4)
- Lecture 9 (10.4): Multiclass Models, Approximate MVA
- Slides le9: pdf b/w 2/page 6/page color 1/page, ps 2/page
- References: [LZGS 84, Ch 7]
- Lecture 10 (11.4): Open Models
- Slides le10: pdf b/w 2/page 6/page color 1/page, ps 2/page
- References: [LZGS 84 Ch 6.4, 7.4] [Men 94 Ch 6.5, 6.6]
- HW 5 (17.4)
- Lecture 11 (17.4): Practical Examples with Specific Problems
- Slides le11: pdf b/w 2/page 6/page color 1/page, ps 2/page
- References: [LZGS 84 Ch 9]
- Lecture 12 (18.4): Parameter Estimation
- Slides le12: pdf b/w 2/page 6/page color 1/page, ps 2/page
- References: [Menasce 94, Ch 9-10]
- HW 6 (24.4)
References
- [LZGS 84] E.D. Lazowska, J. Zahorjan, G.S. Graham, and
K.C. Sevcik, Quantitative System Performance, Prentice-Hall, 1984.
Out of print, but freely available in WWW at
http://www.cs.washington.edu/homes/lazowska/qsp/ - [Law Kelton 91] A.M. Law, W.D. Kelton, Simulation, Modeling and Analysis, McGraw-Hill, 1991 (second edition).
- [Weicker 90] R.P. Weicker, An Overview of Common Benchmarks, IEEE Computer, December 1990, pp. 65-75.
- [Denning Buzen 78] P.J. Denning, J.P. Buzen, The Operational Analysis of Queueing Network Models, Computing Surveys 10, 3 (September 1978), pp. 225-261.
- [Brumfield 81] J. Brumfield, PMVA Purdue Mean Value
Analysis Program User's Guide, Dept of CS, Purdue University, West
Lafayette, Indiana, Tech. rep. CSD-TR-383 (April 1981), 24 p. (Hard copy in
A412)
The program is available for educational purposes from the instructor, and for commercial purposes directly from Jeff Brumfield (brumfield@cs.utexas.edu). - [Lazowska 80] E.D. Lazowska, The Use of Analytic Modelling in System Selection, in Conf. Proc. CMG XI, Dec 2-5, 1980, pp. 63-69.
- [Ferrari 78] D. Ferrari, Computer Systems Performance Evaluation, Prentice-Hall, 1978.
- [Jain 91] R. Jain, The
Art of Computer System Performance Analysis, Techniques for Experimental
Design, Measurement, Simulation and Modeling, Wiley, New York,
1991. Errata.
(Yliopistokirjakaupppa 11.2.2002, €135) - [Kant 92] Introduction to Computer System Performance Evaluation, McGraw-Hill, 1992. Out of print.
- [Menasce 94] D.A. Menasce, V.A.F. Almeida, L.W. Dowdy, Capacity Planning and Performance Modelling, Prentice Hall, 1994. Out of print.
- [Menasce 01], D.A. Menasce, V.A.F. Almeida, Capacity Planning for Web Services: metrics, models, and methods. Prentice Hall, 2001. Kirjan kotisivulla on linkki "Downloads", mistä löytyy Excel taulukko -muotoisia työkirjoja, joissa toteutettu erilaisien jonoverkkotyyppien analyyttisiä tai approksimatiivisia ratkaisuja. (Taulukoiden käyttö vaatii kirjasta Menasce 2001 löytyvän salasanan)
- [Chandy Neuse 82] K.M. Chandy, D. Neuse, Linearizer: A Heuristic Algorithm for Queueing Network Models of Computer Systems, Comm ACM 25, 2 (Feb 1982), p. 126-134.
- Table of Standard Normal Distribution (Dept of Math, Univ. of Huntsville, Alabama, US).
- Table of Student Distribution (Dept of Math, Univ. of Huntsville, Alabama, USA)
- Dhrystone benchmark
Teemu Kerola