Undergraduate Course: Stochastic Modelling (MATH10007)
Course Outline
| School | School of Mathematics |
College | College of Science and Engineering |
| Credit level (Normal year taken) | SCQF Level 10 (Year 3 Undergraduate) |
Availability | Available to all students |
| SCQF Credits | 10 |
ECTS Credits | 5 |
| Summary | Core course for Honours Degrees involving Statistics; optional course for Honours degrees involving Mathematics.
Syllabus summary: Probability review: Conditional probability, basic definition of stochastic processes. Discrete-time Markov chains: Modelling of real life systems as Markov chains, transient behaviour, limiting behaviour and classification of states, first passage and recurrence times, absorption problems, ergodic theorems, Markov chains with costs and rewards, reversibility. Poisson processes: Exponential distribution, counting processes, alternative definitions of Poisson processes, splitting, superposition and uniform order statistics properties, non-homogeneous Poisson processes. Continuous-time Markov chains: transient behaviour, limiting behaviour and classification of states in continuous time, ergodicity, basic queueing models. |
| Course description |
Markov Chains in discrete time: classification of states, first passage and recurrence times, absorption problems, stationary and limiting distributions.
Markov Processes in continuous time: Poisson processes, birth-death processes.
The Q matrix, forward and backward differential equations, imbedded Markov Chain, stationary distribution.
|
Information for Visiting Students
| Pre-requisites | None |
Course Delivery Information
|
| Academic year 2014/15, Available to all students (SV1)
|
Quota: None |
| Course Start |
Semester 2 |
Timetable |
Timetable |
| Learning and Teaching activities (Further Info) |
Total Hours:
100
(
Lecture Hours 22,
Seminar/Tutorial Hours 5,
Summative Assessment Hours 2,
Programme Level Learning and Teaching Hours 2,
Directed Learning and Independent Learning Hours
69 )
|
| Assessment (Further Info) |
Written Exam
95 %,
Coursework
5 %,
Practical Exam
0 %
|
| Additional Information (Assessment) |
Coursework 5%, Examination 95% |
| Feedback |
Not entered |
| Exam Information |
| Exam Diet |
Paper Name |
Hours & Minutes |
|
| Main Exam Diet S2 (April/May) | Stochastic Modelling (MATH10007) | 2:00 | |
Learning Outcomes
1. Basic understanding of stochastic processes and their characterization
2. Ability to analyze the transient behaviour of Markov chains
3. Ability to classify states of a Markov chain
4. Understanding stationary and limiting behaviour and deriving these probability distributions
5. Ability to calculate the finite dimensional distributions of Poisson processes
6. Appreciating the range of applications, together with a facility to model appropriate problems in terms of a stochastic process
|
Reading List
| http://www.readinglists.co.uk |
Contacts
| Course organiser | Dr Tibor Antal
Tel: (0131 6)51 7672
Email: Tibor.Antal@ed.ac.uk |
Course secretary | Mrs Kathryn Mcphail
Tel: (0131 6)50 4885
Email: k.mcphail@ed.ac.uk |
|
© Copyright 2014 The University of Edinburgh - 12 January 2015 4:21 am
|
University Homepage