THE UNIVERSITY of EDINBURGH

DEGREE REGULATIONS & PROGRAMMES OF STUDY 2005/2006
- ARCHIVE for reference only
THIS PAGE IS OUT OF DATE

University Homepage
DRPS Homepage
DRPS Search
DRPS Contact
Home : College of Science and Engineering : School of Informatics (Schedule O) : Artificial Intelligence

Reinforcement Learning (P00881)

? Credit Points : 10  ? SCQF Level : 11  ? Acronym : INF-P-RL

This module covers a range of adaptive learning systems, in particular reinforcement learning and unsupervised methods, particularly as used in RL systems. By the end of the module the student should have a grasp of modern learning techniques and the issues involved in dealing with real-world data. The main techniques covered in the course are basic reinforcement learning, dynamic programming, Monte Carlo methods, Q-learning, function approximation, unsupervised and constructive methods, radial basis and other local functions, classifier systems as compared to RL systems.

Entry Requirements

? Pre-requisites : PGs only or with permission of Director of Teaching.

Subject Areas

Delivery Information

? Normal year taken : Postgraduate

? Delivery Period : Semester 2 (Blocks 3-4)

? Contact Teaching Time : 2 hour(s) per week for 10 weeks

First Class Information

Date Start End Room Area Additional Information
09/01/2006 12:00 13:00 Lecture Room 3218, JCMB KB

All of the following classes

Type Day Start End Area
Lecture Monday 12:10 13:00 KB
Lecture Thursday 12:10 13:00 KB

Summary of Intended Learning Outcomes

-Knowledge of basic and advanced reinforcement learning techniques.
-Insight into the problems involved in applying these techniques to deal with real world data, and how to overcome those problems.
-Appreciation and identification of suitable learning tasks to which these learning techniques can be applied
-Ability to evaluate how effective a particular learning procedure has been -- internal indicators of learning success vs. actual behaviour of the learner.
-Use and writing of Matlab programs, ability to set up and run computational experiments to produce statistically sound results
-Formulation of problems, evaluation of results from the student's own experiments and those presented in some cases in the research literature.

Assessment Information

Written Examination 80%
Assessed Assignments 20%

Exam times

Diet Diet Month Paper Code Paper Name Length
1ST May 1 - 1 hour(s) 45 minutes

Contact and Further Information

The Course Secretary should be the first point of contact for all enquiries.

Course Secretary

Miss Gillian Watt
Tel : (0131 6)50 5194
Email : gwatt@inf.ed.ac.uk

Course Organiser

Dr Douglas Armstrong
Tel : (0131 6)50 4492
Email : Douglas.Armstrong@ed.ac.uk

Course Website : http://www.inf.ed.ac.uk/teaching/courses/

School Website : http://www.informatics.ed.ac.uk/

College Website : http://www.scieng.ed.ac.uk/

Navigation
Help & Information
Home
Introduction
Glossary
Search
Regulations
Regulations
Degree Programmes
Introduction
Browse DPTs
Courses
Introduction
Humanities and Social Science
Science and Engineering
Medicine and Veterinary Medicine
Other Information
Prospectuses
Important Information
Timetab
 
copyright 2005 The University of Edinburgh