THE UNIVERSITY of EDINBURGH

DEGREE REGULATIONS & PROGRAMMES OF STUDY 2023/2024

Timetable information in the Course Catalogue may be subject to change.

University Homepage
DRPS Homepage
DRPS Search
DRPS Contact
DRPS : Course Catalogue : School of Informatics : Informatics

Postgraduate Course: Reinforcement Learning (UG) (INFR11236)

Course Outline
SchoolSchool of Informatics CollegeCollege of Science and Engineering
Credit level (Normal year taken)SCQF Level 11 (Postgraduate) AvailabilityAvailable to all students
SCQF Credits10 ECTS Credits5
SummaryThis course follows the delivery and assessment of Reinforcement Learning (INFR11010) exactly. Undergraduate students must register for this course, while MSc students must register for INFR11010 instead.
Course description This course follows the delivery and assessment of Reinforcement Learning (INFR11010) exactly. Undergraduate students must register for this course, while MSc students must register for INFR11010 instead.
Entry Requirements (not applicable to Visiting Students)
Pre-requisites Co-requisites It is RECOMMENDED that students also take ( Machine Learning Practical (INFR11132) OR Machine Learning Practical (UG) (INFR11223)) OR ( Machine Learning (INFR10086) OR Applied Machine Learning (INFR11211)) OR ( Probabilistic Modelling and Reasoning (INFR11134) OR Probabilistic Modelling and Reasoning (UG) (INFR11235))
Prohibited Combinations Students MUST NOT also be taking Reinforcement Learning (INFR11010)
Other requirements This course follows the delivery and assessment of Reinforcement Learning (INFR11010) exactly. Undergraduate students must register for this course, while MSc students must register for INFR11010 instead.

This course is open to all Informatics students including those on joint degrees. For external students where this course is not listed in your DPT, please seek special permission from the course organiser.

Mathematical background: at the level of undergraduate informatics, particularly linear algebra, multivariate calculus, probability theory, and statistics

Good understanding of Python programming, familiarity with the scientific package NumPy. Familiarity with PyTorch is helpful.
Information for Visiting Students
Pre-requisitesAs above.
High Demand Course? Yes
Course Delivery Information
Academic year 2023/24, Available to all students (SV1) Quota:  None
Course Start Semester 2
Course Start Date 15/01/2024
Timetable Timetable
Learning and Teaching activities (Further Info) Total Hours: 100 ( Lecture Hours 20, Seminar/Tutorial Hours 8, Summative Assessment Hours 2, Programme Level Learning and Teaching Hours 2, Directed Learning and Independent Learning Hours 68 )
Assessment (Further Info) Written Exam 50 %, Coursework 50 %, Practical Exam 0 %
Additional Information (Assessment) Exam 50%
Coursework 50%
Feedback Not entered
Exam Information
Exam Diet Paper Name Hours & Minutes
Main Exam Diet S2 (April/May)Reinforcement Learning (UG) (INFR11236)2:00
Learning Outcomes
On completion of this course, the student will be able to:
  1. gain knowledge of basic and advanced reinforcement learning techniques
  2. identify suitable learning tasks to which these learning techniques can be applied
  3. appreciate the current limitations of reinforcement learning techniques
  4. gain an ability to formulate decision problems, set up and run computational experiments, evaluation of results from experiments
Reading List
Reinforcement Learning: An Introduction (second edition). R. Sutton and A. Barto. MIT Press, 2018
Algorithms for Reinforcement Learning. C. Szepesvari. Morgan and Claypool Publishers, 2010
Reinforcement Learning: State-of-the-Art. M. Wiering and M. van Otterlo. Springer, 2012
Additional Information
Graduate Attributes and Skills Not entered
Keywordsartificial intelligence,machine learning,reinforcement learning
Contacts
Course organiserDr Stefano Albrecht
Tel: (0131 6)51 3218
Email: s.albrecht@ed.ac.uk
Course secretaryMs Lindsay Seal
Tel: (0131 6)50 2701
Email: lindsay.seal@ed.ac.uk
Navigation
Help & Information
Home
Introduction
Glossary
Search DPTs and Courses
Regulations
Regulations
Degree Programmes
Introduction
Browse DPTs
Courses
Introduction
Humanities and Social Science
Science and Engineering
Medicine and Veterinary Medicine
Other Information
Combined Course Timetable
Prospectuses
Important Information