Published on September 16, 2014
26/08/2014 1 Benchmarking eLearning Dayle Soong, eLearning Adviser Benchmarking eLearning This project will identify benchmarks and methods to measure performance in regard to eLearning at The University of Adelaide in order to inform planning and to report on change and improvement in the use of MyUnito the LTSG (Learning Technologies Strategy Group), LTOG (Learning Technologies Operations Group) and LTT (Learning Technologies Team). Usage Policy Strategy Engagement Support
26/08/2014 2 In the beginning… Sub CruceLumen: light under the Cross. Against the vast Australianskies the University of Adelaide shines as a beacon bright as theSouthern Cross: it illuminates new knowledge and is a lodestar ofenlightened learning for South Australia and the world. “ ” Internationally higher education is now being reshaped by globalisation and the digital revolution… (p5)
26/08/2014 3 We will reach out to a still broader student body • providing flexible learning and e-learning to meet new student needs(p6) students need confidence their learning will be better supported by digital learning resources. Where high- quality content can be effectively delivered online with demonstrable pedagogical integrity it will be, to free staff time for small-group discovery where the focus can shift to learning and problem solving.
26/08/2014 4 the University will treble its expenditure on IT learning support and e-learning, ˃Online learning is available in 100% of undergraduate programs ˃MyUniis actively used in 80% or all courses in all faculties ˃All lectures are recorded and available for download ˃We should provide an online delivery option for all student-focused administrative and transactional services, including learning administration services, such as the online submission of assignments. (from SeE) Operational Plan
26/08/2014 5 How will we know if we are realising the Beacon? What do we want to measure? What needs to be done to improve?
26/08/2014 6 Defined set of benchmarks and measures Usage •Content •Communication and collaboration •Assessment •Grade and monitor progress User Engagement •Distinct users •Frequency •Duration Support •Requests •Incidents •Resolution Strategy and Policy •ACODE benchmark 1 Getting the data SELECT * FROM [Users] WHERE [Clue] > 0 No records found.
26/08/2014 7 What data are we getting? MyMedia Data Description Example Record Column A MyUni Course ID associated with MyMedia sessions 3410_PSYCHOL_1000 Column B MyUni Course Description Psychology IA Column C Count of the available MyMedia Sessions (individual lecture recordings and any uploaded media items) associated with the Course ID 25 MyUni Data Description Example Record Course ID MyUni Course ID is a combination of the Term Code, Subject Area Code and Catalogue Number 3410_PSYCHOL_1000 Course Name The Course Name Psychology IA CourseDesc The course description. Useful to identify the 'child' courses in the COMBINED courses This course, together with PSYCHOL 1001, provides an introduction to the basic concepts and core… Discipline The Subject Area PSYCHOL Unit N.A. can be looked up from Peoplesoft data School N.A. can be looked up from Peoplesoft data Faculty N.A. can be looked up from Peoplesoft data Institution The University of Adelaide uofa PS Year Year the course ran measured by years after 1980 (for example, 34 refers to courses that are ran in year 2014) 34 Approx Level Year level of the course within its program. Derived from first digit of Catalogue Number. 1 Class Size Number of students enrolled in the course 687 Available Whether the course has been made available to students (Y = Yes, N = No) Y AllContent Count Count of content items contained in the course i.e. uploaded files or text/media items entered directly into MyUni 230 AvailableContent Count Count of content items which are available/visible to students 219 Pdf Count Count of all PDF files which are available/visible to students 93 PowerPoint Count Count of all PowerPoint files (.ppt/.pptx) which are available/visible to students 5 Word Doc Count Count of all Word files (.doc/.docx) which are available/visible to students 1 Image Count Count of all image files (added from Build Course -> Image) which are available/visible to students. Does not include count of images which are added as 'File' or 'Item'. 0 Audio Count Count of all audio files (added from Build Course -> Audio) which are available/visible to students. Does not include count of audio files which are added as 'File' or 'Item'. 0 Video Count Count of all video files (added from Build Course -> Video) which are available/visible to students. Does not include count of video files which are added as 'File' or 'Item'. 0 ExtLink Count Count of all web links (added from Build Course -> Web Link) which are available/visible to students. 2 SCORM Count of SCORM items (learning objects produced outside of MyUnithat are scormcompliant e.g. an Articulate presentation including a quiz that will interface with GradeCenter) 2 MyMedia PlaylistCount Count of links to MyMediaplaylist feeds (one feed is likely to contain many individual session recordings, but individual sessions are not counted here) 3 MyMedia SessionCount Count of links to MyMediasessions (added with Embed code) -this is NOT a count of the number of sessions recorded and available for this course 14 TLE Links to Online Content items managed by the DRMC (copyright journal articles and book chapters) Note: TLE (The Learning Edge) is now called Equella 0 Cal Count Semester Count of Calendar entries which has a start date within the current semester 0 Task Count Semester Count of Task entries which has a due date within the current semester 0
26/08/2014 8 Avail Announcement Count Count of Announcement which has a start date within the current semester 28 avail forum count Count of Discussion forums which are available/visible to students 0 Forum Post Count Count of posts in the available discussion forums (does NOT include Group discussion boards) 0 Forum Auth Count Count of distinct/unique authors in the posts (does NOT include Group discussion boards) 0 Blog Count Count of Blogs which are available/visible to students. Includes both Individual and Group blogs. 0 Blog Post Count Count of posts in the available blogs 0 Journal Count Count of Journals which are available/visible to students. Includes both Individual and Group journals. 0 Journal Post Count Count of posts in the available journals 0 Wiki Count Count of Wikis which are available/visible to students. Includes both Course and Group Wiki. 0 Collaborate Count Number of Blackboard Collaborate session that have been deployed in a course and availalble/visible to students 0 Group Count Count of Groups 5 Group Gt2 Count Count of Groups which has at more than 2 students. 5 Voice Podcast Count Count of Voice Podcaster which are available/visible to students 0 Voice Board Count Count of Voice Board which are available/visible to students 0 Voice Pres Count Count of Voice Presentation which are available/visible to students 0 Adaptive Rel Rule Count Count of Adaptive Release Rules 0 Assessment Count Count of MyUni Tests, Surveys and Mobile Compatible Test which are deployed in a course 6 Test Count Count of MyUniTests which are deployed in a course 6 Current Results
26/08/2014 11 Measure effectiveness of initiatives University of Adelaide 22
26/08/2014 12 Why? •Some areas have other LMSs •Some areas run courses with very low numbers of students •Some areas teach programs that do not align with PeopleSoft course codes •Some areas create courses for administration purposes •Some areas have different pedagogical approaches •Some areas teach in spaces without AV •Some areas ARE SPECIAL
26/08/2014 13 Recommendations from 2013 baseline report 1.Guidelines for minimum usage of MyUniare developed and proactively disseminated to and applied by staff. 2.Administration processes that create MyUnicourses should be examined in order to improve the accuracy of reporting. 3.Specific strategies should be employed in 2014 to increase utilisation of MyMedialecture recordings and eSubmissionof assignments to meet targets set by the Beacon of Enlightenment and Student e-Experience Strategy. 4.Consideration should be given to increasing support for browsers and devices that are most commonly used by staff and students. 5.The new Closure Code Matrix (refer to Appendix C) should be implemented in LANDesk and utilised by the new MyUniSupport Team to provide better information on support issues. 6.Policies are developed that specify the use of technologies to support learning and teaching covering all aspects and stakeholder perspectives. 7.Consideration should be given to undertaking a comprehensive ACODE or eLearning Maturity Model assessment in the future. 8.Combined or merged courses in MyUnishould have a clear identifier that enables the source courses and year levels to be automatically determined. 9.Reporting on eLearning performance should be sought from areas of the University who are using alternative tools and systems. 10.The Benchmarking eLearning project should be re- established in 2014 with the following objectives: –Automation of eLearning reporting mechanisms with the implementation of an integrated business intelligence reporting application; –Selection of a suitable benchmarking partner in order to compare our performance with our peers. eMM/ACODE •eLearning Maturity Model •Assess the institutions eLearning capability maturity using the eMMframework •Compare with other Australian Universities •Provide a visual representation of strengths and gaps •Identify strategies for improvement that will have the most impact
26/08/2014 14 The future… automated and systematic Data Warehouse MyUniand MyMedia
University of Adelaide forest DNA forensics research has ... The University is celebrating ... Research at Adelaide; Indigenous Education; Learning ...
The University of Adelaide has a long ... Learning is a distinctive, high quality experience ... Higher Education Research Group of Adelaide ...
benchmarking in higher education, ... Teaching and Learning. University Libraries ... Benchmarking University Perfomlance, ...
Benchmarking e-learning: ... Society for Research into Higher Education and Open University ... The Higher Education Academy benchmarking blog can be ...
Contact Us . Name * Organisation. ... the University of Adelaide, University of South Australia and Flinders ... Director, International and Higher Education:
The School of Education, in the Faculty of Humanities & Social Sciences at the University of Adelaide, ... educationalists who can lead learning across ...
Learning in Adelaide is about choice. ... University Pathways; Higher Education; Vocational; ... The University of Adelaide’s English Language Centre.
Learn about working at University of Adelaide. ... University of Adelaide Higher Education. 5001 ... has been amongst Australia's leading universities.
The University of Adelaide's Wine Business courses are without a doubt the benchmark ... Flexible Learning Options. The University of Adelaide ...
ACER’s global research expertise in the higher education ... universities and higher education ... Student learning and career outcomes; Benchmarking ...