Progress with HELGA: Can it provide a sector measure of learning gain? - James Zuccollo and Hannah White
•
0 likes•693 views
Progress with HELGA: Can it provide a sector measure of learning gain? - James Zuccollo and Hannah White
Report
Share
Progress with HELGA: Can it provide a sector measure of learning gain? - James Zuccollo and Hannah White
- 1. Progress with HELGA: can it provide a sector measure of Learning Gain? James Zuccollo Hannah White Senior Economist Analyst Learning Gain National Conference, Birmingham Wednesday 7th February 2018 Follow us on Twitter at #name
- 2. Context Learning Gain activities • Pilot projects – a range of bespoke/sector-wide approaches to measuring/assessing learning gain predominantly at institution level • NMMLGP – working with 10 institutions to test the application of a sector-wide learning gain survey instrument • HELGA – complimentary activity seeking to explore whether administrative data can provide a low burden approach to a Learning Gain proxy which will allow for institutional comparisons • Expert group – have met twice to discuss HELGA principles and direction
- 3. What is HELGA? Investigating the trade-off between burden and validity through: • Start and end points in existing administrative data • Methods for making comparisons across institutions/departments
- 4. Data Our linked dataset pulls on data from: • 2009 UCAS records (1.6 million offer records) • 2009/10 HESA student data (117,000 individuals) • 2009 NPD data (665,000 individuals) • 444,000 linked offer records
- 5. Summary of linked data Variable name Category Student characteristics Institution (attended) University of Poppelton Ethnicity White POLAR 5 Sex Male … Prior attainment A-level grades AAB Tariff point score 340 GCSE results English - A* Maths - A*… Subject area of qualification Psychology, Maths, Economics Offer information Institution (applied to) University of Poppelton Offer Conditional/unconditional Acceptance Firm/Insurance Outcome information Degree class 2.1 DLHE 6 month employment Employed in Marketing, Advisor DLHE 6 month salary £15,000
- 6. Start points A number of initial skills level measures could be considered: • A-levels • Tariff points • GCSEs
- 7. End points
- 8. The HELGA methodology Students apply to universities Universities choose who to offer places to Students accept offers (based on offer criteria) Students attend an institution Students achieve a degree qualification Students enter employment and receive a salary Vertical selection Horizontal selection Skills value- added
- 9. Vertical selection Identify sets of students who are ‘similar’ in the eyes of the offer institution
- 10. Vertical selection Institution offer profiles – what did you guess?
- 12. Vertical selection All students in the linked data set Students given an offer from institution A With same prior attainment (similar in eyes of inst A) Those who attend Those who attend institution A another institution
- 13. The HELGA methodology Students apply to universities Universities choose who to offer places to Students accept offers (based on offer criteria) Students attend an institution Students achieve a degree qualification Students enter employment and receive a salary Vertical selection Horizontal selection Skills value- added
- 14. Horizontal selection Identify sets of institutions which are ‘similar’ in the eyes of the students All students in the linked data set Students given offers from institutions A and B where entrant mean tariff score is equal Those who attend Those who attend institution A institution B
- 15. Can we make value-added comparisons across the sector?
- 16. How reliable will the estimates be?
- 17. Next steps • Initial outputs soon • Testing against pilot project and NMMLGP data • Sensitivity testing will be vital given the small numbers • HELGA output vs multi-level models • Further advice from Expert group on initial output