Title Page
Copyright
Contents
Acknowledgements 7
The Authors 8
Summary 9
1. Introduction and background 17
1.1. Background to the study 17
1.2. The advantages of Iongitudinal research 19
1.3. Research objectives 21
1.4. Research approach 22
1.4.1. Conduct and analysis 24
1.5. Report structure 25
2. Establishing the requirements 27
2.1. Key research themes 27
2.1.1. Substantive areas 27
2.1.2. Research questions 28
2.2. Key grcujps 30
2.3. Gaps and limitations in existing data 32
2.3.1. Gaps 33
2.3.2. Limitations 34
2.4. Using the WPLS 35
2.5. Potential added value of a longitudinal survey 36
2.5.1. Replacing existing programme evaluation suveys 36
2.5.2. Filling knowledge gaps 37
2.5.3. Improving the usability of existing data 38
2.5.4. Providing an overall understanding of customer base and Department impact 39
2.5.5. Overlaps with Understanding Society 39
3. Meeting the requirements and key challenges 41
3.1. Key themes and customer groups for longitudinal study 41
3.2. Sample design and size 43
3.2.1. Sample maintenance 46
3.3. Questioning mode and question types 47
3.3.1. Mode of data collection 49
3.4. Frequency of data collection 49
3.5. Analysis and reporting 50
3.5.1. Analytical expertise 50
3.5.2. Representative sample analysis 51
3.5.3. Trajectory analysis 52
3.5.4. Paired-transitions analysis 52
3.5.5. Reporting 52
3.6. Practical issues 53
3.6.1. Budget 53
3.6.2. Data security 55
3.6.3. Data linkage 55
4. Next steps and recommendations 57
4.1. Could the proposed longitudinal survey add value? 57
4.1.1. Replacing existing programme evaluations 57
4.1.2. Filling knowledge gaps 58
4.1.3. Improving the usability of existing data 60
4.1.4. Providing an understanding of customer base and Department impact 60
4.1.5. Summary 61
4.2. Factors affecting the feasibility of the proposed survey 61
4.2.1. Overall research design 61
4.2.2. Cost 63
4.2.3. Managing the study 65
4.2.4. Managing expectations 66
4.2.5. Political change 67
4.3. Next steps for the Department 68
4.3.1. What budget is available for a given added value? 68
4.3.2. What could the longitudinal survey replace? 69
4.3.3. What groups could it feasibly cover? 69
4.3.4. Can a coherent set of questions be developed around behaviour and attitudes that is appropriate for the customer base? 70
4.3.5. Where would the survey be housed? 71
Appendix 73
Appendix A. Workshop 1 topic guide 73
Appendix B. Telephone interviews topic guide 77
Appendix C. Workshop 2 topic guide 79
Appendix D. Study participants 85
Appendix E. Interim report 87
Figure 1.1. Research approach 24
Figure 2.1. Departmental research questions 29
Figure 2.2. Key customer groups/sub-groups 30
Figure 2.3. Data available on others outcomes affecting and affected by employment outcomes 31