Title page
Contents
Why this study? 3
Research questions 5
Findings 8
Limitations 14
Implications 15
References 16
Appendix A. About the study 18
Appendix B. Methods 19
Appendix C. Supporting analysis 30
Appendix D. Nonresponse bias analysis 43
Appendix E. Principal effect interpretations 60
Figure 1. For all Insight domains and two Panorama domains (Perseverance and Professional Learning about SEL), interquartile ranges for the fraction of teachers in each school... 10
Figure 2. The year-to-year correlations for Insight domains are typically higher when schools do not experience a principal transition than when they do, particularly for Leadership... 11
Figure 3. The principal effects on the Insight domains are larger than the principal effects on proficiency rates in English language arts and math in the first years of a principal's... 12
Boxes
Box 1. Key terms 4
Box 2. Data sources, sample, and methods 7
Table B.1. Data elements used for principal evaluation and school characteristics (2015/16 to 2018/19) 23
Table B.2. Description of samples used for each research question and analysis 24
Table B.3. Principal transitions from 2015/16 to 2018/19 26
Table B.4. Characteristics of principals who transitioned schools (2015/16 to 2018/19) 27
Table B.5. Characteristics of schools with leadership transitions (2015/16 to 2018/19) 27
Table C.1. Intraclass correlations (2017/18, 2018/19) 30
Table C.2. School-level rates of favorable responses on the Insight teacher survey (2018/19) 31
Table C.3. School-level rates of favorable responses on the Panorama teacher survey (2018/19) 34
Table C.4. Year-to-year correlations for adjacent years in which schools did not experience a principal transition and did experience a principal transition (2015/16 to 2018/19) 37
Table C.5. Principal effects on teacher survey measures (2015/16 to 2018/19) 38
Table C.6. Correlations between staff surveys and principals' total IMPACT score (2015/16 to 2018/19) 39
Table C.7. Correlations between staff surveys and principals' IMPACT subscores (2015/16 to 2018/19) 40
Table C.8. Correlations between staff surveys and principals' Leadership Framework subscores (2018/19) 41
Table C.9. Correlations between Insight and Panorama (2017/18 and 2018/19) 42
Table D.1. Panorama teacher survey response rates (2017/18, 2018/19) 44
Table D.2. Insight teacher survey response rates (2017/18, 2018/19) 45
Table D.3. Insight teacher survey response rates (2015/16, 2016/17) 46
Table D.4. Differences between Insight respondents and the eligible sample of teachers (2017/18, 2018/19) 47
Table D.5. Differences between Panorama respondents and the eligible sample of teachers (2017/18, 2018/19) 48
Table D.6. Correlations between teacher characteristics and Insight domains (2017/18, 2018/19) 49
Table D.7. Correlations between teacher characteristics and Panorama survey scales (2017/18, 2018/19) 50
Table D.8. School-level rates of favorable responses on the Insight teacher survey with nonresponse weights applied (2018/19) 51
Table D.9. School-level rates of favorable responses on the Panorama teacher survey with nonresponse weights applied (2018/19) 51
Table D.10. Year-to-year correlations for Insight for adjacent years in which schools did not experience a principal transition and did experience a principal transition with nonresponse... 52
Table D.11. Year-to-year correlations for Panorama for adjacent years in which schools did not experience a principal transition and did experience a principal transition with nonresponse... 53
Table D.12. Principal effects on teacher survey measures (2017/18 to 2018/19) 54
Table D.13. Correlations between Insight domains and principals' total IMPACT score with nonresponse weights applied (2017/18 to 2018/19) 55
Table D.14. Correlations between Panorama scales and principals' total School Leader IMPACT score with nonresponse weights applied (2017/18 to 2018/19) 55
Table D.15. Correlations between Insight domains and principals' IMPACT subscores with nonresponse weights applied (2017/18 to 2018/19) 56
Table D.16. Correlations between Panorama scales and principals' IMPACT subscores with nonresponse weights applied (2017/18 to 2018/19) 57
Table D.17. Correlations between Insight domains and principals' Leadership Framework subscores with nonresponse weights applied (2018/19) 58
Table D.18. Correlations between Panorama scales and principals' Leadership Framework subscores with nonresponse weights applied (2018/19) 59
Table E.1. Principal effect interpretations (2015/16 to 2018/19) 60