Title page
Contents
1. Overview of TALIS 2018 9
1.1. Introduction 9
1.2. What TALIS Measures 9
1.3. TALIS 2018 Administration 11
1.4. Organization of This Document 12
2. Sampling 13
2.1. International Requirements 14
2.2. School Sampling in the United States 15
2.2.1. School Sampling Frame 16
2.2.2. Stratification 16
2.2.3. School Sample 18
2.2.3.a. Measure of Size 18
2.2.3.b. Tabulations Within Subgroups for Frame and Sample 19
2.2.3.c. Substitute Schools 20
2.3. Teacher Sampling in the United States 21
3. School and Teacher Recruitment 23
3.1. Overview 23
3.2. Recruitment Training 24
3.3. Recruitment of Schools 25
3.3.1. Contacting States, Districts, and Schools 26
3.3.1.a. State Contact 26
3.3.1.b. District Contact 26
3.3.1.c. Special Handling Districts 27
3.3.1.d. Initial School Contact 27
3.3.2. Reasons for School Refusal to Participate 27
3.3.3. Solutions and Approaches Used With Refusing Schools 28
3.3.4. Final Results of School Recruitment 29
3.4. Principal and Teacher Recruitment 30
4. Instrument Development and Distribution 32
4.1. Instrument Design 32
4.2. Survey Materials Development 32
4.3. Preparation of Instruments 33
4.4. Distribution of Materials to Respondents 34
5. Field Operations 35
5.1. Presurvey Contacts With School Staff 35
5.2. Preparing Teacher Lists and Within-School Sampling 37
5.3. Data Collection Approach and Activities 37
5.4. Quality Monitoring 38
6. Response Rates 40
6.1. School Participation 41
6.2. Teacher Participation 41
7. Data Processing and Weighting 43
7.1. Data Entry and Verification 43
7.2. Data File Cleaning and Editing 44
7.3. Interim Data Products and the International Database 45
7.4. Weighting and Sampling Errors 46
7.4.1. School Weights 46
7.4.2. Teacher Weights 47
7.5. Sampling Error with Balanced Repeated Replication (BRR) 48
8. U.S. TALIS 2018 Data 49
8.1. U.S. International Datasets 50
8.2. U.S. National Data Files 50
8.3. U.S. National Variables 52
8.4. Variable Names 56
8.4.1. Identification and Administrative Variables 56
8.4.2. Naming conventions for variables 57
8.4.3. Specific Naming Conventions for U.S. Adapted or Added Questions 57
8.5. U.S. National Restricted-Use Variables 58
9. Using the TALIS 2018 Data Files 59
9.1. Special Considerations-Replicate Weights 59
9.2. Merging Principal and Teacher Data 61
9.3. Nonresponse Bias 61
References 62
Appendix A. TALIS 2018 School Recruiting Materials 63
Appendix B. Agencies Endorsing TALIS 2018 86
Appendix C. TALIS 2018 Questionnaire Adaptations 87
Appendix D. TALIS 2018 Nonresponse Bias Analysis Report 135
Table 1. Number and percentage of students and schools included in the TALIS U.S. school sampling frame, by school control: 2018 17
Table 2. Number and percentage of students and schools included in the TALIS U.S. school sampling frame, by grade structure: 2018 17
Table 3. Number and percentage of students and schools included in the TALIS U.S. school sampling frame, by school control and grade structure: 2018 18
Table 4. Number and percentage of students and schools included in the TALIS U.S. school sample, by school control: 2018 19
Table 5. Number and percentage of students and schools included in the TALIS U.S. school sample, by grade structure: 2018 19
Table 6. Number and percentage of students and schools included in the TALIS U.S. school sample, by school control and grade structure: 2018 20
Table 7. Summary of U.S. TALIS school recruitment activities: 2018 24
Table 8. TALIS 2018 schools, by recruitment status 30
Table 9. E-mail reminder and contact plan for TALIS: 2018 37
Table 10. TALIS teacher response in U.S. schools by month: 2018 38
Table 11. TALIS schools, by participation status of principals: 2018 41
Table 12. TALIS schools, by participation status of teachers: 2018 42
Table 13. Changes made to U.S. principal questionnaire 53
Table 14. Changes made to U.S. teacher questionnaire 54
Figure 1. TALIS 2018 original and total school participation, by week: 2018 29
Exhibits
Exhibit 1. Teacher Tracking Form 22
Table D-1. Selected characteristics for the nonresponse bias analysis of the U.S. TALIS final school sample: 2018 136
Table D-2. Percentage distribution of eligible and participating schools in the U.S. TALIS original sample, by school characteristic: 2018 143
Table D-3. Mean values of various characteristics for eligible and participating schools in the U.S. TALIS original sample: 2018 145
Table D-4. Mean percentage of students eligible for free or reduced-price lunch, in eligible and participating public schools in the U.S. TALIS original sample: 2018 145
Table D-5a. Logistic regression model parameters (with six race/ethnicity variables) using the U.S. TALIS original school sample: 2018 147
Table D-5b. Logistic regression model parameters (with summed race/ethnicity percentage) using the U.S. TALIS original school sample: 2018 148
Table D-5c. Logistic regression model parameters (with summed race/ethnicity percentage) using the U.S. TALIS original public school sample: 2018 149
Table D-6. Percentage distribution of eligible and participating schools in the U.S. TALIS final sample, by school characteristic: 2018 151
Table D-7. Mean values of various characteristics for eligible and participating schools in the U.S. TALIS final sample: 2018 152
Table D-8. Mean percentage of students eligible for free or reduced-price lunch, in eligible and participating public schools in the U.S. TALIS final sample: 2018 153
Table D-9a. Logistic regression model parameters (with six race/ethnicity variables) using the U.S. TALIS final school sample: 2018 155
Table D-9b. Logistic regression model parameters (with summed race/ethnicity percentage) using the U.S. TALIS final school sample: 2018 156
Table D-9c. Logistic regression model parameters (with summed race/ethnicity percentage) using the U.S. TALIS final public school sample: 2018 157
Table D-10. Percentage distribution of eligible and participating schools in the U.S. TALIS nonresponse-adjusted sample, by school characteristic: 2018 159
Table D-11. Mean values of various characteristics for eligible and participating schools in the U.S. TALIS nonresponse-adjusted sample: 2018 160
Table D-12. Mean percentage of students eligible for free or reduced-price lunch, in eligible and participating public schools in the U.S. TALIS nonresponse-adjusted sample: 2018 161
Table D-13. Characteristics with p values less than 0.05 and absolute relative bias greater than 10 percent, U.S. TALIS schools: 2018 163
Appendix Exhibits
Exhibit A-1. Council of Chief State School Officer (CCSSO) Advance Letter 64
Exhibit A-2. TALIS 2018 School District Advanced Letter 65
Exhibit A-3. TALIS 2018 School Advance Letter 66
Exhibit A-4. TALIS 2018 Private School Advance Letter 67
Exhibit A-5. TALIS 2018 Public School study brochure and schedule of activities 68
Exhibit A-6. TALIS 2018 Public School FAQs 72
Exhibit A-7. TALIS 2018 Public School Teacher FAQs 74
Exhibit A-8. TALIS 2018 Private School study brochure and schedule of activities 76
Exhibit A-9. TALIS 2018 Private School FAQs 80
Exhibit A-10. TALIS 2018 Private School Teacher FAQs 82
Exhibit A-11. TALIS 2018 Teacher Invitation 84
Exhibit A-12. TALIS 2018 Principal Invitation 85
Exhibit C-1. Principal Questionnaire: Questions that required national adaptations 88
Exhibit C-2. Teacher Questionnaire: Questions that require national adaptations 105