Title page
Contents
Acknowledgments 3
Chapter 1. Overview of NPSAS:16 12
1.1. Background and Purpose 13
1.2. Overview of NPSAS:16 Study Design 13
1.3. Schedule and Products 14
Chapter 2. Sampling Design 16
2.1. Respondent Universe 16
2.2. Institution Sample 18
2.3. Student Sample 22
Chapter 3. Institution Data Collection Design, Outcomes, and Evaluation 30
3.1. Institution Data Collection Design and Systems 30
3.1.1. Institution Contacting System 30
3.1.2. Institution Website 30
3.1.3. Student Records Collection System 32
3.2. Institution Contacting, Recruitment, and Student Enrollment List Acquisition 33
3.2.1. Institution Contacting and Recruitment 33
3.2.2. Student Enrollment List Acquisition 36
3.2.3. Institution Recruitment and Student List Acquisition Outcomes 37
3.3. Student Records Data Collection 42
3.3.1. Student Records Collection From Institutions 42
3.3.2. Student Records Collection Outcomes 43
3.4. Institution Data Evaluation 44
3.4.1. Evaluation of Enrollment List Quality 45
3.4.2. Evaluation of Student Records Collection Activities and Data Quality 47
3.5. Institution Data Collection Conclusions 48
Chapter 4. Student Interview Design, Data Collection, Outcomes, and Evaluation 50
4.1. Student Interview Design and Systems 50
4.1.1. Survey Mode Administration 53
4.1.2. Coding Systems 53
4.1.3. Survey Design System 55
4.2. Student Interview Data Collection 55
4.2.1. Study Website 55
4.2.2. Training of Interview Data Collection Staff 56
4.2.3. Locating and Contacting Sample Members 58
4.2.4. Interviewing 61
4.3. Data Collection Quality Control 64
4.3.1. Interview Monitoring 65
4.3.2. Help Desk 65
4.3.3. Quality Circle Meetings 66
4.3.4. Debriefing 66
4.4 Student Interview Data Collection Outcomes 67
4.4.1. Student Locating Results 68
4.4.2. Student Interview Response Rates 72
4.4.3. Interview Timing Burden 77
4.4.4. Telephone Interviewer Hours 84
4.4.5. Number of Calls to Sample Members 85
4.4.6. Refusal Conversion 86
4.4.7. Potential B&B-eligible Sample Member Identification 87
4.5. Study Members 88
4.5.1. Responsive Design 90
4.6. Evaluation of Student Interview Items 96
4.6.1. Instrument Coders 96
4.6.2. Help Text 98
4.6.3. Conversion Text 101
4.6.4. Item-level Nonresponse 105
Chapter 5. Administrative Records Matching Overview and Outcomes 107
5.1. Administrative Records Matching 107
5.2. Administrative Records Matching Outcomes 109
Chapter 6. Data File Processing and Preparation 118
6.1. Overview of the NPSAS:16 Study Files 118
6.2. Post-Data Collection Editing 121
6.3. Composite and Derived Variable Construction 123
Chapter 7. Weighting and Variance Estimation 124
7.1. Weighting 124
7.1.1. Initial Institution Weights 126
7.1.2. Adjusting Institution Weights 127
7.1.3. Initial Student Weights 135
7.1.4. Adjusted Student Weights 139
7.1.5. Weighting Adjustment Summary and Evaluation 161
7.2. Nonresponse Bias Analysis 166
7.2.1. Bias Analysis: Institution Level 167
7.2.2. Bias Analyses: Study Member Level and Student Interview Level 173
7.2.3. Bias Analysis: Item Level 179
7.3. Variance Estimation 205
7.3.1. Taylor Series 205
7.3.2. Bootstrap Replicate Weights 207
7.3.3. Software Use for Variance Estimation 209
7.3.4. Variance Approximation 212
7.4. Imputations 213
7.5. Disclosure Risk Analysis and Avoidance 215
References 216
Appendix A: Technical Review Panel (TRP) Members 218
Appendix B: Sampling Details 226
B.1. Institution Frame and Sample 227
B.2. Student Universe and Samples 238
B.3. Determining Sample Sizes and Sampling Rates 245
Appendix C: Data Elements for Student Records 312
Appendix D: NPSAS Endorsements 343
Appendix E: Institution Data Collection Materials 345
Appendix F: Data Elements for Student Interview 369
Appendix G: Full-Scale Student Interview 372
Appendix H: Student Data Collection Materials 415
Appendix I: Training Materials 424
Appendix J-I: Nonresponse Bias Analyses 430
Appendix J-II: Nonresponse Bias Analyses 712
Appendix K: Weighted-Analysis Considerations 982
Appendix L: Design Effects 987
Appendix N: Analysis Variables 1011
Appendix O: 2014-15-16 National Postsecondary Student Aid Study (NPSAS:16) Field Test 1026
Section 1. Overview of NPSAS:16 1032
1.1. Sampling Design 1032
1.2. Institution Data Collection 1033
1.2.1. Instrumentation 1033
1.2.2. Data collection design and systems 1034
1.3. Student Interview Data Collection 1034
1.3.1. Instrumentation 1034
1.3.2. Data collection design and systems 1035
1.4. Experiments 1036
1.5. Planned Changes for the Full-Scale Study 1036
Section 2. Institution Data Collection 1037
2.1. Institution Sampling 1037
2.1.1. Institution universe for NPSAS:16 1037
2.1.2. Institution sample for NPSAS:16 1038
2.2. Institution Data Collection Design and Outcomes 1039
2.2.1. Institution recruitment and contacting 1039
2.2.2. Student enrollment list acquisition 1042
2.2.3. Student records collection 1044
2.3. Institution Data Conclusions 1047
Section 3. Student Data Collection 1049
3.1. Student Sampling 1049
3.1.1. Student universe for NPSAS:16 1049
3.1.2. Student sample for NPSAS:16 1049
3.1.3. Bachelor's degree recipients sample 1053
3.2. Student Interview Data Collection 1053
3.3. Student Interview Instrument 1055
3.3.1. Student reinterview analysis 1060
3.3.2. Instrument coders 1067
3.3.3. Item nonresponse 1070
3.3.4. Help text analysis 1073
3.3.5. Conversion text analysis 1076
3.3.6. Instrument timing analysis 1081
3.4. Student Interview Experiments 1088
3.4.1. Evaluation of burden and motivation to participate 1088
3.4.2. Assessing survey fatigue and measurement error 1099
3.4.3. Item design experiments 1101
3.5. Student Interview Conclusions 1106
Section 4. Recommendations for the NPSAS:16 Full-Scale Study 1109
4.1. Full-Scale Sample 1109
4.2. Institution Data Collection 1111
4.3. Student Interview Data Collection 1111
4.4. Administrative Records Matching Recommendations 1112
4.5. NPSAS:16 Field Test Student Records Instrument Facsimile 1113
4.6. NPSAS:16 Field Test Student Interview Instrument Facsimile 1128
References 1213
Table 1. Schedule of major activities for the NPSAS:16 full-scale study: 2015-18 14
Table 2. Size of universe, institution sampling rates and number of institutions sampled, by institution stratum: 2015-16 21
Table 3. Number of sampled and eligible institutions and number and percentage of institutions providing enrollment lists, by control and level of institution: 2015-16 22
Table 4. Oversampled and undersampled student groups: 2015-16 25
Table 5. Expected and achieved numbers of sample students, by student type and control and level of institution: 2015-16 27
Table 6. Expected and achieved NPSAS:16 student samples, by student stratum: 2015-16 28
Table 7. Initial classification of NPSAS:16 student sample, by student type and control and level of institution: 2015-16 29
Table 8. Enrollment list receipt, by control and level of institution: 2015-16 38
Table 9. Institutions providing GPA, number of credits, account overdue status, sex, first-time graduate student indicator, and race/ethnicity, by control and level of institution: 2015-16 40
Table 10. Number and percentage of participating NPSAS:16 institutions, by 2005 Carnegie institutional classification: 2015-16 41
Table 11. Participation of Historically Black Colleges and Universities: 2015-16 42
Table 12. Student record collection methods, by control and level of institution: 2015-16 43
Table 13. Student records collection results, by control and level of institution and student type: 2015-16 44
Table 14. Institutions providing student contact information, Social Security number, date of birth, and high school graduation date, by control and level of institution: 2015-16 46
Table 15. Student records item-level completion rates, by data element and primary mode: 2015-16 48
Table 16. Training of data collection staff: 2015-16 56
Table 17. Beginning of outbound telephone calls, by control and level of institution and response phase: 2015-16 62
Table 18. Abbreviated interview offer, by control and level of institution and student type: 2015-16 64
Table 19. Student locating results, by control and level of institution and student type: 2015-16 69
Table 20. Batch processing record match rates, by method of tracing: 2015-16 70
Table 21. Cases requiring intensive tracing, by institution characteristics and student type: 2015-16 71
Table 22. Located and interviewed rates of cases requiring intensive tracing procedures: 2015-16 72
Table 23. Student interview completion rates, by control and level of institution and student type: 2015-16 73
Table 24. Student interview completion rates, by data collection phase, control and level of institution, and student type: 2015-16 74
Table 25. Student interview completion rates, by mode of administration, control and level of institution, and student type: 2015-16 76
Table 26. Number and percentage of NPSAS interviews included and excluded from the timing report, by interview type: 2015-16 79
Table 27. Average time in minutes to complete the NPSAS interview, by mode of administration and respondent group: 2015-16 80
Table 28. Average time, in minutes, to complete the full NPSAS interview, by student type and interview section: 2015-16 81
Table 29. Average time, in minutes, to complete the full NPSAS interview, by mode of administration and respondent group: 2015-16 82
Table 30. Forms with the highest average interview times, in seconds, by form and item type: 2015-16 84
Table 31. Average number of calls to sample members, by control and level of institution and student type: 2015-16 85
Table 32. Average number of calls, by response status and mode of administration: 2015-16 86
Table 33. Refusal and refusal conversion rates, by control and level of institution and student type: 2015-16 87
Table 34. Baccalaureate determination, by student type: 2015-16 88
Table 35. Number of sampled and eligible students and rates of study membership, by control and level of institution: 2015-16 90
Table 36. Comparison of originally imputed data and reimputed data, using multiple imputation, for selected variables 95
Table 37. Percentage of recoding values, by mode of administration and coding system: 2015-16 98
Table 38. Summary of upcoding results, by mode of administration and coding system: 2015-16 98
Table 39. Help-text access rates, by mode of administration: 2015-16 100
Table 40. Conversion rates for critical items, by mode of administration: 2015-16 102
Table 41. Item nonresponse rates for items with more than 10 percent of data missing, by mode of administration: 2015-16 105
Table 42. Results of Central Processing System matching for 2015-16, by control and level of institution and student type: 2015-16 110
Table 43. Results of National Student Loan Data System loan and Pell Grant matching, by control and level of institution and student type: 2015-16 112
Table 44. Results of National Student Clearinghouse NPSAS institution matching, by control and level of institution and student type: 2015-16 114
Table 45. Results of ACT and SAT matching, by control and level of institution and student type: 2015-16 116
Table 46. Results of Veterans Benefits Administration matching, by control and level of institution and student type: 2015-16 117
Table 47. Restricted-use NPSAS:16 files, by filename, description, and file path: 2015-16 119
Table 48. Description of missing data codes: 2015-16 121
Table 49. Weight adjustment factors for institution nonresponse adjustment: 2015-16 130
Table 50. Weight adjustment factors for institution poststratification: 2015-16 134
Table 51. Weight adjustment factors for unknown student eligibility status: 2015-16 137
Table 52. Weight adjustment factors for student not located adjustment: 2015-16 142
Table 53. Weight adjustment factors for student refusal adjustment: 2015-16 146
Table 54. Weight adjustment factors for student other nonresponse adjustment: 2015-16 150
Table 55. Weight adjustment factors for student poststratification: 2015-16 156
Table 56. Institution weight distribution and unequal weighting effects, by control and level of institution: 2015-16 162
Table 57. Student weight distribution and unequal weighting effects: 2015-16 164
Table 58. Summary of institution-level nonresponse bias analysis, by control and level of institution: 2015-16 171
Table 59. Summary of institution-level differences between means, by control and level of institution: 2015-16 172
Table 60. Summary of student-level bias analysis, by control and level of institution: 2015-16 176
Table 61. Summary of student-level differences between means, by control and level of institution: 2015-16 178
Table 62. Weighted student-level item response rates for imputed variables, by control and level of institution: 2015-16 182
Table 63. Analysis weights, replicate weights, and variance estimation strata, primary sampling unit (PSU), secondary sampling unit (SSU), and PSU count variables available for NPSAS:16 210
Figure 1. NCES Postsecondary Data Portal home page: 2015-16 31
Figure 2. PDP website task menu: 2015-16 36
Figure 3. NPSAS:16 full-scale survey by content area and topics: 2015-16 52
Figure 4. Home page for NPSAS:16 study website: 2015-16 56
Figure 5. NPSAS:16 sample member locating activities 58
Figure 6. Data collection phases: 2015-16 62
Figure 7. NPSAS:16 overall locating and interviewing results: 2015-16 68
Figure 8. Distribution of interview respondents, by mode of administration: 2015-16 77
Figure 9. Receiver Operating Characteristic (ROC) curve for overall institution response propensity: 2015-16 163
Figure 10. Receiver Operating Characteristic (ROC) curve for overall student response propensity: 2015-16 165
Annex Tables
Appendix B: Sampling Details 234
Table B-1. Expected and achieved numbers of sample students, by control and level of institution and student type: 2015-16 234
Table B-2. Sampling rates of undergraduate students, by control and level of institution: 2015-16 235
Table B-3. Sampling rates of graduate students, by control and level of institution: 2015-16 236
Table B-4. Institutional sampling rates and number of institutions sampled, by control and level of institution: 2015-16 238
Table B-5. Initial classification of NPSAS:16 student sample, by control and level of institution and student type: 2015-16 244
Table B-6. Sampling rates of undergraduate students, by student stratum: 2015-16 245
Table B-7. Domains and outcomes for NPSAS:16 sample optimization: 2015-16 249
Appendix C: Data Elements for Student Records 313
Table C-1. Full-scale student records core data elements, by section and topic: 2015-16 313
Appendix E: Institution Data Collection Materials 357
Table 1. File Layout for NPSAS Student Enrollment List 357
Appendix F: Data Elements for Student Interview 370
Table F-1. Full-scale interview core data elements, by section and topic: 2015-16 370
Appendix J-I: Nonresponse Bias Analyses 431
Table J-1. Institution-level nonresponse bias analysis for selected variables for all institutions: 2015-16 435
Table J-2. Institution-level nonresponse bias analysis for selected variables for public less-than-2-year institutions: 2015-16 442
Table J-3. Institution-level nonresponse bias analysis for selected variables for public 2-year institutions: 2015-16 447
Table J-4. Institution-level nonresponse bias analysis for selected variables for public 4-year, non-doctorate-granting, primarily subbaccalaureate institutions: 2015-16 452
Table J-5. Institution-level nonresponse bias analysis for selected variables for public 4-year, non-doctorate-granting, primarily baccalaureate institutions: 2015-16 458
Table J-6. Institution-level nonresponse bias analysis for selected variables for public 4-year, doctorate-granting institutions: 2015-16 464
Table J-7. Institution-level nonresponse bias analysis for selected variables for private nonprofit less-than-4-year institutions: 2015-16 470
Table J-8. Institution-level nonresponse bias analysis for selected variables for private nonprofit 4-year non-doctorate-granting institutions: 2015-16 475
Table J-9. Institution-level nonresponse bias analysis for selected variables for private nonprofit, 4-year, doctorate-granting institutions: 2015-16 481
Table J-10. Institution-level nonresponse bias analysis for selected variables for private for-profit less-than-2-year institutions: 2015-16 487
Table J-11. Institution-level nonresponse bias analysis for selected variables for private for-profit 2-year institutions: 2015-16 492
Table J-12. Institution-level nonresponse bias analysis for selected variables for private for-profit 4-year institutions: 2015-16 497
Table J-13. Institution-level analysis after nonresponse and poststratification adjustments for selected variables for all institutions: 2015-16 503
Table J-14. Institution-level analysis after nonresponse and poststratification adjustments for selected variables for public less than-2-year institutions: 2015-16 509
Table J-15. Institution-level analysis after nonresponse and poststratification adjustments for selected variables for public 2-year institutions: 2015-16 514
Table J-16. Institution-level analysis after nonresponse and poststratification adjustments for selected variables for public 4-year, non-doctorate-granting, primarily subbaccalaureate institutions: 2015-16 519
Table J-17. Institution-level analysis after nonresponse and poststratification adjustments for selected variables for public 4-year, non-doctorate-granting, primarily baccalaureate institutions: 2015-16 524
Table J-18. Institution-level analysis after nonresponse and poststratification adjustments for selected variables for public 4-year, doctorate-granting institutions: 2015-16 530
Table J-19. Institution-level analysis after nonresponse and poststratification adjustments for selected variables for private nonprofit less-than-4-year institutions: 2015-16 536
Table J-20. Institution-level analysis after nonresponse and poststratification adjustments for selected variables for private nonprofit 4-year non-doctorate-granting institutions: 2015-16 540
Table J-21. Institution-level analysis after nonresponse and poststratification adjustments for selected variables for private nonprofit, 4-year, doctorate-granting institutions: 2015-16 546
Table J-22. Institution-level analysis after nonresponse and poststratification adjustments for selected variables for private for profit less-than-2-year institutions: 2015-16 552
Table J-23. Institution-level analysis after nonresponse and poststratification adjustments for selected variables for private for profit 2-year institutions: 2015-16 557
Table J-24. Institution-level analysis after nonresponse and poststratification adjustments for selected variables for private for profit 4-year institutions: 2015-16 561
Table J-25. Student-level (study member) nonresponse bias analysis for selected variables for students in all institutions: 2015-16 567
Table J-26. Student-level (study member) nonresponse bias analysis for selected variables for students in public less-than-2-year institutions: 2015-16 574
Table J-27. Student-level (study member) nonresponse bias analysis for selected variables for students in public 2-year institutions: 2015-16 580
Table J-28. Student-level (study member) nonresponse bias analysis for selected variables for students in public 4-year, non-doctorate-granting, primarily subbaccalaureate institutions: 2015-16 586
Table J-29. Student-level (study member) nonresponse bias analysis for selected variables for students in public 4-year, non-doctorate-granting, primarily baccalaureate institutions: 2015-16 592
Table J-30. Student-level (study member) nonresponse bias analysis for selected variables for students in public 4-year, doctorate-granting institutions: 2015-16 598
Table J-31. Student-level (study member) nonresponse bias analysis for selected variables for students in private nonprofit less than-4-year institutions: 2015-16 604
Table J-32. Student-level (study member) nonresponse bias analysis for selected variables for students in private nonprofit 4-year non-doctorate-granting institutions: 2015-16 610
Table J-33. Student-level (study member) nonresponse bias analysis for selected variables for students in private nonprofit, 4-year, doctorate-granting institutions: 2015-16 616
Table J-34. Student-level (study member) nonresponse bias analysis for selected variables for students in private for-profit less than-2-year institutions: 2015-16 622
Table J-35. Student-level (study member) nonresponse bias analysis for selected variables for students in private for-profit 2-year institutions: 2015-16 628
Table J-36. Student-level (study member) nonresponse bias analysis for selected variables for students in private for-profit 4-year institutions: 2015-16 634
Table J-37. Student-level (study member) analysis after nonresponse and poststratification adjustments for selected variables for students in all institutions: 2015-16 640
Table J-38. Student-level (study member) analysis after nonresponse and poststratification adjustments for selected variables for students in public less-than-2-year institutions: 2015-16 646
Table J-39. Student-level (study member) analysis after nonresponse and poststratification adjustments for selected variables for students in public 2-year institutions: 2015-16 652
Table J-40. Student-level (study member) analysis after nonresponse and poststratification adjustments for selected variables for students in public 4-year, non-doctorate-granting, primarily subbaccalaureate institutions: 2015-16 658
Table J-41. Student-level (study member) analysis after nonresponse and poststratification adjustments for selected variables for students in public 4-year, non-doctorate-granting, primarily baccalaureate institutions: 2015-16 664
Table J-42. Student-level (study member) analysis after nonresponse and poststratification adjustments for selected variables for students in public 4-year, doctorate-granting institutions: 2015-16 670
Table J-43. Student-level (study member) analysis after nonresponse and poststratification adjustments for selected variables for students in private nonprofit less-than-4-year institutions: 2015-16 676
Table J-44. Student-level (study member) analysis after nonresponse and poststratification adjustments for selected variables for students in private nonprofit 4-year non-doctorate-granting institutions: 2015-16 682
Table J-45. Student-level (study member) analysis after nonresponse and poststratification adjustments for selected variables for students in private nonprofit, 4-year, doctorate-granting institutions: 2015-16 688
Table J-46. Student-level (study member) analysis after nonresponse and poststratification adjustments for selected variables for students in private for-profit less-than-2-year institutions: 2015-16 694
Table J-47. Student-level (study member) analysis after nonresponse and poststratification adjustments for selected variables for students in private for-profit 2-year institutions: 2015-16 700
Table J-48. Student-level (study member) analysis after nonresponse and poststratification adjustments for selected variables for students in private for-profit 4-year institutions: 2015-16 706
Appendix J-II: Nonresponse Bias Analyses 713
Table J-49. Student-level (interview respondent) nonresponse bias analysis for selected variables for students in all institutions: 2015-16 716
Table J-50. Student-level (interview respondent) nonresponse bias analysis for selected variables for students in public less-than-2-year institutions: 2015-16 722
Table J-51. Student-level (interview respondent) nonresponse bias analysis for selected variables for students in public 2-year institutions: 2015-16 728
Table J-52. Student-level (interview respondent) nonresponse bias analysis for selected variables for students in public 4-year, non-doctorate-granting, primarily subbaccalaureate institutions: 2015-16 734
Table J-53. Student-level (interview respondent) nonresponse bias analysis for selected variables for students in public 4-year, non-doctorate-granting, primarily baccalaureate institutions: 2015-16 740
Table J-54. Student-level (interview respondent) nonresponse bias analysis for selected variables for students in public 4-year, doctorate-granting institutions: 2015-16 746
Table J-55. Student-level (interview respondent) nonresponse bias analysis for selected variables for students in private nonprofit, less-than-4-year institutions: 2015-16 752
Table J-56. Student-level (interview respondent) nonresponse bias analysis for selected variables for students in private nonprofit, 4-year, non-doctorate-granting institutions: 2015-16 758
Table J-57. Student-level (interview respondent) nonresponse bias analysis for selected variables for students in private nonprofit, 4-year, doctorate-granting institutions: 2015-16 764
Table J-58. Student-level (interview respondent) nonresponse bias analysis for selected variables for students in private for-profit, less-than-2-year institutions: 2015-16 770
Table J-59. Student-level (interview respondent) nonresponse bias analysis for selected variables for students in private for-profit, 2-year institutions: 2015-16 776
Table J-60. Student-level (interview respondent) nonresponse bias analysis for selected variables for students in private for-profit, 4-year institutions: 2015-16 782
Table J-61. Student-level (interview respondent) analysis after nonresponse and poststratification adjustments for selected variables for students in all institutions: 2015-16 788
Table J-62. Student-level (interview respondent) analysis after nonresponse and poststratification adjustments for selected variables for students in public less-than-2-year institutions: 2015-16 794
Table J-63. Student-level (interview respondent) analysis after nonresponse and poststratification adjustments for selected variables for students in public 2-year institutions: 2015-16 800
Table J-64. Student-level (interview respondent) analysis after nonresponse and poststratification adjustments for selected variables for students in public 4-year, non-doctorate-granting, primarily subbaccalaureate institutions: 2015-16 806
Table J-65. Student-level (interview respondent) analysis after nonresponse and poststratification adjustments for selected variables for students in public 4-year, non-doctorate-granting, primarily baccalaureate institutions: 2015-16 812
Table J-66. Student-level (interview respondent) analysis after nonresponse and poststratification adjustments for selected variables for students in public 4-year, doctorate-granting institutions: 2015-16 818
Table J-67. Student-level (interview respondent) analysis after nonresponse and poststratification adjustments for selected variables for students in private nonprofit, less-than-4-year institutions: 2015-16 824
Table J-68. Student-level (interview respondent) analysis after nonresponse and poststratification adjustments for selected variables for students in private nonprofit, 4-year, non-doctorate-granting institutions: 2015-16 830
Table J-69. Student-level (interview respondent) analysis after nonresponse and poststratification adjustments for selected variables for students in private nonprofit, 4-year, doctorate-granting institutions: 2015-16 836
Table J-70. Student-level (interview respondent) analysis after nonresponse and poststratification adjustments for selected variables for students in private for-profit, less-than-2-year institutions: 2015-16 842
Table J-71. Student-level (interview respondent) analysis after nonresponse and poststratification adjustments for selected variables for students in private for-profit, 2-year institutions: 2015-16 848
Table J-72. Student-level (interview respondent) analysis after nonresponse and poststratification adjustments for selected variables for students in private for-profit, 4-year institutions: 2015-16 854
Table J-73. Item nonresponse bias before imputation for STABREG, by select variables for all students: 2015-2016 860
Table J-74. Summary of item nonresponse bias analysis for all students, by selected variables and control and level of institution: 2015-16 866
Appendix L: Design Effects 988
Table L-1. Design effects for all undergraduate students: 2015-16 988
Table L-2. Design effects for undergraduate students at public less-than-2-year institutions: 2015-16 989
Table L-3. Design effects for undergraduate students at public 2-year institutions: 2015-16 990
Table L-4. Design effects for undergraduate students at public 4-year non-doctorate-granting primarily sub-baccalaureate institutions: 2015-16 991
Table L-5. Design effects for undergraduate students at public 4-year non-doctorate-granting primarily baccalaureate institutions: 2015-16 992
Table L-6. Design effects for undergraduate students at public 4-year doctorate-granting institutions: 2015-16 993
Table L-7. Design effects for undergraduate students at private nonprofit less-than-4-year institutions: 2015-16 994
Table L-8. Design effects for undergraduate students at private nonprofit 4-year non-doctorate-granting institutions: 2015-16 995
Table L-9. Design effects for undergraduate students at private nonprofit 4-year doctorate-granting institutions: 2015-16 996
Table L-10. Design effects for undergraduate students at for-profit less-than-2-year institutions: 2015-16 997
Table L-11. Design effects for undergraduate students at for-profit 2-year institutions: 2015-16 998
Table L-12. Design effects for undergraduate students at for-profit 4-year institutions: 2015-16 999
Table L-13. Design effects for dependent undergraduate students: 2015-16 1000
Table L-14. Design effects for independent undergraduate students: 2015-16 1001
Table L-15. Design effects for low-income undergraduate students: 2015-16 1002
Table L-16. Design effects for middle-income undergraduate students: 2015-16 1003
Table L-17. Design effects for high-income undergraduate students: 2015-16 1004
Table L-18. Design effects for all graduate students: 2015-16 1005
Table L-19. Design effects for graduate students at public 4-year institutions: 2015-16 1006
Table L-20. Design effects for graduate students at private nonprofit 4-year institutions: 2015-16 1007
Table L-21. Design effects for graduate students at for-profit 4-year institutions: 2015-16 1008
Appendix M: Imputations 1010
Table M-1. Preimputation versus postimputation frequency distribution for eight variables: 2015-16 1010
Appendix N: Analysis Variables 1012
Table N-1. Analysis variables: 2015-16 1012
Appendix O: 2014-15-16 National Postsecondary Student Aid Study (NPSAS:16) Field Test 1029
Table O-1. Counts of sampled institutions, by control and level of institution: 2014-15 1039
Table O-2. Enrollment list receipt, by control and level of institution: 2014-15 1043
Table O-3. New enrollment list items: student coverage rate: 2014-15 1044
Table O-4. Student records receipt, by control and level of institution: 2014-15 1046
Table O-5. Counts and percentages of field test student sample, by control and level of institution and student types: 2014-15 1052
Table O-6. Baccalaureate recipient status determination, by sample student type: 2014-15 1053
Table O-7. Reliability estimates for items included in the reinterview, by content area: 2014-15 1063
Table O-8. Summary of recoding results, by coder type and mode of administration: 2014-15 1069
Table O-9. Summary of upcoding results, by mode of administration and coding system: 2014-15 1070
Table O-10. Item nonresponse for items with more than 10 percent of data missing: 2014-15 1071
Table O-11. Interview questions with highest rates of help text access, by mode of administration: 2014-15 1075
Table O-12. Conversion rates for critical items, by mode of administration: 2014-15 1078
Table O-13. Count and proportion of NPSAS interviews, by whether included in timing analysis and interview type: 2014-15 1082
Table O-14. Average time in minutes to complete the full interview, by module experiment group and mode of administration: 2014-15 1083
Table O-15. Average time in minutes to complete the full interview, by interview section and experiment group: 2014-15 1084
Table O-16. Average time in minutes to complete the full interview, by respondent subgroup and mode of administration: 2014-15 1085
Table O-17. Ten longest average form times observed in the interview: 2014-15 1087
Table O-18. Average time in minutes to complete NPSAS:16 reinterview, overall and by mode of administration: 2014-15 1087
Table O-19. Response rates, by module experiment group 1089
Table O-20. Module 1 response rates, by module experiment group 1089
Table O-21. Module 2 response rates, by module experiment group 1090
Table O-22. Breakoff rates and frequency, by module experiment group 1090
Table O-23. Breakoff rates and frequency of final completes by module experiment group 1091
Table O-24. Participation rates by module experiment group 1091
Table O-25. Mean time (in minutes) to complete module 1, by module group 1092
Table O-26. Mean time (minutes) module group respondents took to complete modules 1 and 2 1092
Table O-27. Module 1 items with significant differences in nonresponse between control and module groups 1093
Table O-28. Responses to fictitious loan items by module experiment group 1094
Table O-29: Comparison of modules - responses to fictitious loan items 1095
Table O-30. Participation rates by module treatment group 1095
Table O-31. Response rates by module treatment group 1095
Table O-32. Student interview participation rates, by module experiment group and control and level of institution: 2014-15 1096
Figure O-1. Postsecondary Data Portal (PDP) home page 1041
Figure O-2. NPSAS:16 field test student records participation, by mode: 2014-15 1047
Figure O-3. Locating and interviewing outcomes 1055
Figure O-4. NPSAS:16 field-test interview modules and topics: 2014-15 1059
Figure O-5. Number of reinterviews, by mode of administration: 2014-15 1061
Figure O-6. Student interview completion rates, by module experiment group: 2014-15 1099
Figure O-7. NPSAS:16 field test fictitious loan items 1100
Figure O-8. NPSAS:16 field test reversed wording items 1101
Figure O-9. NPSAS:16 field test AP, IB, and college-level coursetaking items 1102
Figure O-10. NPSAS:16 field test parents' highest level of education items 1104
Figure O-11. NPSAS:16 field test undergraduate study abroad experience items 1106