Title Page
Abstract
Contents
Chapter Ⅰ. Introduction 23
1.1. Research background 23
1.1.1. VR technology enabling education information 23
1.1.2. Urgent demand for VR panoramic virtual learning environment construction 25
1.1.3. VR panoramic virtual learning environment construction should focus on learning engagement research 26
1.2. Literature Review 27
1.2.1. Status quo of overseas research of VR panoramic virtual learning environment 27
1.2.2. Status quo in China of VR panoramic virtual learning environment 33
1.3. Objectives, content, methods and processes of the research 43
1.3.1. Research objectives 43
1.3.2. Research contents 45
1.3.3. Research method 47
1.3.4. Research process 49
Chapter Ⅱ. Related theories and techniques 51
2.1. VR panoramic virtual learning environment 51
2.1.1. Concept of VR panoramic video 51
2.1.2. 3DoF VR and 6DoF VR 52
2.1.3. Typical Learning process of VR panoramic virtual learning environment 54
2.2. Key Technologies of VR panoramic virtual learning environment 55
2.2.1. VR Video Shooting 55
2.2.2. VR video Stitching Algorithm -- optical flow stitching algorithm 56
2.2.3. VR video rendering 57
2.3. Evaluation of learning effect of VR panoramic virtual learning environment 59
2.3.1. Concept of learning engagement 59
2.3.2. Investigate the learning engagement measurement tool NSSE 61
2.3.3. Dimension division of learning engagement 63
2.4. Summary of this chapter 64
Chapter Ⅲ. Design and Development of VR Panoramic Virtual Learning Environment 65
3.1. Demand analysis of VR panoramic virtual learning environment 65
3.1.1. Teaching needs of VR panoramic virtual learning environment 65
3.1.2. Teaching engagement needs of VR panoramic virtual learning environment 68
3.1.3. Teaching resources needs of VR panoramic virtual learning environment 69
3.2. Analysis of design principle of VR panoramic virtual learning environment 70
3.2.1. Taking into account educational value should be the important goal of VR panoramic virtual learning environment design 70
3.2.2. Explore the inner law of VR panoramic virtual learning environment design from the perspective of learning engagement 72
3.2.3. Take into account learning, analysis and innovation of design evaluation method of VR panoramic virtual learning environment 73
3.3. Analysis of influence factors of learning engagement under VR panoramic virtual learning environment 75
3.3.1. Actual investigation 75
3.3.2. Established Relationship between Influencing Factors -- SEM theoretical framework 77
3.3.3. VR panoramic virtual learning environment design focuses on the leap from behavior to emotion 88
3.4. Development framework design of VR panoramic virtual learning environment 89
3.4.1. Construction idea of VR panoramic virtual learning environment 89
3.4.2. Development process of VR panoramic virtual learning environment 91
Chapter Ⅳ. Experimental study on the design of VR panoramic virtual learning environment that promotes learning engagement 103
4.1. Experimental Study on the Effects of VR Panoramic Virtual Learning Environment Perceptive Codes on Learning 103
4.1.1. Experimental hypothesis 104
4.1.2. Measurement methods and instruments 107
4.2. Perceptive Codes Experimental Procedure 111
4.2.1. Experimental material making 111
4.2.2. Experimental subjects 113
4.2.3. Experimental procedure 114
4.3. Perceptive Codes Experimental Data Analysis 117
4.3.1. Eye movement data analysis 117
4.3.2. Brainwave data analysis 123
4.3.3. Behavioural engagement data analysis 130
4.3.4. Cognitive engagement data analysis 136
4.3.5. Emotional engagement data analysis 152
4.4. Experimental study on the effect of VR panoramic virtual learning environment Recognition Codes on learning 159
4.4.1. Experimental hypothesis 160
4.4.2. Measurement methods and instruments 162
4.5. Recognition Codes Experimental Procedure 164
4.5.1. Experimental material making 164
4.5.2. Experimental subjects 166
4.5.3. Experimental procedure 166
4.6. Recognition Codes Experimental Data Analysis 168
4.6.1. Knowledge retention test analysis 168
4.6.2. Social presence Analysis 171
4.6.3. Learning satisfaction analysis 172
4.6.4. Learning motivation analysis 174
4.6.5. Learning Attention Analysis 178
ChapterⅤ. VR Panoramic Virtual Learning Environment Development Strategy Discussion 192
5.1. Discussion of design rules for VR panoramic virtual learning environment Perceptive Codes 192
5.1.1. Effect of video playback speed on learning outcomes and cognitive load 193
5.1.2. Effects of video playback speed on eye movements and brain waves 194
5.1.3. Effects of video with and without subtitles on cognitive load and learning outcomes for different learners 195
5.1.4. The relationship between video playback speed and subtitle type and learners' cognitive processing 195
5.1.5. Effect of instructional video dubbing (male and female voices) on self-efficacy 196
5.2. Discussion of design rules for VR panoramic virtual learning environment Recognition Codes 196
5.2.1. The effect of teaching agent image on learner retention performance. 196
5.2.2. The effect of the teaching agent image on learners' experience of social presence. 197
5.2.3. The effect of the teaching agent image on learners' learning satisfaction. 197
5.2.4. The effect of the teaching agent image on learners' motivation to learn. 198
5.2.5. The effect of the teaching agent image on learners' attention to learning. 198
5.3. Application of VR panoramic virtual learning environment "Deng Xiaoping's former residence 201
5.3.1. Analysis of learning engagement measurement results 202
5.3.2. Analysis of positive emotional measurement 203
5.3.3. Analysis of sense of experience measurement 204
Chapter Ⅵ. Summary and Outlook 205
6.1. Research Summary 205
6.2. Research Shortcomings and Future Prospects 206
6.2.1. Research shortcomings 206
6.2.2. Future Prospects 207
Reference 209
국문초록 216
Appendices 219
Appendix A. Learning engagement questionnaire 219
Appendix B. The Learning Satisfaction Questionnaire 224
Table 1-1. Research Orientation of the Main Leaders in the Panoramic Virtual Learning Environment 37
Table 1-2. Review of VR Video Learning Effect Research Literature 39
Table 2-1. Evolution of the definition of learning engagement 59
Table 2-2. NSSE tool development process table 62
Table 2-3. Dimensions of learning engagement 63
Table 3-1. Summary Table of Goodness of Fit Index 77
Table 3-2. SEM Degree of Fitting of Cognitive-behavioral Engagement 80
Table 3-3. SEM Significance Test Results of Cognitive-behavioral Engagement 81
Table 3-4. SEM Degree of Fitting of Cognitive-behavioral Engagement 84
Table 3-5. SEM Significance Test Results of Emotional-behavioral Engagement 84
Table 3-6. SEM Degree of Fitting of Emotion-cognitive Engagement 87
Table 3-7. SEM Significance Test Results of Emotion-cognitive Engagement 87
Table 4-1. Specific experimental items and experimental contents 105
Table 4-2. Experimental eye movement index and the meaning of index 108
Table 4-3. Experimental material presentation format 112
Table 4-4. Gender distribution of experimental subjects 114
Table 4-5. Eye movement data of subjects with different Speech speeds 118
Table 4-6. Data for each measurement 119
Table 4-7. Eye movement data of subjects with different subtitles 120
Table 4-8. Data for each measurement 122
Table 4-9. Concentration data of subjects with different speed 123
Table 4-10. Concentration data of subjects with different subtitles 123
Table 4-11. Different Speech speed conditions Descriptive statistics 125
Table 4-12. Normal speed interpretation +Different Caption conditions Descriptive statistics 126
Table 4-13. 1.5 times speed interpretation +Different Caption conditions Descriptive statistics 129
Table 4-14. Description statistics of behavioural inputs at different speech rates 131
Table 4-15. Description statistics of behavioural inputs at different subtitle types 133
Table 4-16. Description statistics of behavioural inputs at different Speech speed conditions and subtitle types 135
Table 4-17. Description statistics of cognitive inputs at different speech rates 136
Table 4-18. Paired Sample Statistics Chart of Different Speech speed 137
Table 4-19. Descriptive statistics of the sense of social presence 138
Table 4-20. Description statistics of cognitive inputs at different subtitle types 140
Table 4-21. Different subtitle types Chi-squared test 143
Table 4-22. ANOVA test of Different subtitle types 143
Table 4-23. Multiple comparisons of Different subtitle types 144
Table 4-24. Description statistics of cognitive inputs at different Speech speed conditions and subtitle types 146
Table 4-25. Different Speech speed conditions and subtitle types Chi-squared test 149
Table 4-26. Descriptive statistics of the sense of social presence 149
Table 4-27. Different Speech speed conditions and subtitle types Chi-squared test 150
Table 4-28. ANOVA test of Different Speech speed conditions and subtitle types 150
Table 4-29. Multiple comparisons of Different Speech speed conditions and subtitle types 151
Table 4-30. Difference statistics of Different Speech speed conditions 1 153
Table 4-31. Difference statistics of Different Speech speed conditions 2 154
Table 4-32. Difference statistics of Different Speech speed conditions 3 155
Table 4-33. Difference statistics of Different Speech speed conditions 4 157
Table 4-34. Experimental material presentation. 165
Table 4-35. Analysis of variance for retention scores 168
Table 4-36. Descriptive statistics of retention scores 169
Table 4-37. Descriptive statistics for post-test performance 170
Table 4-38. Post-test variance ANOVA test 170
Table 4-39. Analysis of variance of social presence 171
Table 4-40. Descriptive statistics of the sense of social presence 171
Table 4-41. Analysis of variance of learning satisfaction 172
Table 4-42. Descriptive statistics of learning satisfaction 173
Table 4-43. Post hoc test multiple comparison analysis of learning 173
Table 4-44. Analysis of variance for learning motivation 174
Table 4-45. Descriptive statistics of learning motivation 175
Table 4-46. Post hoc test multiple comparison analysis of learning motivation 176
Table 4-47. Multiple comparisons of emotions and motivation 177
Table 4-48. Variance test for total fixation time 179
Table 4-49. Post hoc test multiple comparison analysis of total fixation time 179
Table 4-50. Descriptive statistical analysis of total fixation time 181
Table 4-51. ANOVA test for duration of attention at the first point of fixation 183
Table 4-52. Multiple comparison analysis of post hoc test for first fixation duration 184
Table 4-53. Descriptive statistical analysis of the duration of fixation at the first fixation point 185
Table 4-54. Descriptive statistics of attention 189
Table 4-55. Multiple comparisons of sightings 189
Table 5-1. VR panoramic virtual learning environment "Deng Xiaoping's former residence" learning engagement measureme 203
Table 5-2. Paired test of positive emotion scale pre-test and post-test 203
Table 5-3. Results of some learners' interviews 204
Figure 1-1. The typical VR panoramic system 24
Figure 1-2. WOS 2016 ~2021 Virtual Reality-video keyword co-occurrence knowledge map 28
Figure 1-3. Panoramic video keyword map 34
Figure 1-4. Panoramic video author map 35
Figure 1-5. Research methods and their applications chart 49
Figure 1-6. Research general design flow chart 50
Figure 2-1. Various DoF schematic diagram 53
Figure 2-2. Typical learning process of VR panoramic virtual learning environment 55
Figure 2-3. 3D VR panoramic camera 56
Figure 2-4. Rendering of DetuStitch's image Mosaic. 57
Figure 2-5. "barrel distortion" diagram of VR video image 58
Figure 2-6. "pillow distortion" diagram of VR lens 58
Figure 3-1. Typical learning activities in the coordinate system of "Learning Environment - Learning Mode" 66
Figure 3-2. Classification of Learner Learning Style and Learning Environment 67
Figure 3-3. Effect of Development of VR Panoramic Virtual Learning Environment 68
Figure 3-4. The Rules that the VR Panoramic Virtual Learning Environment Follows 71
Figure 3-5. HTC 3D Eye-tracking 74
Figure 3-6. Brainlink Brainwave 74
Figure 3-7. SEM of Observed Indexes of Cognitive-behavioral Engagement 80
Figure 3-8. Cognitive Engagement and Behavioral Engagement Relation Schema 82
Figure 3-9. SEM of Observed Indexes of Emotion- behavioral engagement 83
Figure 3-10. Emotional Engagement and Behavioral Engagement Relation Schema 85
Figure 3-11. SEM of Observed Indexes of Emotion-cognitive Engagement 86
Figure 3-12. Emotional Engagement and Cognitive Engagement Relation Schema 88
Figure 3-13. Image Design of Mobile Learning Resources to Meet Varying Needs 89
Figure 3-14. Cognitive Processing Model of VR Panoramic Virtual Learning Environment 90
Figure 3-15. Design of Educational Panoramic Development Framework Oriented To the Guidance of Learning Attention 92
Figure 3-16. TetuMAX Panoramic Camera 95
Figure 3-17. VR panoramic Editing process 96
Figure 3-18. Panoramic Virtual Learning Environment Project Build Figure 97
Figure 3-19. Panoramic Virtual Learning Environment Hot zone settings 97
Figure 3-20. Panoramic virtual learning environment script design figure 98
Figure 3-21. Panoramic virtual learning environment Interaction design 1 98
Figure 3-22. Panoramic virtual learning environment Interaction design 2 99
Figure 3-23. Panoramic virtual learning environment Interaction design 3 100
Figure 3-24. Panoramic virtual learning environment Experimental cases 101
Figure 3-25. Panoramic virtual learning environment Teaching applications 102
Figure 4-1. Field diagram of Panorama video experimental process 116
Figure 4-2. Experimental flowchart 117
Figure 4-3. Different Speed conditions heat map and track map 120
Figure 4-4. Interest area Subtitle types heat map and track map 121
Figure 4-5. Interest area a Speech spead VS Subtitle types heat map and track map 122
Figure 4-6. Real-time screenshots of brainwave data 124
Figure 4-7. Box plots of brainwave indicators in different speed speech. 125
Figure 4-8. Box plots of brainwave indicators in Normal speed interpretation +Different Caption 127
Figure 4-9. Box plots of brainwave indicators in l.5 times speed interpretation +Different Caption 129
Figure 4-10. Statistics on the number of regional scores of behavioural inputs at different speech rates 131
Figure 4-11. Statistics on the number of regional scores of behavioural inputs at different subtitle 132
Figure 4-12. Statistics on the number of regional scores of behavioural inputs at different Speech speed conditions and subtitle types 134
Figure 4-13. Different Speech speed conditions Cognitive engagement effect Histogram and Curves 137
Figure 4-14. Normal speed interpretation and 1.5 times speed interpretation Score Comparison Chart 139
Figure 4-15. Different subtitle types Cognitive engagement effect Histogram and Curves 140
Figure 4-16. Different subtitle types Score Comparison Chart 142
Figure 4-17. Different Speech speed conditions and subtitle types Cognitive engagement effect Histogram and Curves 146
Figure 4-18. Different Speech speed conditions and subtitle types Comparison Chart 148
Figure 4-19. Different Speech speed conditions Chart 1 153
Figure 4-20. Different Speech speed conditions Chart 2 154
Figure 4-21. Different Speech speed conditions Chart 3 156
Figure 4-22. Different Speech speed conditions Chart 4 158
Figure 4-23. Subjects wearing the eye-movement device for learning the experimental material 162
Figure 4-24. Box plot of the total score of the maintenance performance 169
Figure 4-25. Eye movement hot zones 1 178
Figure 4-26. Mean values of total fixation time for each group and G-plot of total fixation time 181
Figure 4-27. Eye movement hot zones 2 182
Figure 4-28. Mean values of total fixation time for each group and G-plot of total fixation time2 185