Introduction
-
we propose an online dance learning method based on "video key frame extraction + human key point position extraction + action correction," which can identify and correct dance movements during estimation;
-
the proposed model is implemented over the edge-cloud platform so that the training happens at the cloud while the prediction and correction happens at the edge; and
-
we test the model using datasets and questionnaire survey and report our major observations and outcomes.
Related work
The dance teaching method based on AI
Applications of edge computing in resource integration of teaching platforms
An introduction to the convolutional neural network
Video key frame extraction based on a deep convolutional neural network algorithm
Video frame image feature extraction
Interame similarity measures
Key frame extraction
Experimental results of the algorithm
274 s | 753 s | 1437 s | |||||||
---|---|---|---|---|---|---|---|---|---|
A | B | C | A | B | C | A | B | C | |
Total frame number | 6325 | 15,479 | 31,884 | ||||||
Key frame number | 98 | 98 | 98 | 440 | 440 | 440 | 884 | 884 | 884 |
Extract the quantity | 98 | 95 | 99 | 438 | 434 | 446 | 883 | 880 | 887 |
NC | 91 | 82 | 81 | 424 | 388 | 374 | 857 | 783 | 791 |
NF | 7 | 13 | 18 | 13 | 46 | 72 | 26 | 97 | 97 |
NM | 7 | 15 | 16 | 15 | 52 | 66 | 27 | 101 | 93 |
R/% | 92.86 | 86.32 | 81.82 | 96.80 | 89.40 | 83.86 | 97.06 | 88.98 | 89.18 |
P/% | 92.86 | 83.67 | 82.65 | 96.36 | 88.18 | 85.00 | 96.95 | 88.57 | 89.48 |
Dance action correction process
Grid coding process
Convolutional neural network design for single-person pose estimation
Part | Average | Head | Shoulder | Elbow | Hand | Buttocks | Knee | Foot |
---|---|---|---|---|---|---|---|---|
Accuracy rate | 90.38 | 98.13 | 98.20 | 96.48 | 91.24 | 86.69 | 90.57 | 86.57 |
Dance movement correction based on guidance vectors
Dance teaching method based on knowledge concealment
Questionnaire design
Number | Question | Option | ||||
---|---|---|---|---|---|---|
Dance foundation | Keep up with the teacher’s classroom teaching rhythm | 5 | 4 | 3 | 2 | 1 |
Master the basic techniques of dance | 5 | 4 | 3 | 2 | 1 | |
Clarify the movement principle of the dance | 5 | 4 | 3 | 2 | 1 | |
Rescore the teacher’s demonstration | 5 | 4 | 3 | 2 | 1 | |
Control the strength of the action | 5 | 4 | 3 | 2 | 1 | |
Dance advanced | Dance movements are coordinated with the musical rhythm | 5 | 4 | 3 | 2 | 1 |
You can find out where your movements are not standard | 5 | 4 | 3 | 2 | 1 | |
Be able to complete a dance independently | 5 | 4 | 3 | 2 | 1 | |
Dance in the management of emotions and facial expressions | 5 | 4 | 3 | 2 | 1 | |
Have the consciousness of dance movement innovation | 5 | 4 | 3 | 2 | 1 |
Examination of the questionnaire data
Reliability test
Alpha | Clone Bach Alpha based on the normalization term | number of terms |
---|---|---|
0.866 | 0.768 | 27 |
Validity test
KMO and Bartlett tests | ||
---|---|---|
Number of KMO sampling suitability | .757 | |
Batley Sphicity Test | Approximate chi square | 3847.628 |
Free degree | 279 | |
Conspicuousness | .000 |
Questionnaire results
Number | Question number | Total | Average | |||||||||
---|---|---|---|---|---|---|---|---|---|---|---|---|
A | B | C | D | E | F | G | H | I | J | |||
1 | 4 | 4 | 3 | 3 | 3 | 3 | 2 | 2 | 3 | 2 | 29 | 32.43 |
2 | 3 | 4 | 4 | 4 | 4 | 3 | 3 | 3 | 2 | 3 | 33 | |
3 | 5 | 4 | 3 | 5 | 3 | 2 | 2 | 3 | 2 | 2 | 31 | |
4 | 2 | 3 | 2 | 3 | 3 | 2 | 2 | 1 | 1 | 1 | 20 | |
5 | 4 | 4 | 5 | 5 | 3 | 2 | 2 | 3 | 2 | 3 | 33 | |
392 | 4 | 5 | 4 | 4 | 5 | 3 | 2 | 3 | 2 | 2 | 34 | |
393 | 3 | 5 | 4 | 3 | 4 | 3 | 2 | 2 | 3 | 3 | 32 | |
394 | 4 | 3 | 5 | 3 | 5 | 3 | 2 | 3 | 3 | 2 | 33 | |
395 | 2 | 3 | 3 | 3 | 3 | 2 | 2 | 3 | 3 | 3 | 27 | |
396 | 4 | 3 | 4 | 3 | 4 | 3 | 2 | 2 | 3 | 2 | 30 |
Evaluation of student learning effect
Development of dance teaching method based on knowledge concealment
Score | Learning effect description | Learning method | Learning effect |
---|---|---|---|
< 20, 21–30 | Poor foundation, no advanced ability | Offline + dance basic video online teaching | Improve the foundation of dance |
31–40 | The foundation is good, and the advanced ability is poor | Offline + dance advanced video online teaching | Improve the ability to advance the dance |
41–50 | Good foundation, strong advanced ability | Offline teaching | Normal study |