Muscle coordination retraining inspired by musculoskeletal simulations reduces knee contact force

Scott D Uhlrich, Rachel W Jackson, Ajay Seth, Julie A Kolesar, Scott L Delp, Scott D Uhlrich, Rachel W Jackson, Ajay Seth, Julie A Kolesar, Scott L Delp

Abstract

Humans typically coordinate their muscles to meet movement objectives like minimizing energy expenditure. In the presence of pathology, new objectives gain importance, like reducing loading in an osteoarthritic joint, but people often do not change their muscle coordination patterns to meet these new objectives. Here we use musculoskeletal simulations to identify simple changes in coordination that can be taught using electromyographic biofeedback, achieving the therapeutic goal of reducing joint loading. Our simulations predicted that changing the relative activation of two redundant ankle plantarflexor muscles-the gastrocnemius and soleus-could reduce knee contact force during walking, but it was unclear whether humans could re-coordinate redundant muscles during a complex task like walking. Our experiments showed that after a single session of walking with biofeedback of summary measures of plantarflexor muscle activation, healthy individuals reduced the ratio of gastrocnemius-to-soleus muscle activation by 25 ± 15% (p = 0.004, paired t test, n = 10). Participants who walked with this "gastrocnemius avoidance" gait pattern reduced late-stance knee contact force by 12 ± 12% (p = 0.029, paired t test, n = 8). Simulation-informed coordination retraining could be a promising treatment for knee osteoarthritis and a powerful tool for optimizing coordination for a variety of rehabilitation and performance applications.

Conflict of interest statement

Stanford University has applied for a patent on behalf of S.D.U. and S.L.D. describing the muscle coordination retraining technique, entitled “Real-time electromyography feedback to change muscle activity during complex movements.” The patent is pending at the time of manuscript submission. S.D.U., S.L.D., R.W.J., A.S., and J.A.K. have no other competing interests to disclose.

© 2022. The Author(s).

Figures

Figure 1
Figure 1
Contributions to knee contact force during walking. Muscle force contributions to knee contact force (red) exceed the intersegmental force contribution (blue), which is the reaction force from inverse dynamics. Muscle force contributions are dominated by the hamstrings during the first 10% of stance, the quadriceps from 10–40% stance, and the gastrocnemius from 40 to 90% stance. Forces are shown in terms of bodyweight (BW) for the 10 healthy subjects in this study, and muscle activations were estimated by minimizing the sum of squared activations using static optimization.
Figure 2
Figure 2
Simulation-inspired biofeedback design process. (a) To design the biofeedback for teaching individuals to walk without activating their gastrocnemius (gastroc), we simulated walking using both a natural and a gastrocnemius avoidance objective function (Eqs. 1 and 2) in the static optimization muscle redundancy solver. (b) Based on the simulation results, we provided individuals with visual biofeedback of their muscle activation, measured with electromyography (EMG), that instructed them to change the coordination of their ankle plantarflexor muscles. Participants performed five walking trials: a baseline trial (natural walking), three trials with visual biofeedback, and a retention trial without feedback. During all three feedback (FB) trials, visual biofeedback instructed participants to reduce their gastrocnemius-to-soleus activation ratio (bar magnitude). During the final two feedback sessions, additional feedback was provided, instructing participants to also reduce their average gastrocnemius (gastroc) activity (bar color). (c) EMG-informed static optimization simulations were used to assess the effect of a gastrocnemius avoidance coordination pattern on knee contact force. The simulated gastrocnemius-to-soleus activation ratio was constrained to match the ratio measured with EMG.
Figure 3
Figure 3
Simulation of a gastrocnemius avoidance coordination pattern. Identical joint kinetics were simulated (n = 1) with a natural (Eq. 1) and a gastrocnemius (gastroc) avoidance (Eq. 2) static optimization objective function. During late stance, the muscles generate ankle plantarflexion, knee flexion, and hip flexion moments. The gastrocnemius avoidance coordination pattern requires increased soleus and hamstrings force to compensate for the ankle and knee moments normally generated by the gastrocnemius. The larger knee flexion moment arm (r) of the hamstrings compared to the gastrocnemius allows the hamstrings to generate the same moment with less force than the gastrocnemius, reducing knee contact force. A weighted average of the moment arms (hamstrings: biceps femoris long head and short head, semitendinosus, semimembranosus; gastrocnemius: medial and lateral heads) was computed at 75% of the stance phase, weighted by each muscle’s optimal force in the musculoskeletal model.
Figure 4
Figure 4
Changes in muscle activity and ankle mechanics following coordination retraining. (a) The mean (bar), and standard deviation (error bar) of changes in muscle activation measured with electromyography (n = 10). Participants reduced their gastrocnemius-to-soleus activation ratio and average gastrocnemius (gastroc) activation during training. They retained these reductions following the retention trial (*p < 0.05, paired t test, p-values reported after controlling for the false detection rate). (be) The mean (line) and standard deviation (shading) of ankle plantarflexor muscle activity and ankle mechanics for the baseline (base.) and retention (ret.) trials. Despite the 25 ± 15% change in activation ratio from the baseline to retention trial, the stance-phase-averaged ankle moment only changed by 3 ± 14%, which trended towards being equivalent to baseline within one baseline standard deviation (p = 0.063, two-one-sided t tests for equivalence, n = 10).
Figure 5
Figure 5
Simulated and measured muscle activation. Electromyography (EMG) linear envelopes averaged across all participants (n = 10) with a 40 ms electromechanical delay are compared to simulated muscle activations for the baseline and retention trials. Despite magnitude differences between EMG and simulated activations of the gastrocnemius and soleus, the relative changes between trials are consistent, indicating that our EMG-informed static optimization technique captured the changes in ankle plantarflexor muscle activity measured with EMG. The activations of the muscles in the top row were not informed by EMG in the simulation. The shape, timing, and between-trial changes in simulated activation matched EMG for these muscles, with the exception of the rectus femoris.
Figure 6
Figure 6
The effect of a gastrocnemius avoidance coordination pattern on knee contact force. (a) The mean (line) and standard deviation (shading) of knee contact force for the participants who reduced late-stance gastrocnemius activation during the retention trial (n = 8). These participants reduced their second peak of knee contact force compared to baseline (*p = 0.029, paired t test). (b) Changes in the first and second peak contact force between baseline (base.) and retention (ret.) are shown for all participants (n = 10), with the two participants who did not retain a reduction in late stance gastrocnemius activation represented with dashed lines. Six of the eight individuals who reduced late-stance gastrocnemius activation reduced their second peak knee contact force, but five increased their first peak. (c) For the eight subjects who reduced late-stance gastrocnemius activation, the change in knee contact force is decomposed into the intersegmental and muscle force components. Reductions in the second peak of knee contact force are primarily driven by reductions in gastrocnemius force.
Figure 7
Figure 7
Changes in knee and hip mechanics. The mean (line) and standard deviation (shading) of knee and hip kinematics and kinetics for the participants who retained a reduction in their late-stance gastrocnemius activation during the retention trial (n = 8). During the retention trial, participants walked with a smaller late-stance knee flexion moment (*p = 0.015, paired t test).

References

    1. Ralston HJ. Energy-speed relation and optimal speed during level walking. Int. Z. Angew. Physiol. Einschl. Arbeitsphysiologie. 1958;17:277–283.
    1. Donelan JM, Kram R, Kuo AD. Mechanical and metabolic determinants of the preferred step width in human walking. Proc. R. Soc. Lond. Ser. B Biol. Sci. 2001;268:1985–1992. doi: 10.1098/rspb.2001.1761.
    1. Donelan JM, Shipman DW, Kram R, Kuo AD. Mechanical and metabolic requirements for active lateral stabilization in human walking. J. Biomech. 2004;37:827–835. doi: 10.1016/j.jbiomech.2003.06.002.
    1. Selinger JC, O’Connor SM, Wong JD, Donelan JM. Humans can continuously optimize energetic cost during walking. Curr. Biol. 2015;25:2452–2456. doi: 10.1016/j.cub.2015.08.016.
    1. Nie Y, et al. The relationship between knee adduction moment and knee osteoarthritis symptoms according to static alignment and pelvic drop. Biomed Res. Int. 2019 doi: 10.1155/2019/7603249.
    1. Felson DT. Obesity and vocational and avocational overload of the joint as risk factors for osteoarthritis. J. Rheumatol. Suppl. 2004;31:2–5.
    1. Andriacchi TP, et al. A framework for the in vivo pathomechanics of osteoarthritis at the knee. Ann Biomed Eng. 2004;32:447–457. doi: 10.1023/B:ABME.0000017541.82498.37.
    1. Miyazaki T, et al. Dynamic load at baseline can predict radiographic disease progression in medial compartment knee osteoarthritis. Ann. Rheum. Dis. 2002;61:617–622. doi: 10.1136/ard.61.7.617.
    1. Brisson NM, Gatti AA, Damm P, Duda GN, Maly MR. Association of machine learning-based predictions of medial knee contact force with cartilage loss over 2.5 years in knee osteoarthritis. Arthritis Rheumatol. 2021;73:1638–1645. doi: 10.1002/art.41735.
    1. Winby CR, Lloyd DG, Besier TF, Kirk TB. Muscle and external load contribution to knee joint contact loads during normal gait. J. Biomech. 2009;42:2294–2300. doi: 10.1016/j.jbiomech.2009.06.019.
    1. Saxby DJ, et al. Tibiofemoral contact forces during walking, running and sidestepping. Gait Posture. 2016;49:78–85. doi: 10.1016/j.gaitpost.2016.06.014.
    1. Miller RH, Brandon SCE, Deluzio KJ. Predicting sagittal plane biomechanics that minimize the axial knee joint contact force during walking. J. Biomech. Eng. 2013;135:1–11. doi: 10.1115/1.4023151.
    1. Fregly BJ, et al. Grand challenge competition to predict in vivo knee loads. J. Orthop. Res. 2012;30:503–513. doi: 10.1002/jor.22023.
    1. Prodromos CC, Andriacchi TP, Galante JO. A relationship between gait and clinical changes following high tibial osteotomy. J. Bone Jt. Surg. Ser. A. 1985;67:1188–1194. doi: 10.2106/00004623-198567080-00007.
    1. Brandon SCE, et al. Contributions of muscles and external forces to medial knee load reduction due to osteoarthritis braces. Knee. 2019;26:564–577. doi: 10.1016/j.knee.2019.04.006.
    1. Zhao D, et al. Correlation between the knee adduction torque and medial contact force for a variety of gait patterns. J. Orthop. Res. 2007;25:789–797. doi: 10.1002/jor.20379.
    1. Mündermann A, Asay JL, Mündermann L, Andriacchi TP. Implications of increased medio-lateral trunk sway for ambulatory mechanics. J. Biomech. 2008;41:165–170. doi: 10.1016/j.jbiomech.2007.07.001.
    1. Shull PB, et al. Six-week gait retraining program reduces knee adduction moment, reduces pain, and improves function for individuals with medial compartment knee osteoarthritis. J. Orthop. Res. 2013;31:1020–1025. doi: 10.1002/jor.22340.
    1. Walter JP, D’Lima DD, Colwell CW, Fregly BJ. Decreased knee adduction moment does not guarantee decreased medial contact force during gait. J. Orthop. Res. 2010;28:1348–1354. doi: 10.1002/jor.21142.
    1. Hortobágyi T, et al. Altered hamstring-quadriceps muscle balance in patients with knee osteoarthritis. Clin. Biomech. 2005;20:97–104. doi: 10.1016/j.clinbiomech.2004.08.004.
    1. Demers MS, Pal S, Delp SL. Changes in tibiofemoral forces due to variations in muscle activity during walking. J. Orthop. Res. 2014;32:769–776. doi: 10.1002/jor.22601.
    1. Hodges PW, et al. Increased duration of co-contraction of medial knee muscles is associated with greater progression of knee osteoarthritis. Man. Ther. 2016;21:151–158. doi: 10.1016/j.math.2015.07.004.
    1. Hall M, Diamond LE, Lenton GK, Pizzolato C, Saxby DJ. Immediate effects of valgus knee bracing on tibiofemoral contact forces and knee muscle forces. Gait Posture. 2019;68:55–62. doi: 10.1016/j.gaitpost.2018.11.009.
    1. Smith CR, Brandon SCE, Thelen DG. Can altered neuromuscular coordination restore soft tissue loading patterns in anterior cruciate ligament and menisci deficient knees during walking? J. Biomech. 2019;82:124–133. doi: 10.1016/j.jbiomech.2018.10.008.
    1. van Veen B, Montefiori E, Modenese L, Mazzà C, Viceconti M. Muscle recruitment strategies can reduce joint loading during level walking. J. Biomech. 2019;97:109368. doi: 10.1016/j.jbiomech.2019.109368.
    1. Sasaki K, Neptune RR. Individual muscle contributions to the axial knee joint contact force during normal walking. J. Biomech. 2010;43:2780–2784. doi: 10.1016/j.jbiomech.2010.06.011.
    1. Colborne GR, Wright FV, Naumann S. Feedback of triceps surae EMG in gait of children with cerebral palsy: A controlled study. Arch. Phys. Med. Rehabil. 1994;75:40–45. doi: 10.1016/0003-9993(94)90335-2.
    1. Bolek JE. A preliminary study of modification of gait in real-time using surface electromyography. Appl. Psychophysiol. Biofeedback. 2003;28:129–138. doi: 10.1023/A:1023810608949.
    1. Basmajian JV, De Luca CJ. Muscles Alive: Their Functions Revealed by Electromyography. Williams & Wilkins; 1985.
    1. Basmajian JV. Control and training of individual motor units. Science (80-). 1963;141:440–441. doi: 10.1126/science.141.3579.440.
    1. Simard TG, Ladd HW. Pre-orthotic training: An electromyographic study in normal adults. Am. J. Phys. Med. 1969;48:301–312.
    1. Ng GYF, Zhang AQ, Li CK. Biofeedback exercise improved the EMG activity ratio of the medial and lateral vasti muscles in subjects with patellofemoral pain syndrome. J. Electromyogr. Kinesiol. 2008;18:128–133. doi: 10.1016/j.jelekin.2006.08.010.
    1. Huang HY, Lin JJ, Guo YL, Wang WTJ, Chen YJ. EMG biofeedback effectiveness to alter muscle activity pattern and scapular kinematics in subjects with and without shoulder impingement. J. Electromyogr. Kinesiol. 2013;23:267–274. doi: 10.1016/j.jelekin.2012.09.007.
    1. Kaufman KR, Au KN, Litchy WJ, Chao EYS. Physiological prediction of muscle forces-II. Application to isokinetic exercise. Neuroscience. 1991;40:793–804. doi: 10.1016/0306-4522(91)90013-E.
    1. Anderson FC, Pandy MG. Static and dynamic optimization solutions for gait are practically equivalent. J. Biomech. 2001;34:153–161. doi: 10.1016/S0021-9290(00)00155-X.
    1. Rajagopal A, et al. Full-body musculoskeletal model for muscle-driven simulation of human gait. IEEE Trans. Biomed. Eng. 2016;63:2068–2079. doi: 10.1109/TBME.2016.2586891.
    1. Kepple TM, Siegel KL, Stanhope SJ. Relative contributions of the lower extremity joint moments to forward progression and support during gait. Gait Posture. 1997;6:1–8. doi: 10.1016/S0966-6362(96)01094-6.
    1. Steele KM, Seth A, Hicks JL, Schwartz MS, Delp SL. Muscle contributions to support and progression during single-limb stance in crouch gait. J. Biomech. 2010;43:2099–2105. doi: 10.1016/j.jbiomech.2010.04.003.
    1. Zhang J, et al. Human-in-the-loop optimization of exoskeleton assistance during walking. Science. 2017;356:1280–1284. doi: 10.1126/science.aal5054.
    1. Pizzolato C, et al. Biofeedback for gait retraining based on real-time estimation of tibiofemoral joint contact forces. IEEE Trans. Neural Syst. Rehabil. Eng. 2017;25:1612–1621. doi: 10.1109/TNSRE.2017.2683488.
    1. Hunt MA, Charlton JM, Krowchuk NM, Tse CTF, Hatfield GL. Clinical and biomechanical changes following a 4-month toe-out gait modification program for people with medial knee osteoarthritis: A randomized controlled trial. Osteoarthr. Cartil. 2018;26:903–911. doi: 10.1016/j.joca.2018.04.010.
    1. Uhlrich SD, Silder A, Beaupre GS, Shull PB, Delp SL. Subject-specific toe-in or toe-out gait modifications reduce the larger knee adduction moment peak more than a non-personalized approach. J. Biomech. 2018;66:103–110. doi: 10.1016/j.jbiomech.2017.11.003.
    1. Felson DT, et al. The efficacy of a lateral wedge insole for painful medial knee osteoarthritis after prescreening: A randomized clinical trial. Arthritis Rheumatol. 2019;71:908–915. doi: 10.1002/art.40808.
    1. Chehab EF, Favre J, Erhart-Hledik JC, Andriacchi TP. Baseline knee adduction and flexion moments during walking are both associated with 5 year cartilage changes in patients with medial knee osteoarthritis. Osteoarthr. Cartil. 2014;22:1833–1839. doi: 10.1016/j.joca.2014.08.009.
    1. Aaboe J, Bliddal H, Messier SP, Alkjaer T, Henriksen M. Effects of an intensive weight loss program on knee joint loading in obese adults with knee osteoarthritis. Osteoarthr. Cartil. 2011;19:822–828. doi: 10.1016/j.joca.2011.03.006.
    1. DeVita P, Rider P, Hortobágyi T. Reductions in knee joint forces with weight loss are attenuated by gait adaptations in class III obesity. Gait Posture. 2016;45:25–30. doi: 10.1016/j.gaitpost.2015.12.040.
    1. Knarr BA, Higginson JS, Zeni JA. Change in knee contact force with simulated change in body weight. Comput. Methods Biomech. Biomed. Engin. 2016;19:320–323. doi: 10.1080/10255842.2015.1018193.
    1. Kinney AL, et al. Changes in in vivo knee contact forces through gait modification. J. Orthop. Res. 2013;31:434–440. doi: 10.1002/jor.22240.
    1. Richards RE, Andersen MS, Harlaar J, van den Noort JC. Relationship between knee joint contact forces and external knee joint moments in patients with medial knee osteoarthritis: Effects of gait modifications. Osteoarthr. Cartil. 2018;26:1203–1214. doi: 10.1016/j.joca.2018.04.011.
    1. Fregly BJ, D’Lima DD, Colwell CW. Effective gait patterns for offloading the medial compartment of the knee. J. Orthop. Res. 2009;27:1016–1021. doi: 10.1002/jor.20843.
    1. Brouwer RW, van Raaij TM, Verhaar JAN, Coene LNJEM, Bierma-Zeinstra SMA. Brace treatment for osteoarthritis of the knee: A prospective randomized multi-centre trial. Osteoarthr. Cartil. 2006;14:777–783. doi: 10.1016/j.joca.2006.02.004.
    1. Uchida TK, et al. Simulating ideal assistive devices to reduce the metabolic cost of running. PLoS ONE. 2016 doi: 10.1371/journal.pone.0163417.
    1. Dembia CL, Silder A, Uchida TK, Hicks JL, Delp SL. Simulating ideal assistive devices to reduce the metabolic cost of walking with heavy loads. PLoS ONE. 2017 doi: 10.1371/journal.pone.0180320.
    1. Ong CF, Hicks JL, Delp SL. Simulation-based design for wearable robotic systems: An optimization framework for enhancing a standing long jump. IEEE Trans. Biomed. Eng. 2016;63:894–903. doi: 10.1109/TBME.2015.2463077.
    1. Cinque ME, Schickendantz M, Frangiamore S. Review of anatomy of the medial ulnar collateral ligament complex of the elbow. Curr. Rev. Musculoskelet. Med. 2020;13:96. doi: 10.1007/s12178-020-09609-z.
    1. Renström P, Arms SW, Stanwyck TS, Johnson RJ, Pope MH. Strain within the anterior cruciate ligament during hamstring and quadriceps activity. Am. J. Sports Med. 1986;14:83–87. doi: 10.1177/036354658601400114.
    1. Elias JJ, Faust AF, Chu YH, Chao EY, Cosgarea AJ. The soleus muscle acts as an agonist for the anterior cruciate ligament: An in vitro experimental study. Am. J. Sports Med. 2003;31:241–246. doi: 10.1177/03635465030310021401.
    1. Brandon SCE, Miller RH, Thelen DG, Deluzio KJ. Selective lateral muscle activation in moderate medial knee osteoarthritis subjects does not unload medial knee condyle. J. Biomech. 2014;47:1409–1415. doi: 10.1016/j.jbiomech.2014.01.038.
    1. Bennell KL, et al. Higher dynamic medial knee load predicts greater cartilage loss over 12 months in medial knee osteoarthritis. Ann. Rheum. Dis. 2011;70:1770–1774. doi: 10.1136/ard.2010.147082.
    1. Delp SL, et al. OpenSim: Open-source software to create and analyze dynamic simulations of movement. IEEE Trans. Biomed. Eng. 2007;54:1940–1950. doi: 10.1109/TBME.2007.901024.
    1. Seth A, et al. OpenSim: Simulating musculoskeletal dynamics and neuromuscular control to study human and animal movement. PLoS Comput. Biol. 2018 doi: 10.1371/journal.pcbi.1006223.
    1. Walker PS, Rovick JS, Robertson DD. The effects of knee brace hinge design and placement on joint mechanics. J. Biomech. 1988;21:965–974. doi: 10.1016/0021-9290(88)90135-2.
    1. Arnold EM, Ward SR, Lieber RL, Delp SL. A model of the lower limb for analysis of human movement. Ann. Biomed. Eng. 2010;38:269–279. doi: 10.1007/s10439-009-9852-5.
    1. Silder A, Whittington B, Heiderscheit B, Thelen DG. Identification of passive elastic joint moment-angle relationships in the lower extremity. J. Biomech. 2007;40:2628–2635. doi: 10.1016/j.jbiomech.2006.12.017.
    1. Dostal WF, Soderberg GL, Andrews JG. Actions of Hip Muscles. Phys. Ther. 1986;66:351–359. doi: 10.1093/ptj/66.3.351.
    1. Neumann DA. Kinesiology of the hip: A focus on muscular actions. J. Orthop. Sports Phys. Ther. 2010;40:82–94. doi: 10.2519/jospt.2010.3025.
    1. Blemker SS, Delp SL. Three-dimensional representation of complex muscle architectures and geometries. Ann. Biomed. Eng. 2005;33:661–673. doi: 10.1007/s10439-005-1433-7.
    1. De Pieri E, et al. Refining muscle geometry and wrapping in the TLEM 2 model for improved hip contact force prediction. PLoS ONE. 2018 doi: 10.1371/journal.pone.0204109.
    1. Sherman MA, Seth A, Delp SL. What is a moment arm? Calculating muscle effectiveness in biomechanical models using generalized coordinates. Proce. ASME Des. Eng. Tech. Conf. 2013 doi: 10.1115/DETC2013-13633.
    1. Zajac FE. Muscle and tendon: Properties, models, scaling, and application to biomechanics and motor control. Crit. Rev. Biomed. Eng. 1989;17:359–411.
    1. Millard M, Uchida T, Seth A, Delp SL. Flexing computational muscle: Modeling and simulation of musculotendon dynamics. J. Biomech. Eng. 2013;135:021005. doi: 10.1115/1.4023390.
    1. Arnold EM, Hamner SR, Seth A, Millard M, Delp SL. How muscle fiber lengths and velocities affect muscle force generation as humans walk and run at different speeds. J. Exp. Biol. 2013;216:2150–2160.
    1. Lauber B, Lichtwark GA, Cresswell AG. Reciprocal activation of gastrocnemius and soleus motor units is associated with fascicle length change during knee flexion. Physiol. Rep. 2014 doi: 10.14814/phy2.12044.
    1. Suydam SM, Manal K, Buchanan TS. The advantages of normalizing electromyography to ballistic rather than isometric or isokinetic tasks. J. Appl. Biomech. 2017;33:189–196. doi: 10.1123/jab.2016-0146.
    1. Piazza SJ, Erdemir A, Okita N, Cavanagh PR. Assessment of the functional method of hip joint center location subject to reduced range of hip motion. J. Biomech. 2004;37:349–356. doi: 10.1016/S0021-9290(03)00288-4.
    1. Barrios JA, Crossley KM, Davis IS. Gait retraining to reduce the knee adduction moment through real-time visual feedback of dynamic knee alignment. J. Biomech. 2010;43:2208–2213. doi: 10.1016/j.jbiomech.2010.03.040.
    1. Ipek. Normality test package. (2020).
    1. Benjamini Y, Hochberg Y. Controlling the false discovery rate: A practical and powerful approach to multiple testing. J. R. Stat. Soc. B. 1995;57:289–300.
    1. R Core Team. A language and environment for statistical computing (2019).
    1. Lakens D. Equivalence tests: A practical primer for t tests, correlations, and meta-analyses. Soc. Psychol. Personal. Sci. 2017;8:355–362. doi: 10.1177/1948550617697177.

Source: PubMed

Подписаться