Why do some schools struggle to retain staff? Development and validation of the Teachers' Working Environment Scale (TWES)
Corresponding Author
Sam Sims
UCL Institute of Education, London, UK
Correspondence
Sam Sims, 20 Bedford Way, Bloomsbury, London WC1H 0AL, UK.
Email: [email protected]
Search for more papers by this authorCorresponding Author
Sam Sims
UCL Institute of Education, London, UK
Correspondence
Sam Sims, 20 Bedford Way, Bloomsbury, London WC1H 0AL, UK.
Email: [email protected]
Search for more papers by this authorFunding information
None
Abstract
Many school systems face recurring shortages of qualified teachers. Research suggests that improving teachers’ working environment is one way of improving teachers’ job satisfaction and retention in the profession. However, working environment is inconsistently measured in the literature, hampering cumulation of knowledge. This article develops the first validated teacher-report measure of working environment. Theory and empirics were synthesised to define relevant constructs, then focus groups, expert consultation and cognitive interviews with teachers were used to generate and refine items. The resulting questionnaire displayed the hypothesised factor structure in two samples of teachers. The scale also showed strong predictive validity and the results help resolve a puzzle around the importance of workload in the existing empirical literature. Through improved measurement, the scale can help identify steps by which school leaders can improve retention.
Open Research
DATA AVAILABILITY STATEMENT
The data on which this article is based is not in the public domain.
Supporting Information
Filename | Description |
---|---|
rev33304-sup-0001-SupInfo.docxWord 2007 document , 1.2 MB | Supplementary Material |
Please note: The publisher is not responsible for the content or functionality of any supporting information supplied by the authors. Any queries (other than missing content) should be directed to the corresponding author for the article.
REFERENCES
- Allen, R., Benhenda, A., Jerrim, J., & Sims, S. (2020). New evidence on teachers’ working hours in England. An empirical analysis of four datasets. Research Papers in Education, 1–25. https://doi.org/10.1080/02671522.2020.1736616
- Allensworth, E., Ponisciak, S., & Mazzeo, C. (2009). The schools teachers leave: Teacher mobility in Chicago Public Schools. University of Chicago.
- Bakker, A. B., & Demerouti, E. (2017). Job demands–resources theory: Taking stock and looking forward. Journal of Occupational Health Psychology, 22(3), 273. https://doi.org/10.1037/ocp0000056
- Barmby, P. (2006). Improving teacher recruitment and retention: The importance of workload and pupil behaviour. Educational Research, 48(3), 247–265. https://doi.org/10.1080/00131880600732314
- Benson, J. (1998). Developing a strong program of construct validation: A test anxiety example. Educational Measurement: Issues and Practice, 17(1), 10–17. https://doi.org/10.1111/j.1745-3992.1998.tb00616.x
10.1111/j.1745-3992.1998.tb00616.x Google Scholar
- Borsboom, D., Mellenbergh, G. J., & van Heerden, J. (2004). The concept of validity. Psychological Review, 111(4), 1061–1071. https://doi.org/10.1037/0033-295X.111.4.1061
- Boyd, D., Grossman, P., Ing, M., Lankford, H., Loeb, S., & Wyckoff, J. (2011). The influence of school administrators on teacher retention decisions. American Educational Research Journal, 48(2), 303–333. https://doi.org/10.3102/0002831210380788
- Bozeman, B. (1993). A theory of government “red tape”. Journal of Public Administration Research and Theory, 3(3), 273–304.
- Brunner, M., Nagy, G., & Wilhelm, O. (2012). A tutorial on hierarchically structured constructs. Journal of Personality, 80(4), 796–846. https://doi.org/10.1111/j.1467-6494.2011.00749.x
- Burns, J. M. (1978). Leadership. Harper & Row.
- Cameron, M. (2006). Managing school discipline and implications for school social workers: A review of the literature. Children & Schools, 28(4), 219–227. https://doi.org/10.1093/cs/28.4.219
10.1093/cs/28.4.219 Google Scholar
- Campbell, D. T., & Fiske, D. W. (1959). Convergent and discriminant validation by the multitrait-multimethod matrix. Psychological Bulletin, 56(2), 81. https://doi.org/10.1037/h0046016
- Cheema, J. R. (2014). A review of missing data handling methods in education research. Review of Educational Research, 84(4), 487–508. https://doi.org/10.3102/0034654314532697
- Chen, F. F., Hayes, A., Carver, C. S., Laurenceau, J. P., & Zhang, Z. (2012). Modeling general and specific variance in multifaceted constructs: A comparison of the bifactor model to other approaches. Journal of Personality, 80(1), 219–251. https://doi.org/10.1111/j.1467-6494.2011.00739.x
- Clifford, M., Menon, R., Gangi, T., Condon, C., & Hornung, K. (2012). Measuring school climate for gauging principal performance: A review of the validity and reliability of publicly accessible measures. American Institutes for Research.
- Collie, R. J., Shapka, J. D., Perry, N. E., & Martin, A. J. (2016). Teachers’ psychological functioning in the workplace: Exploring the roles of contextual beliefs, need satisfaction, and personal characteristics. Journal of Educational Psychology, 108(6), 788–799. https://doi.org/10.1037/edu0000088
- European Commission [EC] (2013). Study on policy measures to improve the attractiveness of the teaching profession in Europe (Volume 2).
- European Commission [EC] (2013). Study on policy measures to improve the attractiveness of the teaching profession in Europe (Volume 1).
- Cooper Gibson Research (2018). Factors affecting teacher retention: Qualitative investigation. Department for Education.
- Crawford, E. R., LePine, J. A., & Rich, B. L. (2010). Linking job demands and resources to employee engagement and burnout: A theoretical extension and meta-analytic test. Journal of Applied Psychology, 95(5), 834–848. https://doi.org/10.1037/a0019364
- Cronbach, L. J., & Meehl, P. E. (1955). Construct validity in psychological tests. Psychological Bulletin, 52(4), 281–302. https://doi.org/10.1037/h0040957
- Cuban, L. (1988). The managerial imperative and the practice of leadership in schools. State University of New York Press.
- DeCastellarnau, A. (2018). A classification of response scale characteristics that affect data quality: A literature review. Quality & Quantity, 52(4), 1523–1559. https://doi.org/10.1007/s11135-017-0533-4
- Deci, E. L., & Ryan, R. M. (2000). The “what” and “why” of goal pursuits: Human needs and the self-determination of behavior. Psychological Inquiry, 11, 227–268. https://doi.org/10.1207/S15327965PLI1104_01
- Deci, E. L., & Ryan, R. M. (2008). Facilitating optimal motivation and psychological well-being across life’s domains. Canadian Psychology, 49(1), 14–23. https://doi.org/10.1037/0708-5591.49.1.14
- Deci, E. L., Ryan, R. M., Gagné, M., Leone, D. R., Usunov, J., & Kornazheva, B. P. (2001). Need satisfaction, motivation, and well-being in the work organizations of a former eastern bloc country: A cross-cultural study of self-determination. Personality and Social Psychology Bulletin, 27(8), 930–942. https://doi.org/10.1177/0146167201278002
- Demerouti, E., Bakker, A. B., Nachreiner, F., & Schaufeli, W. B. (2001). The job demands-resources model of burnout. Journal of Applied Psychology, 86, 499–512. https://doi.org/10.1037/0021-9010.86.3.499
- Dolton, P. (2020). Teacher supply. In S. Bradley, & C. Green (Eds.), The economics of education: A comprehensive overview ( 2nd ed., pp. 391–402). Elsevier.
10.1016/B978-0-12-815391-8.00028-8 Google Scholar
- Donaldson, M. L. (2013). Principals’ approaches to cultivating teacher effectiveness: Constraints and opportunities in hiring, assigning, evaluating, and developing teachers. Educational Administration Quarterly, 49(5), 838–882. https://doi.org/10.1177/0013161X13485961
- Donaldson, M. L., & Johnson, S. M. (2010). The price of misassignment: The role of teaching assignments in Teach for America teachers’ exit from low-income schools and the teaching profession. Educational Evaluation and Policy Analysis, 32(2), 299–323. https://doi.org/10.3102/0162373710367680
- Duyar, I., Gumus, S., & Sukru Bellibas, M. (2013). Multilevel analysis of teacher work attitudes: The influence of principal leadership and teacher collaboration. International Journal of Educational Management, 27(7), 700–719.
10.1108/IJEM-09-2012-0107 Google Scholar
- Fackler, S., & Malmberg, L. (2016). Teachers’ self-efficacy in 14 OECD countries: Teacher, student group, school and leadership effects. Teaching and Teacher Education, 56, 185–195. https://doi.org/10.1016/j.tate.2016.03.002
- Fernet, C., Austin, S., Trépanier, S. G., & Dussault, M. (2013). How do job characteristics contribute to burnout? Exploring the distinct mediating roles of perceived autonomy, competence, and relatedness. European Journal of Work and Organizational Psychology, 22(2), 123–137. https://doi.org/10.1080/1359432X.2011.632161
- Fernet, C., Trépanier, S. G., Austin, S., Gagné, M., & Forest, J. (2015). Transformational leadership and optimal functioning at work: On the mediating role of employees’ perceived job characteristics and motivation. Work & Stress, 29(1), 11–31. https://doi.org/10.1080/02678373.2014.1003998
- Feuerhahn, N., Bellingrath, S., & Kudielka, B. M. (2013). The interplay of matching and non-matching job demands and resources on emotional exhaustion among teachers. Applied Psychology: Health and Well-being, 5(2), 171–192.
- Flake, J. K., Barron, K. E., Hulleman, C., McCoach, B. D., & Welsh, M. E. (2015). Measuring cost: The forgotten component of expectancy-value theory. Contemporary Educational Psychology, 41, 232–244. https://doi.org/10.1016/j.cedpsych.2015.03.002
- Flake, J. K., & Fried, E. I. (2019). Measurement schmeasurement: Questionable measurement practices and how to avoid them. https://psyarxiv.com/hs7wm/download?format=pdf
- Flake, J. K., Pek, J., & Hehman, E. (2017). Construct validation in social and personality research: Current practice and recommendations. Social Psychological and Personality Science, 8(4), 370–378. https://doi.org/10.1177/1948550617693063
- Flora, D. B., & Flake, J. K. (2017). The purpose and practice of exploratory and confirmatory factor analysis in psychological research: Decisions for scale development and validation. Canadian Journal of Behavioural Science, 49(2), 78–88. https://doi.org/10.1037/cbs0000069
- Fowler, F. J. (2009). Survey research methods ( 4th ed.). Sage.
- Gagné, M., & Deci, E. L. (2005). Self-determination theory and work motivation. Journal of Organizational Behavior, 26(4), 331–362. https://doi.org/10.1002/job.322
- Gangi, T. A. (2009). School climate and faculty relationships: Choosing an effective assessment measure (Doctoral dissertation). St. John’s University, New York, NY.
- Gehlbach, H., & Brinkworth, M. E. (2011). Measure twice, cut down error: A process for enhancing the validity of survey scales. Review of General Psychology, 15(4), 380–387. https://doi.org/10.1037/a0025704
- Gibbons, S., Scrutinio, V., & Telhaj, S. (2018). Teacher turnover: Does it matter for pupil achievement? CEP Discussion Paper No. 1530. LSE.
- Grissom, J. A., Nicholson-Crotty, S., & Harrington, J. R. (2014). Estimating the effects of No Child Left Behind on teachers’ work environments and job attitudes. Educational Evaluation and Policy Analysis, 36(4), 417–436. https://doi.org/10.3102/0162373714533817
- Gu, Q., & Day, C. (2013). Challenges to teacher resilience: Conditions count. British Educational Research Journal, 39(1), 22–44.
- Gustafsson, J.-E., & Åberg-Bengtsson, L. (2010). Unidimensionality and interpretability of psychological instruments. In S. E. Embretson (Ed.), Measuring psychological constructs: Advances in model-based approaches (pp. 97–121). American Psychological Association.
10.1037/12074-005 Google Scholar
- Hakanen, J. J., Bakker, A. B., & Schaufeli, W. B. (2006). Burnout and work engagement among teachers. Journal of School Psychology, 43, 495–513. https://doi.org/10.1016/j.jsp.2005.11.001
- Hendricks, M. D. (2014). Does it pay to pay teachers more? Evidence from Texas. Journal of Public Economics, 109, 50–63. https://doi.org/10.1016/j.jpubeco.2013.11.001
- Hopkins, M., Bjorklund, P. Jr, & Spillane, J. P. (2019). The social side of teacher turnover: Closeness and trust among general and special education teachers in the United States. International Journal of Educational Research, 98, 292–302. https://doi.org/10.1016/j.ijer.2019.08.020
- Hu, L., & Bentler, P. M. (1999). Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling, 6, 1–55. https://doi.org/10.1080/10705519909540118
- Ingersoll, R. M. (2001). Teacher turnover and teacher shortages: An organizational analysis. American Educational Research Journal, 38(3), 499–534. https://doi.org/10.3102/00028312038003499
- Jarzabkowski, L. (2003). Teacher collegiality in a remote Australian school. Journal of Research in Rural Education, 18(3), 139–144.
- Jóhannesson, I. Á. (2006). ‘Different children—A tougher job’: Icelandic teachers reflect on changes in their work. European Educational Research Journal, 5(2), 140–151.
10.2304/eerj.2006.5.2.140 Google Scholar
- Johnson, S. M., & Birkeland, S. E. (2003). Pursuing a ‘sense of success’: New teachers explain their career decisions. American Educational Research Journal, 40(3), 581–617. https://doi.org/10.3102/00028312040003581
- Johnson, S. M., Kardos, S. M., Kauffman, D., Liu, E., & Donaldson, M. L. (2004). The support gap: New teachers’ early experiences in high-income and low-income schools. Education Policy Analysis Archives, 12(61), 1–24. https://doi.org/10.14507/epaa.v12n61.2004
- Johnson, S. M., Kraft, M. A., & Papay, J. P. (2012). How context matters in high-need schools: The effects of teachers’ working conditions on their professional satisfaction and their students’ achievement. Teachers College Record, 114(10), 1–39.
- Kelchtermans, G. (2006). Teacher collaboration and collegiality as workplace conditions. A review. Zeitschrift Für Pädagogik, 52(2), 220–237.
- Kelley, T. L. (1927). Interpretation of educational measurements. World Book Company.
- Kraft, M. A., Marinell, W. H., & Shen-Wei Yee, D. (2016). School organizational contexts, teacher turnover, and student achievement: Evidence from panel data. American Educational Research Journal, 53(5), 1411–1449. https://doi.org/10.3102/0002831216667478
- Kraft, M. A., Papay, J. P., Johnson, S. M., Charner-Laird, M., Ng, M., & Reinhorn, S. (2015). Educating amid uncertainty: The organizational supports teachers need to serve students. Educational Administration Quarterly, 51(5), 753–790. https://doi.org/10.1177/0013161X15607617
- Krosnick, J. A. (1999). Survey research. Annual Review of Psychology, 50, 537–567. https://doi.org/10.1146/annurev.psych.50.1.537
- Ladd, H. F. (2011). Teachers’ perceptions of their working conditions: How predictive of planned and actual teacher movement? Educational Evaluation and Policy Analysis, 33(2), 235–261. https://doi.org/10.3102/0162373711398128
- Leiter, M. P., & Maslach, C. (1999). Six areas of worklife: A model of the organizational context of burnout. Journal of Health and Human Resources Administration, 21, 472–489.
- Leiter, M., & Maslach, C. (2003). Areas of worklife: a structured approach to organizational predictors of job burnout. In P. Perrewe & D. Ganster, (Ed.) Emotional and physiological processes and positive intervention strategies. (pp. 91–134). Emerald Group Publishing Limited.
10.1016/S1479-3555(03)03003-8 Google Scholar
- Loeb, S., Darling-Hammond, L., & Luczak, J. (2013). How teaching conditions predict teacher turnover in California schools. Peabody Journal of Education, 80(3), 44–70. https://doi.org/10.1207/s15327930pje8003_4
10.1207/s15327930pje8003_4 Google Scholar
- Loevinger, J. (1957). Objective tests as instruments of psychological theory. Psychological Reports, 3, 635–694. https://doi.org/10.2466/pr0.1957.3.3.635
- Lopes, J., & Oliveira, C. (2020). Teacher and school determinants of teacher job satisfaction: A multilevel analysis. School Effectiveness and School Improvement, 31(4), 641–659. https://doi.org/10.1080/09243453.2020.1764593
- Marinell, W. H., & Coca, V. M. (2013). “Who stays and who leaves?” Findings from a three-part study of teacher turnover in NYC middle schools. https://steinhardt.nyu.edu/scmsAdmin/media/users/sg158/PDFs/ttp_synthesis/TTPSynthesis_Report_March2013.pdf
- Maul, A. (2017). Rethinking traditional methods of survey validation. Measurement: Interdisciplinary Research and Perspectives, 15(2), 51–69.
10.1080/15366367.2017.1348108 Google Scholar
- Meredith, W., & Teresi, J. A. (2006). An essay on measurement and factorial invariance. Medical Care, 44, S69–S77. https://doi.org/10.1097/01.mlr.0000245438.73837.89
- National School Climate Council (2007). The School Climate Challenge: Narrowing the gap between school climate research and school climate policy, practice guide- lines and teacher education policy. http://www.schoolclimate.org/climate/advocacy.php
- Organisation for Economic Co-operation and Development [OECD] (2010). TALIS 2008 technical report. OECD Publishing. https://www.oecd-ilibrary.org/education/talis-2008-technical-report_9789264079861-en
- Organisation for Economic Co-operation and Development [OECD] (2014). TALIS 2013 technical report. OECD Publishing. http://www.oecd.org/education/school/TALIS-technical-report-2013.pdf
- Organisation for Economic Co-operation and Development [OECD] (2018). PISA 2018 results (Volume V): Effective policies, successful schools. OECD. https://cutt.ly/Wkkirn1
- Orphanos, S., & Orr, M. T. (2014). Learning leadership matters: The influence of innovative school leadership preparation on teachers’ experiences and outcomes. Educational Management Administration & Leadership, 42(5), 680–700. https://doi.org/10.1177/1741143213502187
- Papay, J. P., & Kraft, M. A. (2017). Developing workplaces where teachers stay, improve, and succeed. In E. Quintero (Ed.), Teaching in context: How social aspects of school and school systems shape teachers’ development & effectiveness (pp. 15–35). Harvard Education Press.
- Perryman, J., & Calvert, G. (2019). What motivates people to teach, and why do they leave? Accountability, performativity and teacher retention. British Journal of Educational Studies, 68(1), 3–23.
- Podsakoff, P. M., MacKenzie, S. B., & Podsakoff, N. P. (2012). Sources of method bias in social science research and recommendations on how to control it. Annual Review of Psychology, 63, 539–569. https://doi.org/10.1146/annurev-psych-120710-100452
- Prieto, L. L., Soria, M. S., Martínez, I. M., & Schaufeli, W. (2008). Extension of the Job Demands-Resources model in the prediction of burnout and engagement among teachers over time. Psicothema, 20(3), 354–360.
- Reeve, J., & Su, Y. L. (2014). Teacher motivation. In M. Gagne (Ed.), The Oxford handbook of work engagement, motivation, and self-determination theory (pp. 349–362). Oxford University Press.
- Reeves, P. M., Pun, W. H., & Chung, K. S. (2017). Influence of teacher collaboration on job satisfaction and student achievement. Teaching and Teacher Education, 67, 227–236. https://doi.org/10.1016/j.tate.2017.06.016
- Robinson, V. M., Lloyd, C. A., & Rowe, K. J. (2008). The impact of leadership on student outcomes: An analysis of the differential effects of leadership types. Educational Administration Quarterly, 44(5), 635–674. https://doi.org/10.1177/0013161X08321509
- Ronfeldt, M., Loeb, S., & Wyckoff, J. (2013). How teacher turnover harms student achievement. American Educational Research Journal, 50(1), 4–36. https://doi.org/10.3102/0002831212463813
- Ryan, R. M., & Deci, E. L. (2011). A self-determination theory perspective on social, institutional, cultural, and economic supports for autonomy and their importance for well-being. In V. I. Chirkov, R. M. Ryan, & K. M. Sheldon (Ed.), Human autonomy in cross-cultural context (pp. 45–64). Springer.
10.1007/978-90-481-9667-8_3 Google Scholar
- Salokangas, M., Wermke, W., & Harvey, G. (2020). Teachers’ autonomy deconstructed: Irish and Finnish teachers’ perceptions of decision-making and control. European Educational Research Journal, 19(4), 329–350. https://doi.org/10.1177/1474904119868378
- Shadish, W. R., Cook, T. D., & Campbell, D. T. (2002). Experimental and quasi-experimental designs for generalized causal inference. Houghton Mifflin.
- Shen, J. (1997). Teacher retention and attrition in public schools: Evidence from SASS ’91. Journal of Educational Research, 91, 81–88. https://doi.org/10.1080/00220679709597525
- Shrivastava, P., & Mitroff, I. I. (1984). Enhancing organizational research utilization: The role of decision makers’ assumptions. Academy of Management Review, 9(1), 18–26. https://doi.org/10.5465/amr.1984.4277749
- Simkins, T. (2012). Understanding school leadership and management development in England: Retrospect and prospect. Educational Management Administration & Leadership, 40(5), 621–640. https://doi.org/10.1177/1741143212451172
- Simon, N. S., & Johnson, S. M. (2015). Teacher turnover in high-poverty schools: What we know and can do. Teachers College Record, 117(3), 1–36.
- Sims, S. (2018). Essays on the recruitment and retention of teachers (Doctoral dissertation). UCL.
- Sims, S. (2020). Modelling the relationships between teacher working conditions, job satisfaction and workplace mobility. British Educational Research Journal, 46(2), 301–320. https://doi.org/10.1002/berj.3578
- Skaalvik, E. M., & Skaalvik, S. (2011). Teacher job satisfaction and motivation to leave the teaching profession: Relations with school context, feeling of belonging, and emotional exhaustion. Teaching and Teacher Education, 27(6), 1029–1038. https://doi.org/10.1016/j.tate.2011.04.001
- Skaalvik, E. M., & Skaalvik, S. (2017). Still motivated to teach? A study of school context variables, stress and job satisfaction among teachers in senior high school. Social Psychology of Education, 20(1), 15–37. https://doi.org/10.1007/s11218-016-9363-9
- Slemp, G. R., Kern, M. L., Patrick, K. J., & Ryan, R. M. (2018). Leader autonomy support in the workplace: A meta-analytic review. Motivation and Emotion, 42(5), 706–724. https://doi.org/10.1007/s11031-018-9698-y
- Steen-Olsen, T., & Eikseth, A. G. (2010). The power of time: Teachers’ working day—Negotiating autonomy and control. European Educational Research Journal, 9(2), 284–295. https://doi.org/10.2304/eerj.2010.9.2.284
10.2304/eerj.2010.9.2.284 Google Scholar
- Strauss, M. E. & Smith, G. T. (2009). Construct validity: Advances in theory and methodology. Annual Review of Clinical Psychology, 5, 1–25.
- Thapa, A., Cohen, J., Guffey, S., & Higgins-D’Alessandro, A. (2013). A review of school climate research. Review of Educational Research, 83(3), 357–385. https://doi.org/10.3102/0034654313483907
- Thompson, E. R., & Phua, F. T. (2012). A brief index of affective job satisfaction. Group & Organization Management, 37(3), 275–307. https://doi.org/10.1177/1059601111434201
- Thorndike, E. L. (1904). An introduction to the theory of mental and social measurements. Columbia University Press.
10.1037/13283-000 Google Scholar
- Timms, C., Graham, D., & Cottrell, D. (2007). “I just want to teach” Queensland independent school teachers and their workload. Journal of Educational Administration, 45(5), 569–586. https://doi.org/10.1108/09578230710778204
10.1108/09578230710778204 Google Scholar
- Toropova, A., Myrberg, E., & Johansson, S. (2021). Teacher job satisfaction: The importance of school working conditions and teacher characteristics. Educational Review, 73(1), 71–97. https://doi.org/10.1080/00131911.2019.1705247
- Torres, A. C. (2016). Is this work sustainable? Teacher turnover and perceptions of workload in charter management organizations. Urban Education, 51(8), 891–914. https://doi.org/10.1177/0042085914549367
- Weidman, A. C., Steckler, C. M., & Tracy, J. L. (2017). The jingle and jangle of emotion assessment: Imprecise measurement, casual scale usage, and conceptual fuzziness in emotion research. Emotion, 17(2), 267. https://doi.org/10.1037/emo0000226
- Weiss, E. M. (1999). Perceived workplace conditions and first-year teachers’ morale, career choice commitment, and planned retention: A secondary analysis. Teaching and Teacher Education, 15(8), 861–879. https://doi.org/10.1016/S0742-051X(99)00040-2
- White, P. & Smith, E. (2005). What can PISA tell us about teacher shortages?. European Journal of Education, 40(1), 93–112.
10.1111/j.1465-3435.2005.00212.x Google Scholar
- Willis, G. B. (2004). Cognitive interviewing: A tool for improving questionnaire design. Sage.