CURRICULUM VITEA JOSINE VERHAGEN Contact Information Dr. A.J. (Josine) Verhagen 655 South Fair Oaks avenue J1116 94086 CA Sunnyvale Mobile: +1-669 237 8320 E-mail: josineverhagen@gmail.com Website: www.josineverhagen.com Experience October 2014 - present 2014 Director of psychometrics, Kidaptive Responsible for the statistical models behind adaptive educational games. Research topics: IRT applied to games, Bayesian abiliy estimation, machine learning, learning analystics January 2014 - October 2014 Psychometric consultant, Kidaptive Advice on the topics of IRT, adaptive learning, Bayesian ability estimation, data analysis January 2014 - October 2014 Assistant Professor, University of Amsterdam Research interests: Bayesian model selection, Bayesian Item Response Theory models, Bayesian adaptive testing. Teaching Responsibilities: Statistics in R (2nd year Bachelor), Experimental design (3rd year Bachelor), Introduction to Bayesian statistics (3rd year Bachelor), Meta-analysis (Research Master), WinBUGS workshop (Interested researchers). December 2012 - December 2013 Postdoctoral Researcher, University of Amsterdam Project: Model selection for Bayesian ANOVA models The project involved the development of standard Bayesian model selection procedures for the broad class of ANOVA models, to be implemented in a software package for general use. Project leader : Eric-Jan Wagenmakers Teaching: Experimental design (Full responsibility) , Bayesian Graphical modeling (Assistant), WinBUGS workshop (Assistant) October 2011 - December 2011 Visiting scholar, Arizona State University Visit to Roger Millsap for a project comparing Bayesian and Frequentist measurement invariance tests. May 2008 - November 2012 PhD Candidate, University of Twente Project: Bayesian IRT models for measurement variance Daily supervisor: Jean-Paul Fox, Promotor: Cees Glas The project involved acquisition of skills in Bayesian data analysis and advanced programming, as well as the development of a comprehensive framework for Bayesian modeling and testing of measurement noninvariance using random item effects. 1 Teaching responsibilities included restructuring the course ”Onderzoeksopzet en data-analyse”, creating lectures and exams on logistic regression, mediation and moderation and giving first year psychology lectures in methodology and statistics. October 2006 - April 2008 Academic researcher, SCP The Netherlands Institute for Social Research (SCP) is a government agency which conducts research into the social aspects of all areas of government policy. The reports published by SCP are widely used by government, civil servants, local authorities and academics. My tasks at the SCP included research on non-response and its effects on the results of the Amenities and Social Services Utilization Survey of 2003 resulting in the publication: ”De ongrijpbare non-respondent”, and serving as a statistical advisor for SCP researchers. February 2006 - July 2006 Internship, SCP The internship consisted of the investigation of the effects of response-enhancing techniques resulting in the SCP-publication: ”Strong Opinions?”, providing statistical advise to SCP researchers, and exploring possibilities for replacing the software package SPSS with the package STATA. September 2003 - December 2007 Student-assistant, Leiden University Supervisor/teacher of practical classes (in Dutch and English) for first year to research master students on various (advanced) data analysis techniques. This involved running 15-20 student classes independently, assisting students with assignments and grading papers. January 2004 - September 2007 Statistics tutor Assisting students with the preparation of exams and the analysis of thesis results. Education 2008 - 2012 Ph.D. in psychometrics, University of Twente 2001 - 2008 Psychology, Leiden University (Msc.) Methodology and Statistics (April 2008) Thesis: ’Distance based multivariate trees for the prediction of multiple binary variables. Predicting the comorbidity of psychological disorders.’ (cum laude) Social and Organizational psychology (October 2006) Thesis: ’Relations at work: On the effects of social capital in formal and informal relations on the performance of R&D teams.’ (cum laude) 1995 - 2001 Gymnasium Erasmianum, Rotterdam (pre-university education) Subjects: Dutch, English, French, Greek, Physics, Chemistry, Math B, Biology (cum laude) Professional skills Software • Latex for creating papers, presentations and posters 2 • Fortran, R and Splus, Winbugs, JAGS, and to some degree Matlab • SPSS, Stata, EQS, MLWIN and IRTPRO Languages • • • • Dutch: excellent speaking, reading and writing English: good speaking, reading and writing French: moderate speaking, reading and writing (Certificate of level B2) German: moderate speaking, reading and writing Additional activities Toastmasters Area Governor, Assistant Division Governor Marketing, Club Founder, Club President, Secretary, Vice president of education, Member Toastmasters International is an organization which aims to improve its members’ public speaking and leadership skills. I successfully completed advanced communicator and advance leadership programmes (Bronze level). As vice president education at Twente Toastmasters I was responsible for planning club meetings in such a way that each member can achieve his or her educational goals. After moving to Amsterdam I founded the new club Fusion Toastmasters, of which I have been the president for a year. I also served on the division J council responsible for creating a better climate for new clubs in the Netherlands. I am the District 4 G6 area governor for 2015-2016, responsible for suporting the 6 clubs in that area. Phd Network of the University of Twente (P-NUT) President (May 2010 - May 2011), Board member from May 2009 The goals of P-NUT are to represent, inform and connect PhD candidates at the University of Twente. As a board member I have been contact person for the University board, the Twente Graduate School and the HR department, representative for P-NUT in the national Phd Network Netherlands (PNN) and involved in the organization of social events and lunch meetings on diverse topics for PhD candidates. As president I initiated a professionalisation process, leading towards an officially recognized association. Honours Research Project and Honours lectures • During the third year extracurricular Honours Research Project, I conducted a longitudinal study on the influence of a segregated versus integrated social environment on the process of discrimination and stereotype threat driven disidentification with the academic domain with dr. Colette van Laar. • I participated in the second year honours lectures of the Psychology department at Leiden University. Scientific Achievements Awards and Grants ETS travel award for the International Meeting of the Psychometric Society (IMPS) 2011 Analyzing Longitudinal Survey Data: A Bayesian IRT Model with Occasion-Specific Item Parameters PhD Mobility Fund (IBR, University of Twente) for a visit to Roger Millsap (ASU, Fall 2012) Comparing traditional and Bayesian tests for measurement invariance 3 Committees I served as an expert on the PhD defense committee of Suzanne Jak (September 27, 2013), regarding her thesis on cluster bias. Reviews I have been reviewer for: Journal of Probability and Statistics, Asia Pacific Education Review, Psychiatry Research, Statistics and Computing, and Acta Politica. Publications and Presentations Published papers and chapters: Boekel, W., Wagenmakers, E.-J., Belay, L., Verhagen, A. J., Brown, S. D., & Forstmann, B. U. (2015). A purely confirmatory replication study of structural brain-behavior correlations. Cortex, 66, 115-133. Wagenmakers, E.-J., Beek, T., Rotteveel, M., Gierholz, A., Matzke, D., Steingroever, H., Ly, A., Verhagen, A. J., Selker, R., Sasiadek, A., Gronau, Q. F., Love, J., & Pinto, Y. (2015). Turning the hands of time again: A purely confirmatory replication study and a Bayesian analysis. Frontiers in Psychology: Cognition, 6, 494. Andraszewicz, S., Scheibehenne, B., Rieskamp, J., Grasman, R. P. P. P., Verhagen, A. J., & Wagenmakers, E.-J. (2015). An introduction to Bayesian hypothesis testing for management research. Journal of Management, 41, 521-543. Fox, J.-P., M. Marsman, J. Mulder, & J. Verhagen (2015). Complex latent variable modeling in educational assessment. Communications in Statistics Simulation and Computation. (doi:10.1080/03610918.2014.939518) Morey, R. D., Rouder, J. N., Verhagen, J., & Wagenmakers, E.-J. (in press). Why hypothesis tests are essential for psychological science: A comment on Cumming. Psychological Science. Verhagen, A. J., & Wagenmakers, E.-J. (2014). Bayesian tests to quantify the result of a replication attempt. Journal of Experimental Psychology: General, 143, 1457-1475. Van den Berg SM, de Moor MHM, McGue M, Pettersson E, Terracciano A, Verweij KJH, Amin N, Derringer J, Esko E,van GrootheestG, Hansell NK, Huffman J, Konte B, Lahti J, Luciano M, Matteson LK, Viktorin A, Wouda J, Agrawal A,Allik J, Bierut L, Broms U, Campbell H, Davey Smith G, Eriksson JG, Ferrucci L, Franke B, Fox JP, de Geus EJC, Giegling I, Gow AJ, Grucza R, Hartmann AM, Heath AC, Heikkil K, Iacono WG, Janzing J, Jokela M, Kiemeney L, Lehtimki T, Madden PAF, Magnusson PKE, Northstone K, Nutile T, Ouwens KG, Palotie A, Pattie A, Pesonen A-K, Polasek O, Pulkkinen L, Pulkki-Rback L, Raitakari OT, Realo A, Rose RJ, Ruggiero D, Seppl I, Slutske WS, Smyth DC, Sorice R, Starr JM, Sutin AR, Tanaka T, Verhagen J, Vermeulen S, Eero Vuoksimaa, Widen E, Willemsen G, Wright MJ, Zgaga L, Rujescu D, Metspalu A, Wilson JF, Ciullo M, Hayward C, Rudan I, Deary IJ, Rikknen K,Arias Vasquez A, Costa PT, Keltikangas-Jrvinen L, van Duijn CM, Penninx BWJH, Krueger RF, Evans DM, Kaprio J,Pedersen NL, Martin NG, Boomsma DI (in press). Harmonization of Neuroticism and Extraversion phenotypes across inventories and cohorts in the Genetics of Personality Consortium: An application of Item Response Theory. Behavior Genetics. De Groot, A. D. (1956/2014). The meaning of “significance” for different types of research. Translated and annotated by Eric-Jan Wagenmakers, Denny Borsboom, Josine Verhagen, Rogier Kievit, Marjan Bakker, Angelique Cramer, Dora Matzke, Don Mellenbergh, and Han L. J. van der Maas. Acta Psychologica, 148, 188-194. Verhagen, A. J., & Fox, J.-P. (2013). Longitudinal measurement in health-related surveys. A Bayesian joint growth model for multivariate ordinal responses. Statistics in Medicine, 32, 2988-2005. 4 Verhagen, A. J., & Fox, J.-P. (2013). Bayesian tests of measurement invariance. The British Journal of Mathematical and Statistical Psychology, 66, 383-401. Verhagen, A. J. (2012). Bayesian Item Response Theory Models for Measurement Variance. PhD Thesis, University of Twente. Fox. J.-P., & Verhagen, A. J. (2010). Random item effects modeling for cross-national survey data. In: E. Davidov, P. Schmidt & J. Billiet (Eds.), Cross-Cultural Analysis: Methods and Applications (pp.467488). Routledge. In press: Verhagen, A. J., Levy, R., Millsap, R.E, & Fox, J.-P. (in press). Evaluating evidence for invariant items: a Bayes factor applied to testing measurement invariance in IRT models. Journal of Mathematical Psychology. Wagenmakers, E.-J., Verhagen, A. J., & Ly, A. (in press). How to quantify the evidence for the absence of a correlation. Behavior Research Methods. Wagenmakers, E.-J., Verhagen, A. J., Ly, A., Matzke, D., Steingroever, H., Rouder, J. N.,& Morey, R. D. (in press). The need for Bayesian hypothesis testing in psychological science. In Lilienfeld, S. O., & Waldman, I. (Eds.), Psychological Science Under Scrutiny: Recent Challenges and Proposed Solutions. John Wiley and Sons. Wagenmakers, E.-J., Verhagen, A. J., Ly, A., Bakker, M., Lee, M. D., Matzke, D., Rouder, J. N., & Morey, R. D. (in press). A power fallacy. Behavior Research Methods. Submitted : Ly, A., Verhagen, A. J., & Wagenmakers, E.-J. (2014). Harold Jeffreyss default Bayes factor hypothesis tests: Explanation, extension, and application in psychology. Manuscript submitted for publication. Ly, A., Verhagen, A. J., Grasman, R. P. P. P., Wagenmakers, E.-J. (2014). A tutorial on Fisher information. Manuscript submitted for publication. Rouder, J. N., Morey, R. D., Verhagen, J. A., Province, J. M., & Wagenmakers, E.-J. (2014). The p ¡ .05 rule and the hidden costs of the free lunch in inference. Manuscript submitted for publication. Other publications: Verhagen, A. J. (2008). De ongrijpbare nonrespondent. Vergelijking van nonrespons bij het AVO in 1999 en 2003. The Hague, SCP. http://www.scp.nl/Publicaties/Alle publicaties/Publicaties 2008/De ongrijpbare nonrespondent Verhagen, A. J. (2007). Robuuste meningen. Het effect van responsverhogende strategien bij het onderzoek Culturele Veranderingen in Nederland. The Hague, SCP. http://www.scp.nl/Publicaties/Alle publicaties/Publicaties 2007/Robuuste meningen Conference presentations: Verhagen A. J. (April 17, 2015). A Bayesian framework for Adaptive Learning in educational games. Paper presented at the NCME conference, Chicago. Verhagen A. J., & Wagenmakers, E.-J. (July 20, 2014). Bayesian Tests to Quantify the Results of a Replication Attempt. Paper presented at the conference for Mathematical Psychology, Quebec City. Verhagen A. J. (July 22, 2014). Developing a Bayesian IRT Framework for Adaptive Learning in Educational Games. Paper presented at the IMPS conference, Madison, Wisconsin. 5 Verhagen A. J., Morey,R.D., Rouder,J.N., Wagenmakers, E.-J. (August 5, 2013). A default Bayes factor hypothesis test for crossed random effects designs. Paper presented at the conference for Mathematical Psychology, Berlin. Verhagen, A. J. (June 2012). Bayesian IRT models for measurement variance. IOPS, Maastricht. Verhagen A. J. (July 22, 2011). Analyzing Longitudinal Survey Data: A Bayesian IRT Model with Random Occasion-Specific Item Parameters. Paper presented at the IMPS conference, Hong Kong. Verhagen A. J. (March 18, 2011). Bayesian models for longitudinal measurement non-invariance. Presentation at the 8th International Amsterdam Conference on Multilevel Analysis, Amsterdam, Nederland. Verhagen A. J. (November 11, 2010). Country-specific Measurement of Attitude towards Immigration Without Using Anchor Items. Paper presented at the ESS workshop, Den Haag, Nederland. Verhagen A. J. (July 7, 2010). Large Cross-national Survey Analysis: Bayesian Testing for Measurement Invariance. Presentation at the IMPS conference, Athens, Georgia, USA. Verhagen, A. J. (December 10, 2009). Testing cross-national invariance; a random effects approach. Poster presentation at the CONBRATRI conference, Florianopolis, Brazil. Verhagen, A. J. (2007, June). Early Respondents, Late Respondents and Traumatic Events in the Midst of Fieldwork. Presentation at the ESRA conference 2007, Prague. 6