The broad goal of this work is to study the effectiveness of teamwork training methods, experience in teams, and receiving various forms of feedback on the development of team skills and the ability to evaluate teamwork. The research leverages the NSF’s prior investment in the CATME system to measure teamwork.
The CATME system automates some of the data collection and feedback, providing input to some of the seven empirical studies required to explore these research questions.
Outcomes. We focus on team-member effectiveness and the ability to evaluate one’s own effectiveness in a team and that of one’s teammates.
Strategies. Frame-of-reference training is proven to improve team member effectiveness and rating ability in this context. We are compiling data for students with varying levels of experience working in teams and different amounts of experience in self- and peer-evaluation. A complex study design to evaluate feedback strategies has been designed in collaboration with a new partner university.
This presentation (Executive Summary and Poster) will provide a valuable update on this project, share various lessons for classroom practice, and provide guidance to other faculty who seek to use CATME in their research. In particular for this year, we have advanced the tool kit for research using nested team data. The poster and paper will include pointers to resources for other instructors/researchers who want to conduct similar studies.
http://orcid.org/0000-0003-4052-1452
Purdue University-Main Campus, West Lafayette (College of Engineering)
[biography]
Matthew W. Ohland is Associate Head and the Dale and Suzi Gallagher of Professor of Engineering Education at Purdue University. He has degrees from Swarthmore College, Rensselaer Polytechnic Institute, and the University of Florida. His research on the longitudinal study of engineering students, team assignment, peer evaluation, and active and collaborative teaching methods has been supported by the National Science Foundation and the Sloan Foundation and his team received for the best paper published in the Journal of Engineering Education in 2008, 2011, and 2019 and from the IEEE Transactions on Education in 2011 and 2015. Dr. Ohland is an ABET Program Evaluator for ASEE. He was the 2002–2006 President of Tau Beta Pi and is a Fellow of the ASEE, IEEE, and AAAS.
Misty L. Loughry, Ph.D. is a Professor of Management in the Crummer Graduate School of Business at Rollins College. She studies peer control, peer evaluation, and teamwork. She earned her Ph.D. from University of Florida.
David J. Woehr is currently Professor and Chair of the Department of Management at The University of North Carolina at Charlotte. He received his Ph.D. in Industrial/Organizational Psychology from the Georgia Institute of Technology in 1989. Dr. Woehr served on the faculty of the Psychology Department in the I/O Psychology program at Texas A&M University from 1988 to 1999 and as a Professor of Management at the University of Tennessee from 1999 to 2011. He has also served as a Visiting Scientist to the Air Force Human Resource Laboratory and as a consultant to private industry. Dr. Woehr is a fellow of the Society for Industrial and Organizational Psychology (SIOP), the American Psychological Association (APA), and the Association for Psychological Science (APS). His research on managerial assessment centers, job performance measurement, work related attitudes and behavior, training development, and quantitative methods has appeared in a variety of books, journals, as papers presented at professional meetings, and as technical reports. Dr. Woehr currently serves as editor for Human Performance as well as on the editorial boards for Organizational Research Methods, and the European Journal of Work and Organizational Psychology
Daniel M. Ferguson is CATME Managing Director and the recipient of several NSF awards for research in engineering education and a research associate at Purdue University. Prior to coming to Purdue he was Assistant Professor of Entrepreneurship at Ohio Northern University. Before assuming that position he was Associate Director of the Inter-Professional Studies Program [IPRO] and Senior Lecturer at Illinois Institute of Technology and involved in research in service learning, assessment processes and interventions aimed at improving learning objective attainment. Prior to his University assignments he was the Founder and CEO of The EDI Group, Ltd. and The EDI Group Canada, Ltd, independent professional services companies specializing in B2B electronic commerce and electronic data interchange. The EDI Group companies conducted syndicated market research, offered educational seminars and conferences and published The Journal of Electronic Commerce. He was also a Vice President at the First National Bank of Chicago [now J.P. Morgan Chase], where he founded and managed the bank’s market leading professional Cash Management Consulting Group, initiated the bank’s non-credit service product management organization and profit center profitability programs and was instrumental in the breakthrough EDI/EFT payment system implemented by General Motors. Dr. Ferguson is a graduate of Notre Dame, Stanford and Purdue Universities, a special edition editor of the Journal of Engineering Entrepreneurship and a member of Tau Beta Pi.
Catherine E. Brawner is President of Research Triangle Educational Consultants. She received her Ph.D.in Educational Research and Policy Analysis from NC State University in 1996. She also has an MBA from Indiana University (Bloomington) and a bachelor’s degree from Duke University. She specializes in
evaluation and research in engineering education, computer science education, and technology education. Dr. Brawner is a founding member and former treasurer of Research Triangle Park Evaluators, an American Evaluation Association affiliate organization and is a member of the American Educational Research Association and American Evaluation Association, in addition to ASEE. Dr. Brawner is also an Extension Services Consultant for the National Center for Women in Information Technology (NCWIT) and, in that role, advises computer science and engineering departments on diversifying their undergraduate student population. She remains an active researcher, including studying academic policies, gender and ethnicity issues, transfers, and matriculation models with MIDFIELD as well as student veterans in engineering. Her evaluation work includes evaluating teamwork models, broadening participation initiatives, and S-STEM and LSAMP programs.
Behzad Beigpourian is a Ph.D. student and Research Assistant in Engineering Education at Purdue University. He earned his master’s in Structural Engineering from Shahid Chamran University in Iran, and his bachelor’s in Civil Technical Teacher from Shahid Rajaee Teacher Training University in Iran, Tehran. He has been official Technical Teacher at Ministry of Education in Iran from 2007 to 2018, and received many certificate in education such as Educational Planning, Developing Research Report, and Understanding School Culture. Mr. Beigpourian currently works in the CATME project, which is NSF funding project, on optimizing teamwork skills and assessing the quality of Peer Evaluations.
Frank Luchini has five years experience in industry working as a Process/Design/Project Engineer. He recently returned to academia to earn a PhD in Engineering Education at Purdue University. He will be completing a Master in Engineering Education in May and starting as a Assistant Professor at Trine University in August 2019. He earned a BS in Mechanical Engineering and a BA in Arts and Humanities from Michigan State University.
http://orcid.org/https://0000-0002-7086-5953
Purdue University-Main Campus, West Lafayette (College of Engineering)
[biography]
Siqing Wei received BSEE and MSEE from Purdue University. He is currently pursuing a Ph.D. degree in Engineering Education program at Purdue University. After years of experience of serving the peer teacher and a graduate teaching assistant in first-year-engineering courses, he is now a research assistant at CATME research group studying how cultural diversity impacts teamwork and how to help students improve intercultural competency and teamwork competency by interventions, counseling, pedagogy, and tool selection (such as how to use CATME Team-Maker to form inclusive and diversified teams). In addition, he also works on many research-to-practice projects to enhance educational technology usage in engineering classrooms and educational research. One feature ongoing project utilizes natural language processing technique to map students' written peer-to-peer comments with their perceived numerical ratings. Siqing also works as the technical development and support manager at CATME research group.
Are you a researcher? Would you like to cite this paper? Visit the ASEE document repository at peer.asee.org for more tools and easy citations.