One of the fundamental concepts behind Adaptive Comparative Judging (ACJ) is that it is easier and more accurate to comparison judge a series of products, and to develop a rank order of achievement, than it is to score products using a more subjective method or rubric approach. Research in the field of comparative judging has shown a very high level of validity and reliability in this assessment methodology. The assessment approach appears to be effective at varying levels of rigor and academic achievement. Studies have examined adaptive comparative judging techniques in academic areas such as writing/composition, science education, and geography instruction. The areas of design and technology have proven to be especially effective topics for ACJ assessment, and are of special interest to the authors.
This paper examines the fundamental principles of comparative judging and adaptive comparative judging, and discusses some of the most recent and relevant research on this topic. Several readily available web-based ACJ tools and products are reviewed, especially as they relate to academic settings. Applications in the areas of portfolio evaluation, graphics assignment (CAD, animation, Web, etc.) assessment, and peer critiquing are also explored.
Additionally, the potential for large-scale collaboration using this methodology for analyzing educational productivity, learning effectiveness, and collaborative research is considered. Adaptive comparative judging has proven to be a method or assessment tool that is relatively straightforward to learn for faculty, and somewhat easily applied to a wide variety of topics and assignment approaches. Lessons learned to this point in time and application best practices using ACJ are shared with an eye toward future applications of this approach that is rapidly growing in popularity.
I have instructed classes related to all CTE areas at the Junior High, High School, and College Level over the past 10 years. In addition to research activities I enjoying working with future and current Engineering/Technology Teachers. My interests revolve around adaptive comparative judgment, engineering design, teacher training, self-directed learning, and mobile devices in K-12 classrooms.
Dr. Patrick Connolly is a professor and department head of the Department of Computer Graphics Technology in the Purdue Polytechnic at Purdue University. He has extensive experience in the aerospace design and CAD/CAE software industries, and has been serving in higher education for twenty years. Dr. Connolly has a BS degree in Design and Graphics Technology and an MS in Computer Integrated Manufacturing from Brigham Young University, and a PhD in Educational Technology from Purdue University. His research interests include spatial ability development, virtual and augmented reality applications, product data and lifecycle management, and innovative classroom methodologies.
Are you a researcher? Would you like to cite this paper? Visit the ASEE document repository at peer.asee.org for more tools and easy citations.