Introductory engineering courses within large universities often have annual enrollments exceeding several hundreds of students, while online classes have even larger enrollments. It is challenging to achieve differentiated instruction in classrooms with class sizes and student diversity of such great magnitude. In such classes, professors assess whether students have mastered a concept through multiple-choice questions, marking answers as right or wrong with little feedback, or using online text-only systems. However, in these scenarios the feedback is of a mostly binary nature (right or wrong) with limited constructive feedback to scaffold learning. A growing concern among engineering educators is that students are losing both the critical skill of sketched diagrams and the ability to take a real system and reduce it to an accurate but simplified free-body diagram (FBD).
A sketch-recognition based tutoring system, called Mechanix, allows students to hand-draw solutions just as they would with pencil and paper, while also providing iterative real-time personalized feedback. Sketch recognition algorithms use artificial intelligence to identify the shapes, their relationships, and other features of the sketched student drawing. Other AI algorithms then determine if and why a student’s work is incorrect, enabling the tutoring system to return immediate and iterative personalized feedback facilitating student learning that is otherwise not possible in large classes.
To observe the effectiveness of this system, it has been implemented into various courses at three universities, with two additional universities planning to use the system within the next year. Student knowledge is measured using Concept Inventories based in both Physics and Statics, common exam questions, and assignments turned in for class.
Preliminary results using Mechanix, a sketch-based statics tutoring system built at Texas A&M University, suggest that a sketch-based tutoring system increases homework motivation in struggling students and is as effective as paper-and-pencil-based homework for teaching method of joints truss analysis. In focus groups, students believed the system enhanced their learning and increased engagement.
Keywords: sketch recognition; intelligent user interfaces; physics education; engineering education
Ethan is a PhD candidate in Mechanical Engineering at the Georgia Institute of Technology working with Dr. Julie Linsey as a part of the IDREEM Lab. He graduated with honors from Louisiana Tech University with his Bachelors of Science in Mechanical Engineering. Ethan's research area is design cognition and methods with a focus on prototyping and its utilization during the design process. In particular, Ethan has focused on hand-drawn sketches and how they are used as tools for generating ideas and visual communication, especially when it involves the skill to generate quick and realistic sketches of an object or idea. He has also conducted research on the impact involvement in academic makerspaces has on students in engineering programs.
http://orcid.org/0000-0002-6235-0706
Texas State University
[biography]
Dr. Kimberly G. Talley, P.E. is an associate professor in the Department of Engineering Technology, PERSIST (Promoting the Engagement and Retention of Students In STEM) Lab Director at Texas State University, and a licensed Professional Engineer. She received her Ph.D. and M.S.E. from the University of Texas at Austin in Structural Engineering. Her undergraduate degrees in History and in Construction Engineering and Management are from North Carolina State University. Dr. Talley teaches courses in the Construction Science and Management and Civil Engineering Technology Programs, and her research focus is in student engagement and retention in engineering and engineering technology education. Contact: talley@txstate.edu
Dr. Kristi J. Shryock is the Frank and Jean Raymond Foundation Inc. Endowed Associate Professor in Multidisciplinary Engineering and Affiliated Faculty in Aerospace Engineering in the College of Engineering at Texas A&M University. She also serves as Director of the Craig and Galen Brown Engineering Honors Program. She received her BS, MS, and PhD from the College of Engineering at Texas A&M. Kristi works to improve the undergraduate engineering experience through evaluating preparation in areas, such as mathematics and physics, evaluating engineering identity and its impact on retention, incorporating non-traditional teaching methods into the classroom, and engaging her students with interactive methods.
Dr. Julie S. Linsey is a Professor in the George W. Woodruff School of Mechanical Engineering at the Georgia Institute of Technological. Her research focus is on design methods, theory, and engineering education with a particular focus on innovation and conceptual design.
http://orcid.org/https://0000-0001-7272-0507
Texas A&M University
[biography]
Dr. Hammond is Director of the Texas A&M University Institute for Engineering Education & Innovation and also the chair of the Engineering Education Faculty. She is also Director of the Sketch Recognition Lab and Professor in the Department of Computer Science & Engineering. She is a member of the Center for Population and Aging, the Center for Remote Health Technologies & Systems as well as the Institute for Data Science. Hammond is a PI for over 13 million in funded research, from NSF, DARPA, Google, Microsoft, and others. Hammond holds a Ph.D. in Computer Science and FTO (Finance Technology Option) from the Massachusetts Institute of Technology, and four degrees from Columbia University: an M.S in Anthropology, an M.S. in Computer Science, a B.A. in Mathematics, and a B.S. in Applied Mathematics and Physics. Hammond advised 17 UG theses, 29 MS theses, and 10 Ph.D. dissertations. Hammond is the 2020 recipient of the TEES Faculty Fellows Award and the 2011 recipient of the Charles H. Barclay, Jr. '45 Faculty Fellow Award. Hammond has been featured on the Discovery Channel and other news sources. Hammond is dedicated to diversity and equity, which is reflected in her publications, research, teaching, service, and mentoring. More at http://srl.tamu.edu and http://ieei.tamu.edu.
Are you a researcher? Would you like to cite this paper? Visit the ASEE document repository at peer.asee.org for more tools and easy citations.