MENU
  • ASEE Logo
  • Give
    Give
    ASEE Donations...
    Classified Volunteer
    Login
  • Join Login Volunteer Classified Give
    Give
    ASEE Donations...



About
  • Overview
    • Mission, Vision, Goals
    • Public Policy Statements
    • Constitution
    • Bylaws
    • Organizational Structure
    • Investment Policy
    • Financial Policy
  • Our History
  • Staff Contacts
  • Leadership
    • Board Of Directors
    • Academy Of Fellows
    • Past Board Members
    • Advisory Committees
    • Representatives to External Organizations
    • Executive Director's Message
    • Meeting Minutes
  • Volunteer
  • Careers at ASEE
  • Privacy Statement
I Am A...
  • Member
      Login Required
    • Your Member Page
    • Membership Directory
    • Financials
    • Volunteer for Task Force
      • COVID Recovery
      • Engineering Culture
    • No Login Required
    • Awards
    • Divisions, Fellows, and Campus Reps
    • Sections and Zones
    • Resources
  • Prospective Individual/Organizational Member
    • About ASEE
    • Individual Membership
    • Institutional Membership
    • Major Activities
  • Donor
  • Prospective Partner or Sponsor
  • Advertiser
  • Fellowship Seeker
    • About Fellowships
    • High School
    • Undergraduate
    • Graduate
    • Post-Doctoral
    • Other Programs
Events
  • Conferences and Meetings
    • 2022 Annual Conference & Exposition
    • 2021 Virtual Annual Conference & Exposition
    • 2020 Virtual Annual Conference & Exposition
    • Section & Zone Meetings
  • Council Events
    • Conference for Industry and
      Education Collaboration (CIEC)
    • CMC Workforce Summit
    • Engineering Deans Institute (EDI)
    • Research Leadership Institute (RLI) (Formerly ERC)
    • Engineering Technology Leaders Institute (ETLI)
    • EDC Public Policy Colloquium (PPC)
  • Featured Events
    • Frontiers in Education
    • NETI
    • CoNECD
    • First Year Engineering Experience
    • Workforce Summit
  • Future Conference Dates
Publications
  • News
    • Newsletters
    • eGFI
    • Division Publications
  • Journals and Conference Papers
    • Overview
    • Journal of Engineering Education
    • Advances in Engineering Education
    • Conference Proceedings
    • Section Proceedings
    • Zone Proceedings
    • PEER
    • Plagiarism
  • Monographs and Reports
  • Prism Magazine
  • Data
    • Profiles of E&ET Colleges
    • Case Study Series: Engineering-Enhanced Liberal Education
Impact
  • Public Policy Statements
  • Data Analysis
  • Annual Reports
  • Diversity
Education & Careers
  • Academic Job Opportunities
  • Course Catalog
  • Engineering Education Research and Innovation
    • Engineering Education Community Resource
  • PreK-12
    • eGFI Teachers
    • eGFI Students
  • Engineering Teacher PD Endorsement
Calendar
2020 Annual Conference
The ASEE 2020 Virtual Annual Conference content is available.
See More....
  • International Forum
    • Past Forums
  • 2020 Research Leadership Institute(RLI) (Formerly ERC)
    • Overview
    • Registration
    • Housing
    • Program Schedule
    • ERC Past Conferences
  • 2018 Engineering Technology Leaders Institute (ETLI)
    • Engineering Technology Leaders Institute (ETLI)
    • Registration
    • Housing
    • Program Schedule
    • ETLI Sponsorship Options
  • 2017 Global Colloquium
  • Pre K-12 Workshop
    • Call for Proposals
    • Registration
    • Housing
    • Sponsors
    • Program Schedule
    • Past Conferences
  • STEP Grantees Meeting
  • Annual Conference
    • Past Conferences
  • International Forum
    • Past Forums
  • 2020 Research Leadership Institute(RLI) (Formerly ERC)
    • Overview
    • Registration
    • Housing
    • Program Schedule
    • ERC Past Conferences
  • 2018 Engineering Technology Leaders Institute (ETLI)
    • Engineering Technology Leaders Institute (ETLI)
    • Registration
    • Housing
    • Program Schedule
    • ETLI Sponsorship Options
  • 2017 Global Colloquium
  • Pre K-12 Workshop
    • Call for Proposals
    • Registration
    • Housing
    • Sponsors
    • Program Schedule
    • Past Conferences
  • STEP Grantees Meeting
  • Annual Conference
    • Past Conferences

2019 ASEE Annual Conference & Exposition

Board 135: DIY Classroom Observations: A Toolkit for Novice Classroom Observers

Presented at NSF Grantees Poster Session

The Improving Student Experiences to Increase Student Engagement (ISE-2) grant was awarded to Texas A&M University by the National Science Foundation, through EEC-Engineering Diversity Activities (Grant No. 1648016) with the goal of increasing student engagement and retention in the College of Engineering. ISE-2 deployed a faculty development program in the Summers of 2017 and 2018, with the goal of increasing active learning, improving classroom climates, and decreasing implicit bias and deficit thinking in first- and second-year Engineering classes. In order to capture whether faculty have changed their instructional practices prior to and following the faculty development program, the ISE-2 team conducted classroom observations both before and after the faculty participants attended the trainings. To date, the team has observed 55 total classes in Spring 2017, Fall 2017, and Spring 2018, with two observers attending most of the classes.

The ISE-2 observation team consists of faculty, instructional consultants from the Center for Teaching Excellence (CTE), graduate students, and undergraduate research assistants. Thus, there was a wide range of classroom observation experiences in our team, ranging from expert to novice. In order to ensure the quality of the classroom observations and improve interrater reliability, the novice classroom observers were trained to observe undergraduate classrooms by the expert observers at the beginning of each semester. These training sessions became the basis of this classroom observation toolkit. This classroom observation toolkit can be used by instructors or researchers who are interested in doing classroom observations, but have limited experience with qualitative coding and observational research, to train themselves and their research assistants. This paper will serve as an introduction and a handbook for the classroom observation toolkit. The observation toolkit includes: a) an annotated bibliography introducing articles that would be helpful to understanding classroom observations, b) a series of training videos teaching viewers to conduct classroom observations using an environmental scan and the Classroom Observation Protocol for Undergraduate STEM (COPUS; Smith et al., 2013), one of the peer-reviewed coding schemes that is available in the engineering education literature, c) a series of sample classroom videos that document a typical first- and second-year Engineering class, d) validation keys for each of the sample videos (i.e., consensus coding of the sample videos from our team, against which a new team can compare their codes and discuss their matches and mismatches as a group), and e) guidance from the qualitative coding literature on how to determine whether emergent codes (i.e., additional codes beyond the initially adopted coding scheme) are needed and how to operationalize them.

Reference
Smith, M. K., Jones, F. H. M., Gilbert, S. L., & Wieman, C. E. (2013). The Classroom Observation Protocol for Undergraduate STEM (COPUS): A new instrument to characterize university STEM classroom practices. CBE—Life Sciences Education, 12, 618-627. DOI: 10.1187/cbe.13-08-0154.

Authors
  1. Adrian Leos
  2. Ms. Kaitlin Harlan
  3. Ms. Brooke A. Merrill Texas A&M University
  4. Ms. Sin-Ning Cindy Liu Texas A&M University [biography]

    Ph.D. student in Industrial/Organizational Psychology at Texas A&M University.
    M.A. Educational Psychology, 2016 - Baylor University
    B.A. Psychology, 2014 - Baylor University

  5. Cynthia K. Lang Texas A&M University [biography]

    Cynthia Lang is a third-year graduate student in the School Psychology Ph.D program at Texas A&M University. She earned her BA in Psychology from The University of Texas at Austin in May 2016.

  6. Mr. Robert C. Martin Texas A&M University
  7. Dr. Carolyn L. Sandoval University of California, San Diego [biography]

    Dr. Sandoval is the Associate Director of the Teaching + Learning Commons at the University of California, San Diego. She earned a PhD in Adult Education-Human Resource Development. Her research interests include adult learning and development, faculty de

  8. Dr. Mindy Bergman Texas A&M University [biography]

    Dr. Bergman is a Professor in the Department of Psychological and Brain Sciences and Executive Director of Interdisciplinary Critical Studies at Texas A&M University. She earned her PhD in industrial-organizational psychology at the University of Illinois at Urbana-Champaign. Her research interests include workplace safety, occupational health, and fairness and mistreatment in the workplace and in STEM classrooms and programs.

Download paper (614 KB)

Are you a researcher? Would you like to cite this paper? Visit the ASEE document repository at peer.asee.org for more tools and easy citations.

» Download paper

« View session


  • Follow Us
  • twitter
  • facebook
  • youtube
  • instagram
  • linkedin
  • 1818 N Street N.W. Suite 600, Washington DC 20036

  • Telephone: 202.331.3500 | Fax: 202.265.8504

  • © 2023 Copyright: ASEE.org All rights reserved. Privacy Policy.