This work in progress research paper describes methodology for large-scale sampling of doctoral engineering students to analyze identity and motivation profiles, which can affect persistence. A sample size of 253 doctoral engineering programs was chosen. Doctoral engineering programs are known to have an approximately fifty-percent attrition rate, but the factors influencing attrition are obscured by limited studies in doctoral education. Small-scale and convenience sampling limit the ability to generalize results, and large-scale surveying has been implemented to capture graduate experiences but does not reflect the attitudes and experiences of students who might report hesitancy in completing a doctoral degree. As such, we will survey currently enrolled doctoral engineering students to explore the affective factors that may influence student graduation rates. To initiate discussion of engineering doctoral student attrition, we address the following research question: How do we create a sample design that allows us to capture the diverse population of engineering doctoral students and their attitudes?
Engineering departments were allocated to geographic regions and received codes for academic programs based on Engineering by the Numbers to enhance diversity in the doctoral student sample by stratifying amongst geographic distribution and potential programmatic norms. Each department was coded for no more than three academic program types to account for variability within departments. Department size was imputed using the number of doctoral degrees awarded to each program as a proxy using information gathered from NSF Reported Doctorate Recipients from U.S. Universities and determined to be small, medium, or large using quantiles as determinants for allocation. Department size was stratified to minimize the influence of large, influential programs by requiring the presence of small and medium sized programs within the sample.
Previous work considered region, department size, and academic program classification separately in methodology but has not utilized all three factors in a multistage cluster sampling design. The doctoral degree programs are divided into five geographic groups, then stratified by size. Finally, academic programs are sampled using probability proportional to size, where size is defined as frequency of the academic program within the smallest sampling unit. All academic programs in departments with multiple academic tracks are considered as sampling units and counted against the expected total for each program if another academic program from the same department is selected in the sample to reduce the total number of departments sampled, thus simplifying the recruitment process. Further probabilistic sampling techniques are unnecessary, as a census of students in selected academic programs will be taken.
Sampling techniques described in this research facilitate recruitment of participating departments and create a generalizable protocol that permits easy replacement of non-participating programs, objective statistical analysis, and a representative sample. Further work will focus on the recruitment of doctoral degree granting engineering programs in a consistent manner based on this sampling design.
Are you a researcher? Would you like to cite this paper? Visit the ASEE document repository at peer.asee.org for more tools and easy citations.