logo logo European Journal of Educational Research

EU-JER is is a, peer reviewed, online academic research journal.

Subscribe to

Receive Email Alerts

for special events, calls for papers, and professional development opportunities.

Subscribe

Publisher (HQ)

Eurasian Society of Educational Research
Eurasian Society of Educational Research
Christiaan Huygensstraat 44, Zipcode:7533XB, Enschede, THE NETHERLANDS
Eurasian Society of Educational Research
Headquarters
Christiaan Huygensstraat 44, Zipcode:7533XB, Enschede, THE NETHERLANDS
Research Article

Supervised Learning Applied to Graduation Forecast of Industrial Engineering Students

Natalia Gil Canto , Marcelo Albuquerque de Oliveira , Gabriela de Mattos Veroneze

The article aims to develop a machine-learning algorithm that can predict student’s graduation in the Industrial Engineering course at the Feder.

T

The article aims to develop a machine-learning algorithm that can predict student’s graduation in the Industrial Engineering course at the Federal University of Amazonas based on their performance data. The methodology makes use of an information package of 364 students with an admission period between 2007 and 2019, considering characteristics that can affect directly or indirectly in the graduation of each one, being: type of high school, number of semesters taken, grade-point average, lockouts, dropouts and course terminations. The data treatment considered the manual removal of several characteristics that did not add value to the output of the algorithm, resulting in a package composed of 2184 instances. Thus, the logistic regression, MLP and XGBoost models developed and compared could predict a binary output of graduation or non-graduation to each student using 30% of the dataset to test and 70% to train, so that was possible to identify a relationship between the six attributes explored and achieve, with the best model, 94.15% of accuracy on its predictions.

Keywords: Engineering retention, supervised learning, classification, graduation forecast.

cloud_download PDF
Cite
Article Metrics
Views
434
Download
838
Citations
Crossref
2

Scopus
2

References

Akhgar, A., Toghraie, D., Sina, N., & Afrand, M. (2019). Developing dissimilar artificial neural networks (ANNs) to prediction the thermal conductivity of MWCNT-TiO2/Water-ethylene glycol hybrid nanofluid. Powder Technology, 355, 602-610. https://doi.org/10.1016/j.powtec.2019.07.086

Almatrafi, O., Johri, A., Rangwala, H., & Lester, J. (2017, June 24-28). Board 65: Retention and persistence among STEM students: a comparison of direct admit and transfer students across engineering and science [Paper presentation]. 2014 ASEE Annual Conference & Exposition, Columbus, Ohio, United States. https://doi.org/10.18260/1-2--27899

Chelberg, K. L., & Bosman, L. B. (2019). The role of faculty mentoring in improving retention and completion rates for historically underrepresented STEM students. International Journal of Higher Education, 8(2), 39-48. https://doi.org/10.5430/ijhe.v8n2p39

Chen, T., & Guestrin, C. (2016). Xgboost: A scalable tree boosting system. In B. Krishnapuram & M. Shah, (Eds.), Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (pp. 785-794). Association for Computing Machinery. https://doi.org/10.1145/2939672.2939785

Coletti, K. B., Wisniewski, E. O., Shapiro, R. L., DiMilla, P. A., Reisberg, R., & Covert, M. (2014, June 15-18). Correlating freshman engineers’ performance in a general chemistry course to their use of supplemental instruction [Paper presentation]. 2014 ASEE Annual Conference & Exposition, Indianapolis, Indiana, United States. https://doi.org/10.18260/1-2--20214

Craig, W. O. (2011). Strategies for improving the retention of engineering and technology students at historically black colleges and universities HBCU. International Transaction Journal of Engineering, Management, & Applied Sciences & Technologies, 2(5), 561-570. https://tuengr.com/V02/561-568.pdf

Davis, C.-S. G., & Finelli, C. J. (2007). Diversity and retention in engineering. New Directions for Teaching and Learning, 111, 63-71. https://doi.org/10.1002/tl.287

Desai, N., & Stefanek, G. (2017, March 2-5). A literature review of the different approaches that have been implemented to increase retention in engineering programs across the United States [Paper presentation]. 2017 ASEE Zone II Conference, San Juan, Puerto Rico. http://zone2.asee.org/papers/proceedings/3/117.pdf

Dhaliwal, S. S., Nahid, A.-A., & Abbas, R. (2018). Effective intrusion detection system using XGBoost. Information, 9(7). https://doi.org/10.3390/info9070149

Fletcher, S. L., & Anderson-Rowland, M. (2000, June 18-21). Developing retention strategies for women that promote student success in engineering and the applied sciences [Paper presentation]. 2000 Annual Conference, St. Louis, Missouri, United States. https://doi.org/10.18260/1-2--8284

French, S. E., Bego, C. R., Hieb, J. L., & Ralston, P. A. (2021, July 26-29). Psychological cost, gender, and retention among engineering students [Paper presentation]. 2021 ASEE Virtual Annual Conference Content Access, Virtual Conference. https://peer.asee.org/37622

García-Ros, R., Pérez-González, F., Cavas-Martínez, F., & Tomás, J. M. (2019). Effects of pre-college variables and first-year engineering students’ experiences on academic achievement and retention: a structural model. International Journal of Technology and Design Education, 29(4), 915-928. https://doi.org/10.1007/s10798-018-9466-z

Gehr, T., Mirman, M., Drachsler-Cohen, D., Tsankov, P., Chaudhuri, S., & Vechev, M. (2018). AI2: Safety and robustness certification of neural networks with abstract interpretation [Paper presentation]. IEEE Symposium on Security and Privacy (SP), San Francisco, CA, United States. https://doi.org/10.1109/SP.2018.00058

Géron, A. (2017). Hands-on machine learning with Scikit-Learn and TensorFlow: Concepts, tools and techniques to build intelligent systems (1st ed.). O'Reilly Media.

Godfrey, E., Aubrey, T., & King, R. (2010). Who leaves and who stays? Retention and attrition in engineering education. Engineering Education, 5(2), 26-40. https://doi.org/10.11120/ened.2010.05020026

Green, C., Dika, S., & Smith, A. (2019, June 15-19). Board 137: Persistence of women of color in undergraduate engineering programs [Paper presentation]. ASEE 2019 Annual Conference and Exposition, Tampa, Florida, United States. https://doi.org/10.18260/1-2--32248

Hartman, H., Forin, T., Sukumaran, B., Farrell, S., Bhavsar, P., Jahan, K., Dusseau, R., Bruckerhoff, T., Cole, P., Lezotte S., Zeppilli, D., Macey, D. (2019). Strategies for improving diversity and inclusion in an engineering department. Journal of Professional Issues in Engineering Education and Practice, 145(2). https://doi.org/10.1061/(ASCE)EI.1943-5541.0000404

Hieb, J. L., Lyle, K. B., Ralston, P. A., & Chariker, J. (2015). Predicting performance in a first engineering calculus course: Implications for interventions. International Journal of Mathematical Education in Science and Technology, 46(1), 40-55. https://doi.org/10.1080/0020739X.2014.936976

Honken, N. B., & Ralston, P. (2013). Freshman engineering retention: A holistic look. Journal of STEM Education: Innovations and Research, 14(2), 29-37. https://bit.ly/3D0WvQz

Jagacinski, C. M. (2013). Women engineering students: Competence perceptions and achievement goals in the freshman engineering course. Sex Roles, 69(11-12), 644-657. https://doi.org/10.1007/s11199-013-0325-9

Jiang, J., Wang, H., Xie, J., Guo, X., Guan, Y., & Yu, Q. (2020). Medical knowledge embedding based on recursive neural network for multi-disease diagnosis. Artificial Intelligence in Medicine, 103, 1-12. https://doi.org/10.1016/j.artmed.2019.101772

Koenig, K., Schen, M., Edwards, M., & Bao, L. (2012). Addressing STEM retention through a scientific thought and methods course. Journal of College Science Teaching, 41(4), 23-29.

Kurt, I., Ture, M., & Kurum, A. T. (2008). Comparing performances of logistic regression, classification and regression tree, and neural networks for predicting coronary artery disease. Expert Systems with Applications, 34(1), 366-374. https://doi.org/10.1016/j.eswa.2006.09.004

Lemon, S. C., Roy, J., Clark, M. A., Friedmann, P. D., & Rakowski, W. (2003). Classification and regression tree analysis in public health: methodological review and comparison with logistic regression. Annals of Behavioral Medicine, 26(3), 172-181. https://doi.org/10.1207/S15324796ABM2603_02

Lichtenstein, G., McCormick, A. C., Sheppard, S. D., & Puma, J. (2010). Comparing the undergraduate experience of engineers to all other majors: Significant differences are programmatic. Journal of Engineering Education, 99(4), 305-317. https://doi.org/10.1002/j.2168-9830.2010.tb01065.x

Lin, J.-J., Malyscheff, A., & Imbrie, P. (2008, June 22-25). Artificial intelligence methods to forecast engineering students' retention based on cognitive and non-cognitive factors [Paper presentation]. 2008 Annual Conference & Exposition, Pittsburgh, Pennsylvania. https://doi.org/10.18260/1-2--4315

Lisberg, A., & Woods, B. (2018). Mentorship, mindset and learning strategies: An integrative approach to increasing underrepresented minority student retention in a STEM undergraduate program. Journal of STEM Education, 19(3), 14-20. https://www.learntechlib.org/p/184625/

Lomuscio, A., & Maganti, L. (2017). An approach to reachability analysis for feed-forward Relu neural networks. https://arxiv.org/abs/1706.07351

Ngah, S., & Bakar, R. A. (2017). Sigmoid function implementation using the unequal segmentation of differential lookup table and second order nonlinear function. Journal of Telecommunication, Electronic and Computer Engineering, 9, 103-108. https://jtec.utem.edu.my/jtec/article/view/2637

Ngah, S., Bakar, R. A., Embong, A., & Razali, S. (2016). Two-steps implementation of sigmoid function for artificial neural network in Field Programmable Gate Array. ARPN Journal of Engineering and Applied Sciences, 11(7), 4882-4888. https://bit.ly/3nScpH6

Nielsen, D. (2016). Tree boosting with xgboost-why does xgboost win" every" machine learning competition? [Master’s thesis, Norwegian University of Science and Technology]. NTNU Open. http://hdl.handle.net/11250/2433761

Palmer, R. T., Maramba, D. C., & Dancy, T. E. (2011). A qualitative investigation of factors promoting the retention and persistence of students of color in STEM. The Journal of Negro Education, 80(4), 491-504. http://www.jstor.org/stable/41341155

Pham, B. T., Bui, D. T., Prakash, I., & Dholakia, M. B. (2017). Hybrid integration of Multilayer Perceptron Neural Networks and machine learning ensembles for landslide susceptibility assessment at Himalayan area (India) using GIS. CATENA 149(1), 52-63. https://doi.org/10.1016/j.catena.2016.09.007

Reichert, M., & Absher, M. (1997). Taking another look at educating African American engineers: The importance of undergraduate retention. Journal of Engineering Education, 86(3), 241-253. https://doi.org/10.1002/j.2168-9830.1997.tb00291.x

Santacroce, A. (2018). Determining strategies for the Embry-Riddle Aeronautical University college of engineering faculty to use to increase the retention rate of women in their undergraduate engineering programs. The Compass, 1(5), 30-36. https://scholarworks.arcadia.edu/thecompass/vol1/iss5/6

Shahhosseini, A. M., Moayed, F. A., & McLeod, A. (2020, June 22-26). Strategies for increasing enrollment, retention, and graduation in two baccalaureate degree STEM programs: Mechanical Engineering Technology (MET) and Safety Management (SM) [Paper presentation]. 2020 ASEE Virtual Annual Conference Content Access, Virtual Conference. https://monolith.asee.org/public/conferences/172/papers/29080/view

Stromei, L. K. (2000). Increasing retention and success through mentoring. New Directions for Community Colleges, 2000(112), 55-62. https://doi.org/10.1002/cc.11205

Subasi, A., & Ercelebi, E. (2005). Classification of EEG signals using neural network and logistic regression. Computer Methods and Programs in Biomedicine, 78(2), 87-99. https://doi.org/10.1016/j.cmpb.2004.10.009

Susto, G. A., Schirru, A., Pampuri, S., McLoone, S., & Beghi, A. (2015). Machine learning for predictive maintenance: a multiple classifiers approach. IEEE Transactions on Industrial Informatics 11(3), 812-820. https://doi.org/10.1109/TII.2014.2349359

Tiwari, V., & Khare, N. (2015). Hardware implementation of neural network with Sigmoidal activation functions using CORDIC. Microprocessors and Microsystems, 39(6), 373-381. https://doi.org/10.1016/j.micpro.2015.05.012

Veenstra, C. P., Dey, E. L., & Herrin, G. D. (2009). A Model for freshman engineering retention. Advances in Engineering Education, 1(3), 1-33. https://files.eric.ed.gov/fulltext/EJ1076050.pdf

Wang, J., Fu, P., & Gao, R. X. (2019). Machine vision intelligence for product defect inspection based on deep learning and Hough transform. Journal of Manufacturing Systems, 51, 52-60. https://doi.org/10.1016/j.jmsy.2019.03.002

Wang, M.-T., Degol, J., & Ye, F. (2015). Math achievement is important, but task values are critical, too: examining the intellectual and motivational factors leading to gender disparities in STEM careers. Frontiers in Psychology, 6, 1-9. https://doi.org/10.3389/fpsyg.2015.00036

Wanto, A., Windarto, A. P., Hartama, D., & Parlina, I. (2017). Use of binary sigmoid function and linear identity in artificial neural networks for forecasting population density. International Journal of Information System & Technology, 1(1), 43-54. https://doi.org/10.30645/ijistech.v1i1.6

Ye, N., Fok, T. Y., Collofello, J., & Coronella, T. (2021, July 26-29). Common and uncommon characteristics of engineering student retention after the first year in university [Paper presentation]. 2021 ASEE Virtual Annual Conference Content Access, Virtual Conference. https://doi.org/10.18260/1-2--36813

...