Supervised Learning Applied to Graduation Forecast of Industrial Engineering Students
Natalia Gil Canto , Marcelo Albuquerque de Oliveira , Gabriela de Mattos Veroneze
The article aims to develop a machine-learning algorithm that can predict student’s graduation in the Industrial Engineering course at the Feder.
- Pub. date: January 15, 2022
- Pages: 325-337
- 434 Downloads
- 838 Views
- 2 Citations
The article aims to develop a machine-learning algorithm that can predict student’s graduation in the Industrial Engineering course at the Federal University of Amazonas based on their performance data. The methodology makes use of an information package of 364 students with an admission period between 2007 and 2019, considering characteristics that can affect directly or indirectly in the graduation of each one, being: type of high school, number of semesters taken, grade-point average, lockouts, dropouts and course terminations. The data treatment considered the manual removal of several characteristics that did not add value to the output of the algorithm, resulting in a package composed of 2184 instances. Thus, the logistic regression, MLP and XGBoost models developed and compared could predict a binary output of graduation or non-graduation to each student using 30% of the dataset to test and 70% to train, so that was possible to identify a relationship between the six attributes explored and achieve, with the best model, 94.15% of accuracy on its predictions.
Keywords: Engineering retention, supervised learning, classification, graduation forecast.
References
Akhgar, A., Toghraie, D., Sina, N., & Afrand, M. (2019). Developing dissimilar artificial neural networks (ANNs) to prediction the thermal conductivity of MWCNT-TiO2/Water-ethylene glycol hybrid nanofluid. Powder Technology, 355, 602-610. https://doi.org/10.1016/j.powtec.2019.07.086
Almatrafi, O., Johri, A., Rangwala, H., & Lester, J. (2017, June 24-28). Board 65: Retention and persistence among STEM students: a comparison of direct admit and transfer students across engineering and science [Paper presentation]. 2014 ASEE Annual Conference & Exposition, Columbus, Ohio, United States. https://doi.org/10.18260/1-2--27899
Chelberg, K. L., & Bosman, L. B. (2019). The role of faculty mentoring in improving retention and completion rates for historically underrepresented STEM students. International Journal of Higher Education, 8(2), 39-48. https://doi.org/10.5430/ijhe.v8n2p39
Chen, T., & Guestrin, C. (2016). Xgboost: A scalable tree boosting system. In B. Krishnapuram & M. Shah, (Eds.), Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (pp. 785-794). Association for Computing Machinery. https://doi.org/10.1145/2939672.2939785
Coletti, K. B., Wisniewski, E. O., Shapiro, R. L., DiMilla, P. A., Reisberg, R., & Covert, M. (2014, June 15-18). Correlating freshman engineers’ performance in a general chemistry course to their use of supplemental instruction [Paper presentation]. 2014 ASEE Annual Conference & Exposition, Indianapolis, Indiana, United States. https://doi.org/10.18260/1-2--20214
Craig, W. O. (2011). Strategies for improving the retention of engineering and technology students at historically black colleges and universities HBCU. International Transaction Journal of Engineering, Management, & Applied Sciences & Technologies, 2(5), 561-570. https://tuengr.com/V02/561-568.pdf
Davis, C.-S. G., & Finelli, C. J. (2007). Diversity and retention in engineering. New Directions for Teaching and Learning, 111, 63-71. https://doi.org/10.1002/tl.287
Desai, N., & Stefanek, G. (2017, March 2-5). A literature review of the different approaches that have been implemented to increase retention in engineering programs across the United States [Paper presentation]. 2017 ASEE Zone II Conference, San Juan, Puerto Rico. http://zone2.asee.org/papers/proceedings/3/117.pdf
Dhaliwal, S. S., Nahid, A.-A., & Abbas, R. (2018). Effective intrusion detection system using XGBoost. Information, 9(7). https://doi.org/10.3390/info9070149
Fletcher, S. L., & Anderson-Rowland, M. (2000, June 18-21). Developing retention strategies for women that promote student success in engineering and the applied sciences [Paper presentation]. 2000 Annual Conference, St. Louis, Missouri, United States. https://doi.org/10.18260/1-2--8284
French, S. E., Bego, C. R., Hieb, J. L., & Ralston, P. A. (2021, July 26-29). Psychological cost, gender, and retention among engineering students [Paper presentation]. 2021 ASEE Virtual Annual Conference Content Access, Virtual Conference. https://peer.asee.org/37622
García-Ros, R., Pérez-González, F., Cavas-Martínez, F., & Tomás, J. M. (2019). Effects of pre-college variables and first-year engineering students’ experiences on academic achievement and retention: a structural model. International Journal of Technology and Design Education, 29(4), 915-928. https://doi.org/10.1007/s10798-018-9466-z
Gehr, T., Mirman, M., Drachsler-Cohen, D., Tsankov, P., Chaudhuri, S., & Vechev, M. (2018). AI2: Safety and robustness certification of neural networks with abstract interpretation [Paper presentation]. IEEE Symposium on Security and Privacy (SP), San Francisco, CA, United States. https://doi.org/10.1109/SP.2018.00058
Géron, A. (2017). Hands-on machine learning with Scikit-Learn and TensorFlow: Concepts, tools and techniques to build intelligent systems (1st ed.). O'Reilly Media.
Godfrey, E., Aubrey, T., & King, R. (2010). Who leaves and who stays? Retention and attrition in engineering education. Engineering Education, 5(2), 26-40. https://doi.org/10.11120/ened.2010.05020026
Green, C., Dika, S., & Smith, A. (2019, June 15-19). Board 137: Persistence of women of color in undergraduate engineering programs [Paper presentation]. ASEE 2019 Annual Conference and Exposition, Tampa, Florida, United States. https://doi.org/10.18260/1-2--32248
Hartman, H., Forin, T., Sukumaran, B., Farrell, S., Bhavsar, P., Jahan, K., Dusseau, R., Bruckerhoff, T., Cole, P., Lezotte S., Zeppilli, D., Macey, D. (2019). Strategies for improving diversity and inclusion in an engineering department. Journal of Professional Issues in Engineering Education and Practice, 145(2). https://doi.org/10.1061/(ASCE)EI.1943-5541.0000404
Hieb, J. L., Lyle, K. B., Ralston, P. A., & Chariker, J. (2015). Predicting performance in a first engineering calculus course: Implications for interventions. International Journal of Mathematical Education in Science and Technology, 46(1), 40-55. https://doi.org/10.1080/0020739X.2014.936976
Honken, N. B., & Ralston, P. (2013). Freshman engineering retention: A holistic look. Journal of STEM Education: Innovations and Research, 14(2), 29-37. https://bit.ly/3D0WvQz
Jagacinski, C. M. (2013). Women engineering students: Competence perceptions and achievement goals in the freshman engineering course. Sex Roles, 69(11-12), 644-657. https://doi.org/10.1007/s11199-013-0325-9
Jiang, J., Wang, H., Xie, J., Guo, X., Guan, Y., & Yu, Q. (2020). Medical knowledge embedding based on recursive neural network for multi-disease diagnosis. Artificial Intelligence in Medicine, 103, 1-12. https://doi.org/10.1016/j.artmed.2019.101772
Koenig, K., Schen, M., Edwards, M., & Bao, L. (2012). Addressing STEM retention through a scientific thought and methods course. Journal of College Science Teaching, 41(4), 23-29.
Kurt, I., Ture, M., & Kurum, A. T. (2008). Comparing performances of logistic regression, classification and regression tree, and neural networks for predicting coronary artery disease. Expert Systems with Applications, 34(1), 366-374. https://doi.org/10.1016/j.eswa.2006.09.004
Lemon, S. C., Roy, J., Clark, M. A., Friedmann, P. D., & Rakowski, W. (2003). Classification and regression tree analysis in public health: methodological review and comparison with logistic regression. Annals of Behavioral Medicine, 26(3), 172-181. https://doi.org/10.1207/S15324796ABM2603_02
Lichtenstein, G., McCormick, A. C., Sheppard, S. D., & Puma, J. (2010). Comparing the undergraduate experience of engineers to all other majors: Significant differences are programmatic. Journal of Engineering Education, 99(4), 305-317. https://doi.org/10.1002/j.2168-9830.2010.tb01065.x
Lin, J.-J., Malyscheff, A., & Imbrie, P. (2008, June 22-25). Artificial intelligence methods to forecast engineering students' retention based on cognitive and non-cognitive factors [Paper presentation]. 2008 Annual Conference & Exposition, Pittsburgh, Pennsylvania. https://doi.org/10.18260/1-2--4315
Lisberg, A., & Woods, B. (2018). Mentorship, mindset and learning strategies: An integrative approach to increasing underrepresented minority student retention in a STEM undergraduate program. Journal of STEM Education, 19(3), 14-20. https://www.learntechlib.org/p/184625/
Lomuscio, A., & Maganti, L. (2017). An approach to reachability analysis for feed-forward Relu neural networks. https://arxiv.org/abs/1706.07351
Ngah, S., & Bakar, R. A. (2017). Sigmoid function implementation using the unequal segmentation of differential lookup table and second order nonlinear function. Journal of Telecommunication, Electronic and Computer Engineering, 9, 103-108. https://jtec.utem.edu.my/jtec/article/view/2637
Ngah, S., Bakar, R. A., Embong, A., & Razali, S. (2016). Two-steps implementation of sigmoid function for artificial neural network in Field Programmable Gate Array. ARPN Journal of Engineering and Applied Sciences, 11(7), 4882-4888. https://bit.ly/3nScpH6
Nielsen, D. (2016). Tree boosting with xgboost-why does xgboost win" every" machine learning competition? [Master’s thesis, Norwegian University of Science and Technology]. NTNU Open. http://hdl.handle.net/11250/2433761
Palmer, R. T., Maramba, D. C., & Dancy, T. E. (2011). A qualitative investigation of factors promoting the retention and persistence of students of color in STEM. The Journal of Negro Education, 80(4), 491-504. http://www.jstor.org/stable/41341155
Pham, B. T., Bui, D. T., Prakash, I., & Dholakia, M. B. (2017). Hybrid integration of Multilayer Perceptron Neural Networks and machine learning ensembles for landslide susceptibility assessment at Himalayan area (India) using GIS. CATENA 149(1), 52-63. https://doi.org/10.1016/j.catena.2016.09.007
Reichert, M., & Absher, M. (1997). Taking another look at educating African American engineers: The importance of undergraduate retention. Journal of Engineering Education, 86(3), 241-253. https://doi.org/10.1002/j.2168-9830.1997.tb00291.x
Santacroce, A. (2018). Determining strategies for the Embry-Riddle Aeronautical University college of engineering faculty to use to increase the retention rate of women in their undergraduate engineering programs. The Compass, 1(5), 30-36. https://scholarworks.arcadia.edu/thecompass/vol1/iss5/6
Shahhosseini, A. M., Moayed, F. A., & McLeod, A. (2020, June 22-26). Strategies for increasing enrollment, retention, and graduation in two baccalaureate degree STEM programs: Mechanical Engineering Technology (MET) and Safety Management (SM) [Paper presentation]. 2020 ASEE Virtual Annual Conference Content Access, Virtual Conference. https://monolith.asee.org/public/conferences/172/papers/29080/view
Stromei, L. K. (2000). Increasing retention and success through mentoring. New Directions for Community Colleges, 2000(112), 55-62. https://doi.org/10.1002/cc.11205
Subasi, A., & Ercelebi, E. (2005). Classification of EEG signals using neural network and logistic regression. Computer Methods and Programs in Biomedicine, 78(2), 87-99. https://doi.org/10.1016/j.cmpb.2004.10.009
Susto, G. A., Schirru, A., Pampuri, S., McLoone, S., & Beghi, A. (2015). Machine learning for predictive maintenance: a multiple classifiers approach. IEEE Transactions on Industrial Informatics 11(3), 812-820. https://doi.org/10.1109/TII.2014.2349359
Tiwari, V., & Khare, N. (2015). Hardware implementation of neural network with Sigmoidal activation functions using CORDIC. Microprocessors and Microsystems, 39(6), 373-381. https://doi.org/10.1016/j.micpro.2015.05.012
Veenstra, C. P., Dey, E. L., & Herrin, G. D. (2009). A Model for freshman engineering retention. Advances in Engineering Education, 1(3), 1-33. https://files.eric.ed.gov/fulltext/EJ1076050.pdf
Wang, J., Fu, P., & Gao, R. X. (2019). Machine vision intelligence for product defect inspection based on deep learning and Hough transform. Journal of Manufacturing Systems, 51, 52-60. https://doi.org/10.1016/j.jmsy.2019.03.002
Wang, M.-T., Degol, J., & Ye, F. (2015). Math achievement is important, but task values are critical, too: examining the intellectual and motivational factors leading to gender disparities in STEM careers. Frontiers in Psychology, 6, 1-9. https://doi.org/10.3389/fpsyg.2015.00036
Wanto, A., Windarto, A. P., Hartama, D., & Parlina, I. (2017). Use of binary sigmoid function and linear identity in artificial neural networks for forecasting population density. International Journal of Information System & Technology, 1(1), 43-54. https://doi.org/10.30645/ijistech.v1i1.6
Ye, N., Fok, T. Y., Collofello, J., & Coronella, T. (2021, July 26-29). Common and uncommon characteristics of engineering student retention after the first year in university [Paper presentation]. 2021 ASEE Virtual Annual Conference Content Access, Virtual Conference. https://doi.org/10.18260/1-2--36813