INVESTIGATION AND COMPARISON OF CHATGPT AND GOOGLE GEMINI EFFICIENCY IN EDUCATION, DESIGN AND ENGINEERING ANALYSIS

Ghashochi-Bargh, Hadi; Sadr, Mohammad Homayoune; Aghababaee, Ali

doi:10.22047/ijee.2024.467824.2096

INVESTIGATION AND COMPARISON OF CHATGPT AND GOOGLE GEMINI EFFICIENCY IN EDUCATION, DESIGN AND ENGINEERING ANALYSIS

Document Type : Scientific - Research

Authors

Hadi Ghashochi-Bargh ¹

Mohammad Homayoune Sadr ²

Ali Aghababaee ³

¹ Department of Industrial, Mechanical and Aerospace Engineering, Buein Zahra Technical University, Buein Zahra

² Aerospace Engineering Department, Amirkabir University of Technology, Tehran, Iran

³ Department of Aerospace Engineering, Faculty of New Sciences and Technologies, University of Tehran, Tehran, Iran

https://doi.org/10.22047/ijee.2024.467824.2096

Abstract

Abstract: In this paper, the potential use of ChatGPT and Google Gemini in engineering education, design, and analysis is investigated and compared through a multiple case study method and the results of other studies are also used in this purpose. For several different engineering cases, it is ilustrated how students and engineers can use them. The capabilities, limitations, advantages and disadvantages of using these chatbots in engineering research and education are also discussed, and practical strategies for the effective use of the two chatbots by engineering students, professors, and designers are presented. The results show that the use of sufficient and clear input information in the above chatbots plays a decisive role in reaching the appropriate response. Also, the two chatbots are not very successful in the face of complex engineering problems and in some cases, they refer the problems to expert consultation or to use other engineering softwares. On the other hand, for simple computational engineering problems, ChatGPT usually does not give correct answers, unlike Google Gemini. Overall, the mentioned chatbots can significantly facilitate the work of engineers in design, calculations, material selection, and other tasks, and also, provide significant assistance in the field of education.

Keywords

Keywords: Artificial intelligence

ChatGPT

Google Gemini

engineering education

analysis

20.1001.1.16072316.1403.26.104.3.4

Subjects

New frontiers in Engineering Education

References
Aluga, M., (2023). Application of CHATGPT in civil engineering. East African Journal of Engineering, 6(1), 104-112.
Armero Martínez, A., Capuz Rizo, S., & Hernández Orallo, E., (2023). Current application of artificial intelligence tool ChatGPT to the development of engineering projects. 27th International Congress on Project Management and Engineering, Donostia-San Sebastián, 1876-1887.
Badini, S., Regondi, S., Frontoni, E., & Pugliese, R., (2023). Assessing the capabilities of ChatGPT to improve additive manufacturing troubleshooting. Advanced Industrial and Engineering Polymer Research, 6(3), 278-287.
Bahrini, A., Khamoshifar, M., Abbasimehr, H., Riggs, R.J., Esmaeili, M., Majdabadkohne, R.M., & Pasehvar, M., (2023). Chat GPT: Applications, opportunities, and threats. 2023 Systems and Information Engineering Design Symposium (SIEDS), IEEE, 274-279.
Banerjee, P., Srivastava, A., Adjeroh, D., Reddy, Y.R., & Karimian, N., (2023). Understanding ChatGPT: Impact analysis and path forward for teaching computer science and engineering. Authorea Preprints, 1-20.
Baytak, A,. (2024). The content analysis of the lesson plans created by ChatGPT and Google Gemini. Research in Social Sciences and Technology, 9(1), 329-350.
Biswas, S., (2023). Role of ChatGPT in computer programming. Mesopotamian Journal of Computer Science, 2023, 9-15.
ChatGPT. (2024). https://chat.openai.com/chat. Accessed on January.
Farhat, F., Silva, E.S., Hassani, H., Madsen, D.Ø., Sohail, S.S., Himeur, Y., Alam, M.A., & Zafar, A., (2023). Analyzing the scholarly footprint of ChatGPT: Mapping the progress and identifying future trends. Preprints.
Giray, L., Jacob, J., & Gumalin, D.L., (2024). Strengths, weaknesses, opportunities, and threats of using ChatGPT in scientific research. International Journal of Technology in Education (IJTE), 7(1), 40-58.
Google Gemini. (2024). https://gemini.google.com. Accessed on July.
Grace, Y., & Sun, E. W. H. (2024). Comparative analysis of ChatGPT-4and gemini advanced in erroneous code detection and correction. BSc thesis, Linnaeus University.
Hasanein, A., Sobaih, A., & Elshaer, I. (2024). Examining Google Gemini’s acceptance and usage in higher education. Journal of Applied Learning and Teaching, 7(2).
Hassan, E., Bhatnagar, R., & Shams, M.Y., (2023). Advancing scientific research in computer science by ChatGPT and LLaMA-A review. International Conference on Intelligent Manufacturing and Energy Sustainability, Singapore: Springer Nature Singapore, 23-37.
Hassani, H., & Silva, E.S., (2023). The role of ChatGPT in data science: how ai-assisted conversational interfaces are revolutionizing the field. Big Data and Cognitive Computing, 7(2), 62.
Heitz, L. B., Chamas, J., & Scherb, C. (2024). Evaluation of the programming skills of large language models”. arXiv preprint:2405.14388.
Imran, M., & Almusharraf, N. (2024). Google Gemini as a next generation AI educational tool: a review of emerging educational technology. Smart Learning Environments, 11(1), 22.
Kalla, D., Smith, N., Kuraku, S., & Samaah, f. (2023) Study and analysis of ChatGPT and its impact on different fields of study. International Journal of Innovative Science and Research Technology, 8(3), 827-833.
Kandpal, N., Deng, H., Roberts, A., Wallace, E., & Raffel, C., (2023). Large language models struggle to learn long-tail knowledge. International Conference on Machine Learning, PMLR, 15696-707.
Nelson, M.D., Goenner, B.L., & Gale, B.K., (2023).Utilizing ChatGPT to assist CAD design for microfluidic devices. Lab on a Chip, 23(17), 3778-3784.
Nikolic, S., Daniel, S., Haque, R., Belkina, M., Hassan, G.M., Grundy, S., Lyden, S., Neal P., & Sandison, C., (2023). ChatGPT versus engineering education assessment: A multidisciplinary and multi-institutional benchmarking and analysis of this generative artificial intelligence tool to investigate assessment integrity. European Journal of Engineering Education, 48(4), 559-614.
Nyaaba, M. (2024). Generative AI conception of the nature of science. Society for Information Technology and Teacher Education International Conference, Chesapeake, Virginia, 18181827.
Pierson, K.C., & Ha, M.J., (2024). Usage of ChatGPT for engineering design and analysis tool development. AIAA SCITECH 2024 Forum, 0914.
Prieto, S.A., Mengiste, E.T., & García de Soto, B., (2023). Investigating the use of ChatGPT for the scheduling of construction projects. Buildings, vol. 13(4), 857.
Rane, N., Choudhary, S., & Rane, J. (2024). Gemini versus ChatGPT: applications, performance, architecture, capabilities, and implementation. Journal of Applied Artificial Intelligence, 5(1), 69-93.
Ray, P.P., (2023). ChatGPT: A comprehensive review on background, applications, key challenges, bias, ethics, limitations and future scope. Internet of Things and Cyber-Physical Systems. 3, 121-154.
Rice, S., Crouse, S.R., Winter, S.R., & Rice, C., (2024). The advantages and limitations of using ChatGPT to enhance technological research. Technology in Society, 76, 102426.
Rodriguez-Sarmiento, L.F., Galpin, I., & Sanchez-Riaño, V., (2024). Mapping brand territories using ChatGPT. International Conference on Applied Informatics, Springer, Cham, 31-46.
Ruby, D., (2023). ChatGPT statistics for 2023: Comprehensive facts and data. Demand sage, Feb 8. Online. https://www.demandsage.com/chatgpt-statistics/, accessed March 1, 2023.
Saeidnia, H.R., (2023). Welcome to the Gemini era: Google DeepMind and the information industry. Library Hi Tech News, ahead-of-print.
Sánchez-Ruiz, L.M., Moll-López, S., Nuñez-Pérez, A., Moraño-Fernández, J.A., & Vega-Fleitas, E., (2023). ChatGPT challenges blended learning methodologies in engineering education: A case study in mathematics. Applied Sciences, 13(10), 6039.
Shewale, R., (2024). Google Gemini statistics (2024 Users & Traffic), Feb 16. Online. https://www.demandsage.com/google-gemini-statistics/, accessed July 13, 2024.
Tiro, D., (2023). The Possibility of applying ChatGPT (AI) for calculations in mechanical engineering. International Conference “New Technologies, Development and Applications. Cham: Springer Nature Switzerland, 313-320.
Wang, X., Anwer, N., Dai, Y., & Liu, A., (2023). ChatGPT for design, manufacturing, and education. Procedia CIRP, 119, 7-14.