Abstract: The researchers conducted this study to develop and validate instrument in assessing the perception of University students of the use of AI in research in the College of Industrial Technology, Sultan Kudarat State University, Isulan, Sultan Kudarat, in 2023. It was done in three-phases: (1) Defining the Focus and Item Generation; (2) Content Validation; and (3) Internal Consistency Assessment. Figure 1 shows the overview of the instrument development and validation process adopted from Bazhan et al. (2023) with modifications. As to content validity, the expert panel members evaluated the 90 items based on the four-point scale. Then, CVI for each item was calculated. In this round, the responses of the experts were converted as 1 (relevance scale of 3 or 4) or 0 (relevance scale of 1 or 2). In this stage, 11, 24, and 14 items with a content validity ratio (CVR) of less than 1 were eliminated for constructs 1, 2, and 3, respectively. The remaining items were revised to satisfy the recommendations of the experts in terms of the consistency of statements’ verb tenses as well as the points of view utilized. As to internal consistency, it revealed that the reliability of the three constructs is greater than 0.90, indicating that the reliability is acceptable. This implies that all items demonstrated a valid internal consistency. Cronbach’s α between 0.8 to 1 shows good reliability, between 0.6 to 0.79 indicates the reliability is acceptable, and less than 0.6 indicates poor reliability. Therefore, it is concluded that the students had positive perceptions towards the use of AI applications. The students enjoyed the learning, and the AI applications helped them in their writing. They reported that the AI used could help them understand the theoretical concepts, assist them during the writing process, and help them learn the grammar and vocabulary items in their writing. Thus, it is recommended that utilization of the developed tool to assess the perceptions of university students in AI in research will be used.
Keywords: Development and Validation of an Instrument, University Students, Artificial Intelligence, Research, Philippines, Taiwan, United States of America.
Title: Development and Validation of an Instrument Assessing University Students’ Perceptions of the Use of Artificial Intelligence for Research
Author: Cyril John A. Domingo, Kennedy A. Genon, Therese Niña V. Torres, Yvonne Lynn V. Torres, Dr. Lorlaine R. Dacanay
International Journal of Mathematics and Physical Sciences Research
ISSN 2348-5736 (Online)
Vol. 11, Issue 2, October 2023 - March 2024
Page No: 15-25
Research Publish Journals
Website: www.researchpublish.com
Published Date: 20-December-2023
