Next Article in Journal
Anticipatory Thinking as a Key Competence in Management for Sustainability: The Results of Research Among Polish Teenagers
Previous Article in Journal
From Conventional to Organic Agriculture: Influencing Factors and Reasons for Tea Farmers’ Adoption of Organic Farming in Pu’er City
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

An Investigation of University Students’ Perceptions of Learning Management Systems: Insights for Enhancing Usability and Engagement

by
Ahlam I. Almusharraf
Department of Management, College of Business Administration, Princess Nourah Bint Abdulrahman University, P.O. Box 84428, Riyadh 11671, Saudi Arabia
Sustainability 2024, 16(22), 10037; https://doi.org/10.3390/su162210037
Submission received: 29 September 2024 / Revised: 6 November 2024 / Accepted: 7 November 2024 / Published: 18 November 2024

Abstract

:
Learning management systems (LMS) have become central to modern education, enabling accessible, personalized, and engaging learning experiences. This study aims to investigate Saudi university students’ perception of LMS in order to explore the critical factors that shape their engagement, satisfaction, and acceptance of these platforms. Drawing from the existing literature that points out the usability challenges of LMS, this study hopes to derive actionable insights to optimize e-learning outcomes. Using Kelly’s repertory grid analysis technique, this study systematically captured and analyzed the personal constructs students associate with LMS, focusing on ease of use, interactivity, and content alignment with educational needs. A sample of 20 university students provided insights on their experiences with LMS features related to usability, functionality, and interactivity, which are critical to engagement. Findings indicate that ease of use is a major determinant of acceptance, along with interactivity and relevant content delivery that supports diverse learning preferences. The study identifies key elements to improve LMS platforms, fostering a more engaging digital learning environment and supporting students’ learning needs. The findings highlight the key aspects: usability of LMS and students’ satisfaction through user-friendly interfaces and interactive features. Institutions that incorporate student feedback into LMS development will likely see improved e-learning outcomes. This research contributes to a deeper understanding of LMS user perceptions and implies refinements that can align platforms with pedagogical demands in higher education.

1. Introduction

In recent years, learning management systems (LMS) have developed digital platforms that support the accomplishment of e-learning content delivery, communication, and management of academic tasks in modern education [1]. LMS adoption is in line with broader changes toward technology-enhanced learning, seeking improvement in access, flexibility, and quality of education [2]. However, their implementation worldwide is highly variable, as it depends on specific cultural and institutional factors. Previous studies indicate that LMS benefits, such as enhanced interaction and accessibility, can be offset by barriers to users’ acceptance of the technology, particularly across diverse cultural contexts [3,4]. This is particularly significant in Saudi Arabia, where Vision 2030—Saudi Arabia’s strategic initiative to modernize its education sector—emphasizes the need to understand LMS adoption from the perspective of local users for maximum benefit realization [5]. While LMS has been widely adopted, there has yet to be sufficient scholarly work on how students are responding to and engaging with these systems, especially in the context of culturally unique settings such as Saudi Arabia.
Student perceptions of LMS are pivotal to the success of e-learning initiatives [5]. These perceptions influence how students engage with the platform, affecting their learning outcomes and overall satisfaction with their educational experience [3]. Prior studies demonstrated technology adoption behavior in many aspects [6,7,8], which indicates that adoption behavior in technology may influence various aspects. However, the adoption of LMS is often met with challenges related to user engagement, system usability, and the alignment of LMS features with pedagogical needs [9]. These challenges are further compounded by the varied experiences and expectations of students, which are shaped by factors such as prior exposure to digital technologies, perceived ease of use, and perceived usefulness of the LMS [10]. Addressing these issues requires a deeper understanding of the factors that influence student perceptions of LMS and their impact on the effectiveness of e-learning environments.
This study focuses on exploring students’ perceptions regarding adopting the learning management system tool as part of their learning process and analyzing its impact on their academic learning experiences. Most schools face problems with implementing e-learning, proper planning of the educational process, and student engagement with LMS platforms. With the conviction of quickly assembling a conceptual framework, the persuasive techno-determinist approach in e-learning has a possible root in human drivers of the illusive world of technologies, a ghetto armed with employment limited only to confined technological space. To achieve this goal, this study implements the method of personal constructs by Kelly (1955), following the approach used by Odekeye ei. Al. (2023) to determine the students’ attitudes toward using the LMS system and e-learning technologies and the effectiveness of such measures in education and development [11]. The RepGrid technique is particularly suited for exploring the complex and subjective nature of personal constructs, allowing researchers to uncover the nuanced ways in which students conceptualize their experiences with LMS [12]. The study by Reichelt (2023) seeks to provide valuable insights into enhancing e-learning environments by assessing personal constructs to identify critical factors that affect students’ acceptance and utilization of learning management systems (LMS) [13]. The choice of RepGrid is motivated by its ability to reveal deep, often unarticulated, cognitive patterns that underlie students’ attitudes toward technology, which more conventional survey methods can overlook [14,15].
Specifically, this research examines the acceptance and use of LMS among university students in Saudi Arabia, a region where adopting digital learning tools is part of a broader strategy to modernize the education sector under the Saudi Vision 2030 initiative [16]. Vision 2030 aims to diversify the Saudi economy and enhance the quality of life by investing in technology and education, making the study of LMS adoption particularly relevant [17]. The varied perceptions, understandings, and misunderstandings of people or groups concerning their constructs are well taken by the RepGrid approach. Such an analysis of the constructs will be beneficial in determining how easily students will embrace the use of learning management systems (LMS) and what elements will increase the capacity of this technology to influence the learning of students and the quality of teaching provided to them in higher education [18]. The growing adoption of LMS in educational environments has prompted several researchers to study students’ feelings and experiences toward these systems [19,20,21]. While platforms like Moodle and Blackboard have been extensively studied for their technical features and usability [22], there is still a lack of comprehensive understanding of how students view and interact with these systems daily [23,24]. The RepGrid approach provides a valuable framework for capturing these experiences by eliciting personal constructs that reflect students’ varied perceptions and understandings [25].
The study also addresses broader implications of LMS perceptions on the quality of teaching and learning in higher education. By identifying elements that enhance or hinder the effectiveness of LMS, the findings can inform educators, administrators, and policymakers about the strategies needed to foster a more supportive and engaging digital learning environment [26]. Understanding these perceptions is vital for developing LMS that meet technical standards and resonate with the users’ learning needs and preferences, ensuring that a deep understanding of user needs and experiences accompanies technological solutions in education [27]. Adopting LMS in educational institutions often faces challenges related to implementation, proper planning, and student engagement with LMS platforms [9]. These challenges are compounded by a lack of comprehensive understanding of students’ attitudes and expectations, which can significantly affect the successful implementation of e-learning initiatives [28]. To address these issues, this research employs the RepGrid technique to capture the nuanced perspectives of students on LMS. Focusing on the constructs that shape students’ experiences, this approach aims to identify key factors influencing their engagement and satisfaction with LMS, thereby providing insights critical for optimizing the learning process [29]. As educational institutions increasingly integrate LMS to enhance teaching and learning, comprehending how students perceive these systems becomes crucial to optimizing their effectiveness and ensuring positive learning outcomes [30].
This paper tries to fill this gap by investigating university students’ perceptions of LMS regarding usability, engagement, and learning outcomes in Saudi Arabian universities. The core research question is how do university students in Saudi Arabia perceive LMS, and how do these perceptions impact the effectiveness of e-learning?
Understanding these perceptions is crucial, as they directly influence students’ engagement, satisfaction, and academic outcomes [6]. While students’ perception of LMS is the independent variable, their effects on e-learning effectiveness—measured by engagement and academic experience—act as the dependent variable.
Our research aims to analyze how students’ subjective experiences influence the perceived effectiveness of LMS in supporting e-learning, focusing on capturing these constructs using the Repertory Grid (RepGrid) technique. Kelly’s RepGrid technique is ideal for exploring personal constructs in this context, allowing us to elicit subtle perceptions generally left unnoticed by traditional survey approaches [7]. The findings are useful within the Saudi Arabian context and have implications for how LMS design and use can be optimized more broadly. These insights can help educators, administrators, and policymakers understand the needs of LMS users for the development of more effective pedagogical strategies and technology policies. This research has limitations, including a limited sample size and regional focus, which may limit the generalizability of the results. Future research can learn from larger and more diverse samples.
The related literature is reviewed in Section 2; the methodology, findings, and discussion of implications and limitations are presented in Section 3, Section 4, and Section 5, respectively, with directions for future research. This study contributes valuable knowledge toward enhancing e-learning environments through a systematic examination of students’ perceptions of LMS.

2. Literature Review

The world has been experiencing the development of cutting-edge technologies and how these technologies have been influencing all aspects of various fields [31,32,33]. However, the education sector in Saudi Arabia has seen significant growth due to high investment in Information Communication Technology (ICT). The Kingdom of Saudi Arabia has prioritized sustainability since the 2030 vision, aiming for net zero emissions by 2060 [34]. This aligns with Vision 2030’s energy transition and sustainability goals, promoting investment and a more sustainable environment [35]. Saudi Arabia’s sustainability is reflected in all aspects of its activities, urging other countries to follow its lead in tackling energy and climate problems. The development evolution as the result of ICT integration has brought about changes within modern economies, and progress has been made in sustainable development. ICTs have played a crucial role in enhancing the synergy among various sectors, contributing positively to developing countries by improving education, healthcare, governance, and communication. Studies indicate that the use of technology in learning strategies within the classroom enhances student participation more than the traditional methods of learning information within the classroom [36]. The outcomes further point out that students’ ICT use helps in cooperative learning and problem-solving, while the environments offered are also flexible in terms of learning [37]. However, recent studies indicate that the integration of ICT in education goes beyond infrastructure, requiring a deeper understanding of how these technologies affect student engagement, learning outcomes, and satisfaction [38]. Expanding on these insights, this review explores the nuances of LMS adoption and its impact on e-learning effectiveness, particularly in Saudi Arabia.
The increasing reliance on LMS platforms during the COVID-19 pandemic has revealed insights into student engagement and performance through e-learning frameworks [39,40]. During COVID-19, the business paradigm has shifted and experienced many changes in diverse aspects [7,41,42]. However, studies investigating students’ views on e-learning during its growth and spread have shown that service quality, teacher participation, and system quality are critical and significantly impact the students’ views of e-learning in the first wave across 10 countries. Although digital skills and e-interactions emerged as less important, they contributed to learning satisfaction evaluation [39]. According to Gamage et al. (2022), the Moodle platform is a learning management system, and its usability is evident in that it can be adjusted to be used in different educational settings [38]. This literature study drew from publications detailing new developments in the field between 2015 and 2021, such as, but not necessarily limited to, the training of the teachers and the utilization of interactive tools to improve students’ engagement and effectiveness [38]. The study results of Alshammari (2024)’s study indicate that students’ attendance and comprehension of the fundamental principles of the complex use of LMS tools have significantly improved. The research asserted that learners’ performance was enhanced not because of the contents but because of the interactive elements embedded within LMSs, such as quizzes, discussion boards, and immediate feedback [43].
Nikou and Maslov (2021) also studied the obstacles the Saudi university system encountered during the strong momentum towards online learning. The study revealed that while LMS platforms helped a lot in supporting education during the pandemic, there were complications concerning infrastructure, user training, and student attachment. Such findings point towards the continued need for investment in technological infrastructure and training to realize the potential benefits of LMS platforms in higher education. In the same way, a study on the interactivity of Blackboard in Saudi universities revealed that the students were better able to upload and hand in work and learning materials as well as receive feedback, hence performing better academically. However, the study also pointed out that the effectiveness of Blackboard was limited by participants’ utilization of the system as well as their zeal to learn using online resources [44]. Alshammari (2024) examined students’ attitudes towards blended learning incorporating the use of LMS tools. The study demonstrated that although learners appreciated the take-home benefits of blended learning, courtesy of its flexibility and convenience, there was a limitation on more support systems to allow for the effective transition to online environments [43]. Cranfield et al. (2021) address the issue of how learning management systems affect learning activities in the long term, including the history of students. They conclude that the more students engage in academic activities using tools such as LMS throughout their academic journey, the more they succeed academically, the more engaged they are, and the more satisfied they are with the learning process [45].
These studies also draw attention to the necessity of conducting additional studies regarding the social role of ICT education in Saudi Arabia, which is progressive in many areas instead of just education. The Saudi Arabia Development Plan outlines what the country hopes to achieve in the years to come, which includes enhancing the globalization of the Saudi economy, attracting foreign investors, and increasing the volume of non-oil exports so that the country does not suffer in the future when oil becomes a thing of the past. These are the two main factors that the educational system’s modernization and the population’s continual training serve to conduct the country’s economic modernization. The national plan Saudi Vision 2030 has embraced several recommendations, such as programs, initiatives, and projects likely to support the pan-global drive toward sustainable development [46]. Universities are integral to restructuring their education systems when such concepts as active learning and adapting new learning technologies are properly employed within those institutions [47,48]. Such initiatives permit altering the learning system, increasing student involvement, and optimizing cooperative learning [49]. Increasingly, universities have adopted LMS platforms and tools like Blackboard to further their e-learning and mobile learning stakeholders [50]. Since the technological evolution has developed [31,32,33], LMS platforms have gained the capability to enhance assessment evaluation, support diverse teaching methods, and boost technical skills for students and higher education teachers more efficiently [51]. The student’s learning experience is improved by incorporating learning platforms with better capabilities, participatory strategies, feedback strategies, and performance monitoring strategies of students’ learning activities [52].
There is an urgency to enhance the elements of quantitative research that seek to assess students’ perception of the use of LMS tools in education and whether they embrace such learning and its outcomes. This sentiment has, however, been observed by researchers such as Sridharan et al. (2010) and Ashrafi et al. (2022), who indicated that there is a paucity of critical studies on the acceptance of these platforms by university students and their willingness to use them [19,53]. Other studies have also investigated the factors that result in learners’ poor adaptation and utilization of these tools in class [54]. This highlights an important point pertinent to our study: that students differ in personality traits, which also shapes their behavioral intentions towards LMS tools as facilitators of IT acceptance and usage.
To analyze how educational institutions have embraced LMS technology and resources for students’ learning, it is vital to look at the perception and other characteristics of the LMS approach. This study will focus on Personal Construct Theory, specifically the Repertory Grid approach, as it pertains to students’ attitudes about using learning management systems in the educational process. This is sage enough, as the research seeks to use constructs and repertory grid analysis to understand the issues that make the students take certain views of LMSs and their probable capabilities in assisting learning. It is therefore important to look at these factors as they would help in developing a plan of action that would help in the usage and the adoption of these LMS platforms, hence aiding in the advancement of the education system in the Kingdom of Saudi Arabia.

3. Theory and Methodology

3.1. Repertory Grid Technique

The Repertory Grid (RepGrid) technique, which is rooted in Personal Construct Theory (PCT) [55], is a valuable tool for studying the way people perceive and interpret their experiences within learning management systems (LMS). George Kelly proposed Personal Construct Theory (PCT) in 1955, asserting that individuals create personal constructs to comprehend life events or situations [56,57]. Since these constructs are formed through varied experiences and ways of thinking, they act as mental models that shape how a person views elements like education or technology. Kelly emphasized that constructs extend beyond straightforward statements and help understand behavior directed toward personal interpretations of reality [58]. This theory highlights individual thought processes and personality in interpreting any given stimulus.
Kelly noted that constructs are essentially bipolar or dichotomous since, for a given individual, when something is considered true, its opposite is denied [59]. Each construct thus has both an emergent and a contrasting pole, with the contrasting pole clarifying the emergent pole [60]. These bipolar poles enable a fuller understanding and explanation of the phenomenon being studied [61]. Unlike concepts, constructs are based on comparing and contrasting occurrences, where some elements share similarities while others diverge. Kelly’s approach to dichotomous constructs differs from traditional conceptual thinking, which tends to arrange phenomena on a single-dimensional basis [60]. This capability of capturing subtle individual perceptions through RepGrid is very important in this research.
A RepGrid comprises three main components: elements, constructs, and links [62]. Elements represent the objects of focus in the study, while constructs represent individual interpretations of these elements [61]. This study employs the RepGrid method to identify bipolar constructs that distinguish a set of LMS features [63]. Links connect the elements to the constructs, demonstrating how individuals perceive similarities and differences among them [64]. Tan and Hunter (2002) [61] describe methods for linking elements to constructs, including dichotomizing, ranking, and rating. Our study uses a five-point rating scale to enable participants to evaluate elements and constructs, supporting an in-depth exploration of subjective experiences with LMS [65].
While RepGrid is well-regarded for capturing detailed cognitive structures, it has limitations. Compared with more structured surveys, such as Likert scales or focus groups, RepGrid strongly relies on subjective interpretation and is likely to introduce individual biases. However, its choice in this study is justified, as RepGrid provides nuanced and systematic insight into the constructs underpinning LMS experiences—something less achievable with other methods. Prior research has shown its effectiveness in exploring subjective student experiences across diverse contexts, particularly within LMS [66,67]. This technique is widely applicable in educational research and allows for capturing personal constructs in a way that can guide improvements in educational technology.
In recent years, the RepGrid technique has been used to understand students’ perceptions of cognitive processes within educational frameworks [68,69]. For instance, one study found that postgraduate students used RepGrid to reflect on their understanding of research processes, offering insights into their academic success. This technique helps to clarify elements that make e-learning effective by capturing unique constructs such as usability, accessibility, and support, thus assisting educators in aligning LMS functionality with student needs.
Research has demonstrated that familiarity with norms, expectations, and beliefs dramatically enhances information systems’ effectiveness [61]. Learning management systems (LMS) success in higher education heavily depends on their sustained adoption [70]. In their seminal work, Tan and Hunter (2002) [61] underscored that understanding individual values can lead to shifts in interpreting experiences with information systems. The RepGrid technique, by exploring human cognition, helps researchers gain insights into how individuals perceive and make sense of their experiences [71]. This technique is versatile and applicable across fields, including organizational behavior [72], education [73], market research [74], and human–computer interaction.
This research, using RepGrid in an LMS context within higher education, is predicated on the widespread application of this methodology and highlights the appropriateness of uncovering student constructs such as usability, content relevance, and interactivity, which can support the actionable enhancement of LMS platforms. Although the RepGrid technique has already been established as appropriate for educational research, its flexibility offers opportunities for future researchers to explore how it might work in diverse educational settings and cultural contexts. This adaptability could yield comparative insights that improve LMS design to meet varied student needs globally.
Lastly, the theoretical framework established by this research provides a strong interpretative model for analyzing students’ subjective experiences and implies practical directions for developing LMS platforms. The present study has identified certain construct-related aspects, such as usability and interactivity, most closely linked with engagement and satisfaction; therefore, it presents some concrete insights that educators and LMS developers can apply to improve educational outcomes and develop digital learning environments that better meet student expectations.

3.2. Study Design

According to Tan and Hunter (2002), the RepGrid technique can be applied in various ways, making it flexible enough to fit into diverse research objectives and contexts [61]. The comprehensive nature of the RepGrid technique suggests that a sample size of approximately 15 to 25 participants is generally adequate to develop a thorough list of constructs and allow for a robust exploration of perceptions [75,76]. Our study’s sample size was 20, balancing the need for diverse construct elicitation with data collection and analysis feasibility.
The study was conducted on 20 students at Saudi universities who were selected to present the diverse characteristics of the LMS, particularly Blackboard, as it is highly adopted in these institutions. Data were collected over four months through interviews with a structured protocol, including introductions to the study’s purpose and detailed instructions on completing the RepGrid interview. Participants were given opportunities to clarify any uncertainties about the process to ensure consistency and comfort throughout the study. The sample included 7 male and 13 female students, aged between 19 and 22, who had all attended university for at least one year. Participants were selected from various fields at several universities to encompass variegated LMS usage and specifically targeted those who have used Blackboard for at least one year to ensure an in-depth assessment of user experience.
The following sections outline the steps taken in applying the RepGrid technique.

3.2.1. Element Elicitation

Elements in this study refer to the specific themes or subjects under analysis [77]. These elements have been chosen to represent the primary tasks of Blackboard with which students usually interact, maintaining a relevant and consistent focus on those features affecting the end-user experience. Consistent with Hedman et al. (2017) and Bourne and Jankowicz (2018), these elements were homogenous, contextually relevant, and avoided inherent bias [78,79]. The elements comprised blackboard announcements, audio/video streamed lectures (blackboard collaborate ultra), discussion boards, tests, course resources, grade center and evaluation, assignments evaluation boards, and Course Information. These categories are central Blackboard functions, paralleling how students interact with LMS. Items were provided as prompts for participants to ensure consistency and appropriateness.

3.2.2. Construct Elicitation

Constructs represent the features that individuals perceive in relation to different stimuli [80]. Constructs are typically bipolar, revealing commonalities and differences between elements [61]. The study used a structured “triading” technique to elicit these constructs, where respondents were presented with three elements at a time [81]. They were then asked to describe similarities and differences between any two elements relative to the third. This method is especially helpful in capturing participants’ impressions of Blackboard’s features [82]. This stage yielded constructs like “easy to use but hard to use” from participants’ responses, which are meaningful in understanding how they felt about the platform’s usability.
Interviews were conducted until theoretical saturation was achieved, which the study defined as the point where additional interviews no longer yielded new constructs. This study reached saturation at 17 interviews, with six additional interviews conducted to confirm saturation and ensure construct diversity. This process produced a total of 16 constructs, including “clear and organized”, “easy to access and reach”, “interactive”, “user-friendly”, and “reliable”, among others. These constructs represent how students evaluate Blackboard’s functionality, usability, and impact on learning outcomes.
Participants then individually rated each construct for each element using a RepGrid interview sheet with a 5-point Likert scale, where five indicated the emergent pole and one denoted the contrast pole. Data were analyzed, and cognitive maps were constructed using Microsoft Excel and IBM SPSS Statistics 30.0.0, resulting in 20 valid grids. These grids were further analyzed to explore patterns in students’ perceptions of LMS features. This analysis aimed to provide a structured understanding of user experience and identify key factors impacting LMS satisfaction and engagement.

4. Data Analysis and Results

4.1. Content Analysis

This study employed Honey’s (1979) content analysis approach [83], as described by Jankowicz (2005) [84], which integrates all construct ratings by calculating the mean of ratings for each element. Before conducting content analysis, the author categorized constructs into three groups using the bootstrapping technique: usability and accessibility (how easily users navigate, engage with, and operate the LMS), functionality and diversity (the breadth and completeness of options and features), and reliability and importance (the LMS’s dependability, relevance, and longevity). Categorizing these constructs upfront adds more clarity to the findings and helps to interpret what aspects users focus on. Table 1 presents the constructs grouped under each category based on this initial classification.
Following the content analysis, this study used frequency distribution to highlight trends within the data. This approach revealed that constructs associated with reliability and relevance attained higher ratings than those associated with usability, accessibility, functionality, and diversity (see Figure 1). The frequency of construct ratings within each group demonstrates which elements participants found most essential (Appendix A).

4.2. Participant Variability Across Construct Ratings

To examine differences in participant perceptions across the construct groups, this study analyzed variability using standard deviations and ranges for each category. These values offer insight into the distribution of ratings and the level of consensus among participants [85,86]. Notably, constructs within the “reliability and importance” category exhibited a higher degree of agreement (lower standard deviation), while ratings for “functionality and diversity” showed a wider range, indicating more varied participant perceptions. Table 2 below summarizes these findings, presenting the highest-scoring constructs in each group along with variability statistics.

4.3. Principal Components Analysis (PCA)

This study applied principal components analysis (PCA) to further analyze perception differences to examine the construct variance and correlation [87]. PCA, a common technique for analyzing RepGrids, reveals patterns within the data by identifying principal components that explain the most variance [84,88]. This study retained components with eigenvalues greater than 1, explaining about 70% of the total variance. This threshold helped identify the constructs participants perceived as most influential for LMS use. Varimax orthogonal rotation was applied to enhance the interpretability of the component loadings (Table 3).

4.4. Practical Implications for LMS Design

Our findings suggest specific design enhancements for LMS platforms. For example, high ratings on “reliability and importance” point to the critical need for LMS platforms to be reliable and continuously updated to ensure relevance and dependability. Participants also emphasized features tied to “usability and accessibility”, such as simplified navigation and user-friendly interfaces. Consequently, these findings imply that improving system accessibility and interactive elements could enhance user satisfaction and engagement with LMS platforms.

4.5. Perceptions Based on User Experience with the Platform

Finally, this study examined perceptions based on participants’ experience level with the LMS (second-year, third-year, fourth-year, and higher education students). Results suggested that students in fourth-year and above placements scored “functionality and diversity” constructs higher than their younger counterparts, suggesting that experience with the LMS influences expectations for diverse and comprehensive features. In contrast, younger participants prioritized usability and accessibility features, possibly due to their familiarity with intuitive, easy-to-navigate systems.
These analyses give a more comprehensive insight into the LMS constructs appreciated by different user groups and provide specific insights on improving LMS design.

5. Discussion

Understanding factors affecting students’ adoption and usage of LMS may contribute to improving e-learning and promoting sustainability within educational frameworks. These findings indicate that students’ values are a major driver of their perceptions of the LMS platforms [89,90,91,92]. To get to this point, this study used repertory grid analysis in the classroom, highlighting the importance of different perspectives from key players like the students. Consequently, educational institutions can create a more engaging and tailored learning environment by considering these various perspectives and developing governance methods to monitor LMS usage better [93].
The increased use of LMS platforms due to the COVID-19 pandemic provides very important insights related to the e-learning context [94]. As Ellianawati et al. (2021) and Abu-Hashem et al. (2023) pointed out, students faced different challenges adapting to online learning. Some common challenges related to techno-tolerance and engagement were observed because of remote learning. These studies are in line with our research findings and suggest that an intuitive interface and interactivity are essential to promoting engagement. The pandemic experience has underlined the need for culturally contextualized content and local-language support, particularly within a region like Saudi Arabia [95,96].
In this way, the integration of emerging technologies such as artificial intelligence and augmented reality in LMS would redefine e-learning regarding personalization, interactivity, and engagement. Similarly, AI-driven LMS platforms might offer adaptive learning experiences tailored to each student’s needs by applying data on progress and preferences to suggest personalized content and feedback, hence increasing engagement and learning results. AI can take over the administrative burden, reducing the cognitive load on both the students and the educators and freeing up time for deeper interactions; AR introduces immersive, interactive learning through placing digital information into real-world environments. This will allow exploring complex subjects—science or history—in 3D, making learning more intuitive and relevant. AR-driven learning can enhance student engagement by providing context-rich and visually engaging content, which might improve LMS acceptance and satisfaction [97,98].
In terms of student acceptance and utilization of LMS, this study’s analysis has yielded quite noticeable relative variances in numerous dimensions. The more familiar the students are with the LMS platforms, the more noticeable this relative variance becomes. The amount of involvement and approval is affected by how students’ perceptions alter as they gain familiarity. Recognizing and addressing any discrepancies in adapting LMS features to students’ evolving demands requires understanding these shifting perceptions. This will ensure that the LMS remains useful and applicable to students throughout their education.
Such variation in student perceptions calls for a deeper understanding of what LMS can offer and the consequences of such perceptions for engagement. Although this study specifically focuses on perceptions of LMS among university students in Saudi Arabia, other studies from North America, Europe, and parts of Asia also report both common and unique factors that influence LMS engagement and effectiveness. For example, European research often identifies perceived ease of use and interactivity as significant predictors of student engagement and satisfaction [44]—two constructs that also emerged in the Saudi Arabian context. However, much of the North American studies emphasize content relevance and LMS usability [2,20,38], which this study also found important to increase engagement. Identification of these similarities and differences cross-contextually is very key to resolving inconsistencies in the optimization of LMS. Having such insight, educational institutions can enhance user experience and foster successful LMS adoption within their unique learning environment.
The pandemic has shown that LMS platforms are very critical to the continuity of education. Most of the regional studies pointed out that a well-designed LMS system, concerning user friendliness, interactivity, and flexibility, can dramatically affect students’ satisfaction and engagement, which is in line with our findings. Closing this perception gap will help educational institutions adopt better means of improving user experience and engagement for the successful implementation of LMS within the learning environment [95,96].
By integrating these insights, it becomes possible for educational institutions in Saudi Arabia and elsewhere to create policies supporting user-centered design and regular user feedback. The pandemic experience showed that responsive LMS design—incorporating feedback and supporting diverse user needs—is foundational to effective digital learning environments.
In “Figure 2”, each colored line represents one participant’s perception. The figure displays how the participants have some differences in their perceptions regarding each of the eight features of the blackboard. Two points on two lines intersect, meaning the two participants have the same perception regarding the respective feature. Higher-year students rated LMS constructs more favorably, particularly in helpfulness and learning enhancement. At the same time, reliability and up-to-date information consistently received high ratings across all groups, indicating their importance in LMS design. This suggests that as students advance in their education, their expectations for comprehensive features and usability increase.
By aligning LMS features with students’ evolving values, this research contributes to sustainability in education by promoting responsible and responsive learning environments. Knowing students’ perceptions offers several significant benefits in improving the e-learning experience as follows:
  • Tailored learning experience: The LMS course design aligns with students’ content preferences and learning styles, potentially enhancing engagement and motivation. This customization enhances the learning experience and contributes to superior educational outcomes, fostering a more sustainable approach to education.
  • Effective communication: A detailed understanding of students’ perceptions will enable educators to emphasize the advantages of LMS more effectively. Addressing any misconceptions or concerns directly may foster a positive attitude towards the platform, hence enhancing adoption rates and diminishing resistance.
  • Improved user experience: Understanding student perceptions is crucial for enhancing the LMS interface. Enhancing usability and functionality informed by feedback renders the platform more accessible and user-friendly, thereby boosting navigation, interaction, and overall satisfaction within the e-learning environment.
  • Optimized training and support: Educators can now create focused training and support materials that precisely meet students’ needs and perceptions. This will ensure that students receive timely guidance and support in utilizing the full features of the LMS, ultimately enhancing their learning outcomes and effectiveness.
  • Augmented engagement and retention: This process promotes comprehensive student success, elevated academic achievement, and enhanced knowledge retention by creating engaging and relevant learning experiences informed by students’ perspectives. It also encourages active involvement and collaboration.
  • Resource efficiency: LMS platforms significantly reduce the need for physical materials like paper and textbooks while digitizing course content and assessments. This aligns with environmental sustainability goals, including conserving resources and reducing waste, and making educational practices more sustainable.
  • Accessibility and inclusion: LMS platforms provide equitable access to education, supporting social sustainability and lifelong learning. They broaden educational opportunities, reduce the need for physical campus infrastructure, and reduce land use and building material consumption. This sustainable growth management helps educational institutions manage their growth without additional environmental burdens.
This research not only answers the first problem statement by giving insights on what factors influence LMS adoption but has also contributed to the expanded debate on sustainability in education by pointing out that alignment of educational technology with students’ perceptions and values needs to be achieved, thus developing LMS that will support sustainable educational practices.

6. Conclusions

This study provides significant insights into how university students in Saudi Arabia perceive learning management systems (LMS) like Blackboard. By applying the Repertory Grid technique, this study is able to capture and analyze students’ subjective experiences and identify key factors influencing their engagement and satisfaction with these platforms. The results indicate that students’ perceptions are shaped largely by the usability, interactivity, and reliability of LMS features, which in turn affect their overall learning experience.
Our results obviously show that enhancing the usability and interactive features of LMS significantly raises the level of students’ engagement and satisfaction. Those features, which are easy to use and navigate, are especially important to let the student feel supported while going through the learning process. Moreover, these data emphasize the need for continuous improvement of LMS based on the feedback from students to keep up with the changing learner needs and also ensure that the LMS remain relevant to the creation of a conducive learning environment.
The research emphasizes the importance of tailoring LMS platforms to student preferences and learning styles. Institutions that proactively address these perceptions by enhancing LMS features and functionality are likely to see improved student performance, satisfaction, and engagement in e-learning environments. This is especially pertinent as educational institutions strive to provide quality education in a rapidly evolving digital landscape. The continued development of robust, flexible LMS platforms for the delivery of quality education in today’s digital environments will depend on insights and solutions regarding student perceptions.
This study also recommends that educators and policymakers prioritize continuous user feedback integration into the LMS design process to adapt to student needs swiftly. Additionally, policies should support the implementation of regular LMS training for educators to maximize the system’s effectiveness. These steps are crucial as they contribute to the development of a more supportive and effective e-learning environment.
However, this study was carried out with a sample size of 20 students in one country, which may not accurately generalize findings to larger demographics. Accordingly, Kelly’s (1955) [58] theory on personal constructs stipulates that individuals perceive and interpret experiences according to their background and contexts in their peculiar way. By focusing on Saudi Arabian universities and the Blackboard LMS in particular, this study may miss out on a diversity of perspectives and experiences by students in different educational settings and cultural environments. Results are generalizable with care since future research needs to include much larger samples and be diversified across more regions and LMS platforms. This would offer a more holistic view of student perception and make the findings more applicable in the e-learning field. The study’s qualitative nature, while informative, could be enhanced by future quantitative methodologies for more extensive statistical confirmation. Subsequent studies ought to investigate larger, more heterogeneous student groups across various nations and LMS. Longitudinal studies investigating the change in students’ perception of LMS as time passes and familiarity increases with the technology should also be included.

Funding

Princess Nourah bint Abdulrahman University Researchers Supporting Project number (PNURSP2024R432), Princess Nourah bint Abdulrahman University, Riyadh, Saudi Arabia.

Institutional Review Board Statement

The study was conducted in accordance with the Declaration of Helsinki and approved by the Institutional Review Board of Princess Nourah bint Abdulrahman University (23-0460—14 May 2023).

Informed Consent Statement

Informed consent was obtained from all subjects involved in the study.

Data Availability Statement

Due to the nature of this research, participants’ data cannot be shared publicly to protect their privacy.

Conflicts of Interest

The author declares no conflicts of interest.

Appendix A

Level of EducationConstructsGroup
2nd YearInteractiveUsability and Accessibility
Easy to useUsability and Accessibility
Helpful and usefulFunctionality and Diversity
Enhance student learningFunctionality and Diversity
Commonly usedReliability and Importance
ImportantReliability and Importance
Information provided is up-to-dateReliability and Importance
ReliableReliability and Importance
3rd YearClear/OrganizedUsability and Accessibility
Attractive/User-friendlyUsability and Accessibility
Facilitate the workUsability and Accessibility
Helpful and usefulFunctionality and Diversity
Commonly usedReliability and Importance
ImportantReliability and Importance
Available for a long timeReliability and Importance
Information provided is up-to-dateReliability and Importance
Reflect students performanceReliability and Importance
4th YearFacilitate the workUsability and Accessibility
Unlimited functions/comprehensiveFunctionality and Diversity
Includes variety of options/diverseFunctionality and Diversity
Enhance student learningFunctionality and Diversity
Information provided is up-to-dateReliability and Importance
ReliableReliability and Importance
Higher EducationClear/organizedUsability and Accessibility
Easy to access/easy to reachUsability and Accessibility
InteractiveUsability and Accessibility
Easy to useUsability and Accessibility
Attractive/user-friendlyUsability and Accessibility
Facilitate the workUsability and Accessibility
Includes variety of options/diverseFunctionality and Diversity
Unlimited functions/comprehensiveFunctionality and Diversity
Helpful and usefulFunctionality and Diversity
Enhance student learningFunctionality and Diversity
Commonly usedReliability and Importance
ImportantReliability and Importance
Available for a long timeReliability and Importance
Information provided is up-to-dateReliability and Importance
ReliableReliability and Importance

References

  1. Dahlstrom, E.; Brooks, D.C.; Bichsel, J. The Current Ecosystem of Learning Management Systems in Higher Education: Student, Faculty, and IT Perspectives; ECAR: Louisville, CO, USA, 2014. [Google Scholar]
  2. Al-Fraihat, D.; Joy, M.; Sinclair, J. Evaluating E-learning systems success: An empirical study. Comput. Hum. Behav. 2020, 102, 67–86. [Google Scholar] [CrossRef]
  3. Mtebe, J.; Raisamo, R. Investigating students’ behavioural intention to adopt and use mobile learning in higher education in East Africa. Int. J. Educ. Dev. Using ICT 2014, 10, 4–20. [Google Scholar]
  4. Almaiah, M.A.; Alamri, M.M.; Al-Rahmi, W. Applying the UTAUT Model to Explain the Students’ Acceptance of Mobile Learning System in Higher Education. IEEE Access 2019, 7, 174673–174686. [Google Scholar] [CrossRef]
  5. Moreno, V.; Cavazotte, F.; Alves, I. Explaining university students’ effective use of e-learning platforms. Br. J. Educ. Technol. 2017, 48, 995–1009. [Google Scholar] [CrossRef]
  6. Aaradhi, V.; Chakraborty, D. EdTech applications and their adoption in Indian education sector—A bibliometric analysis and systematic literature review. High. Educ. Ski. Work Based Learn. 2024, 14, 510–528. [Google Scholar] [CrossRef]
  7. Salam, M.A.; Saha, T.; Rahman, M.H.; Mutsuddi, P. Challenges to mobile banking adaptation in COVID-19 pandemic. J. Bus. Manag. Sci. 2021, 9, 101–113. [Google Scholar]
  8. Salam, M.A.; Rayun, S.M.N.; Leong, V.S. Examining critical factors influencing generation z’s acceptance of mobile payment systems in bangladesh: A utaut model analysis. J. Bus. Econ. Anal. 2024, 15, 20–28. [Google Scholar] [CrossRef]
  9. Alhazmi, A.K.; Rahman, A.A. Why LMS failed to support student learning in higher education institutions. In Proceedings of the 2012 IEEE Symposium on E-Learning, e-Management and e-Services, Kuala Lumpur, Malaysia, 21–24 October 2012. [Google Scholar]
  10. Davis, F.D. Perceived usefulness, perceived ease of use, and user acceptance of information technology. MIS Q. Manag. Inf. Syst. 1989, 13, 319–339. [Google Scholar] [CrossRef]
  11. Odekeye, O.T.; Fakokunde, J.B.; Metu, D.V.; Adewusi, M.A. Perception of Learning Management System (LMS) on the Academic Performance of Undergraduate Students during the COVID-19 Pandemic. Int. J. Educ. Dev. Using Inf. Commun. Technol. 2023, 19, 7–19. [Google Scholar]
  12. Fransella, F.; Bell, R.; Bannister, D. A Manual for Repertory Grid Technique; John Wiley & Sons: Hoboken, NJ, USA, 2004. [Google Scholar]
  13. Reichelt, B. College-Level Foreign Language Instructor’s Perceptions on the Incorporation of Mobile Technology Devices and Their Learning Applications in Curricula: A Collective Case Study. Ph.D. Thesis, Liberty University, Lynchburg, VA, USA, 2023. [Google Scholar]
  14. Rozenszajn, R.; Kavod, G.Z.; Machluf, Y. What do they really think? The repertory grid technique as an educational research tool for revealing tacit cognitive structures. Int. J. Sci. Educ. 2021, 43, 906–927. [Google Scholar]
  15. Vanfretti, L.; Farrokhabadi, M. Evaluating constructive alignment theory implementation in a power systems analysis course through repertory grids. IEEE Trans. Educ. 2013, 56, 443–452. [Google Scholar] [CrossRef]
  16. Alharbi, A.F. Identification of Critical Factors Affecting the Student’s Acceptance of Learning Management System (LMS) in Saudi Arabia. Int. J. Innov. 2020, 9, 353–388. [Google Scholar] [CrossRef]
  17. Faridi, M.R.; Ebad, R. Transformation of higher education sector through massive open online courses in Saudi Arabia. Probl. Perspect. Manag. 2018, 16, 220–231. [Google Scholar]
  18. Ismail, S.N.; Hamid, S.; Ahmad, M.; Alaboudi, A.; Jhanjhi, N. Exploring students engagement towards the learning management system (LMS) using learning analytics. Comput. Syst. Sci. Eng. 2021, 37, 73–87. [Google Scholar] [CrossRef]
  19. Ashrafi, A.; Zareravasan, A.; Rabiee Savoji, S.; Amani, M. Exploring factors influencing students’ continuance intention to use the learning management system (LMS): A multi-perspective framework. Interact. Learn. Environ. 2022, 30, 1475–1497. [Google Scholar] [CrossRef]
  20. Binyamin, S.; Rutter, M.; Smith, S. Extending the technology acceptance model to understand students’ use of learning management systems in Saudi higher education. Int. J. Emerg. Technol. Learn. 2019, 14, 4–21. [Google Scholar] [CrossRef]
  21. Kumar, D.; Koul, S.; Siringoringo, H. Assessing antecedents of behavioral intention to use e-LMS: A case from a private institution in the northern region of India. IEEE Trans. Learn. Technol. 2023, 16, 861–872. [Google Scholar]
  22. Aljawarneh, S.A. Reviewing and exploring innovative ubiquitous learning tools in higher education. J. Comput. High. Educ. 2020, 32, 57–73. [Google Scholar] [CrossRef]
  23. Carvalho, A.; Areal, N.; Silva, J. Students’ perceptions of Blackboard and Moodle in a Portuguese university. Br. J. Educ. Technol. 2011, 42, 824–841. [Google Scholar] [CrossRef]
  24. Ghosh, A.; Nafalski, A.; Nedic, Z.; Wibawa, A.P. Learning management systems with emphasis on the Moodle at UniSA. Bull. Soc. Inform. Theory Appl. 2019, 3, 13–21. [Google Scholar] [CrossRef]
  25. Srivastava, P.K.; Gupta, M.; Jaiswal, B. RepGrid: A new way of identifying and assessing teaching competency. J. Appl. Res. High. Educ. 2021, 13, 577–590. [Google Scholar] [CrossRef]
  26. Jaggars, S.S.; Xu, D. How Do Online Course Des. Features Influ. Stud. Perform? Comput. Educ. 2016, 95, 270–284. [Google Scholar] [CrossRef]
  27. Dey, S.; Lee, S.-W. REASSURE: Requirements elicitation for adaptive socio-technical systems using repertory grid. Inf. Softw. Technol. 2017, 87, 160–179. [Google Scholar] [CrossRef]
  28. Sampson, D.; Ifenthaler, D.; Spector, J.M.; Isaías, P. Digital Technologies: Sustainable Innovations for Improving Teaching and Learning; Springer: Berlin/Heidelberg, Germany, 2018. [Google Scholar]
  29. Bennacer, I. Teaching Analytics: Support for the Evaluation and Assistance in the Design of Teaching through Artificial Intelligence. Ph.D. Thesis, Le Mans Université, Le Mans, France, 2022. [Google Scholar]
  30. Oliveira, P.C.; de A Cunha, C.J.C.; Nakayama, M.K. Learning Management Systems (LMS) and e-learning management: An integrative review and research agenda. JISTEM-J. Inf. Syst. Technol. Manag. 2016, 13, 157–180. [Google Scholar] [CrossRef]
  31. Azad, R.U.; Ahammed, K.; Salam, M.A.; Efat, M.I.A. Block-chain Aided Cluster Based Logistic Network for Food Supply Chain. Int. Conf. Mach. Intell. Emerg. Technol. 2022, 1, 422–434. [Google Scholar] [CrossRef]
  32. Salam, M.A.; Rayun, S.M.N.; Islam, W.; Hasan, R.; Firmansyah, E.A.; Kalinaki, K. Consumer Engagement: Exploring Deepfake Applications in Consumer Marketing Communication. In Navigating the World of Deepfake Technology; IGI Global: Hershey, PA, USA, 2024; pp. 397–421. [Google Scholar]
  33. Satu, M.S.; Yeasmin, T.; Salam, M.A. Towards an AutoML-Based Data Analytical Framework for Predicting Bankruptcy in Industrial. In Proceedings of the International Conference on Trends in Electronics and Health Informatics, Dhaka, Bangladesh, 20–21 December 2023. [Google Scholar]
  34. Al-Sinan, M.A.; Bubshait, A.A.; Alamri, F. Saudi Arabia’s journey toward net-zero emissions: Progress and challenges. Energies 2023, 16, 978. [Google Scholar] [CrossRef]
  35. Asenso-Okyere, K.; Mekonnen, D.A. The importance of ICTs in the provision of information for improving agricultural productivity and rural incomes in Africa. African Human Development Report. UNDP Spons. Res. Ser. 2012, 43, 2012–2015. [Google Scholar]
  36. Islam, M.T.; Ali, A. Sustainable green energy transition in Saudi Arabia: Characterizing policy framework, interrelations and future research directions. Next Energy 2024, 5, 100161. [Google Scholar] [CrossRef]
  37. Almalki, G.; Williams, N. A strategy to improve the usage of ICT in the Kingdom of Saudi Arabia primary school. Int. J. Adv. Comput. Sci. Appl. 2012, 3, 1007. [Google Scholar] [CrossRef]
  38. Gamage, S.H.P.W.; Ayres, J.R.; Behrend, M.B. A systematic review on trends in using Moodle for teaching and learning. Int. J. STEM Educ. 2022, 9, 9. [Google Scholar] [CrossRef]
  39. Keržič, D.; Alex, J.K.; Pamela Balbontín Alvarado, R.; Bezerra, D.D.S.; Cheraghi, M.; Dobrowolska, B.; Fagbamigbe, A.F.; Faris, M.E.; França, T.; González-Fernández, B.; et al. Academic student satisfaction and perceived performance in the e-learning environment during the COVID-19 pandemic: Evidence across ten countries. PLoS ONE 2021, 16, e0258807. [Google Scholar] [CrossRef] [PubMed]
  40. Rajabalee, Y.B.; Santally, M.I. Learner satisfaction, engagement and performances in an online module: Implications for institutional e-learning policy. Educ. Inf. Technol. 2021, 26, 2623–2656. [Google Scholar] [CrossRef] [PubMed]
  41. Rahman, M.T.; Salam, M.A. The Impact of COVID-19 (Coronavirus) on Consumers’ Behavior towards E-commerce. Can. J. Bus. Inf. Stud. 2023, 5, 81–91. [Google Scholar] [CrossRef]
  42. Salam, M.A.; Nabila, S.M.; Dey, T.; Chowdhury, F. Reflection of Customers’ Preference for Offline Shopping amid COVID-19: A Post Vaccination Analysis in Bangladesh. Int. Bus. Res. 2022, 15, 1–39. [Google Scholar] [CrossRef]
  43. Alshammari, A. Using analytics to predict students’ interactions with learning management systems in online courses. Educ. Inf. Technol. 2024, 29, 1–26. [Google Scholar] [CrossRef]
  44. Nikou, S.; Maslov, I. An analysis of students’ perspectives on e-learning participation–the case of COVID-19 pandemic. Int. J. Inf. Learn. Technol. 2021, 38, 299–315. [Google Scholar] [CrossRef]
  45. Cranfield, D.J.; Tick, A.; Venter, I.M.; Blignaut, R.J.; Renaud, K. Higher education students’ perceptions of online learning during COVID-19—A comparative study. Educ. Sci. 2021, 11, 403. [Google Scholar] [CrossRef]
  46. Nilsson, M.; Chisholm, E.; Griggs, D.; Howden-Chapman, P.; McCollum, D.; Messerli, P.; Neumann, B.; Stevance, A.-S.; Visbeck, M.; Stafford-Smith, M. Mapping interactions between the sustainable development goals: Lessons learned and ways forward. Sustain. Sci. 2018, 13, 1489–1503. [Google Scholar] [CrossRef]
  47. Tan, P.J.B. Applying the UTAUT to understand factors affecting the use of English e-learning websites in Taiwan. SAGE Open 2013, 3, 2158244013503837. [Google Scholar] [CrossRef]
  48. Yakubu, M.N.; Dasuki, S.I.; Abubakar, A.M.; Kah, M.M.O. Determinants of learning management systems adoption in Nigeria: A hybrid SEM and artificial neural network approach. Educ. Inf. Technol. 2020, 25, 3515–3539. [Google Scholar] [CrossRef]
  49. Santhanam, R.; Sasidharan, S.; Webster, J. Using self-regulatory learning to enhance e-learning-based information technology training. Inf. Syst. Res. 2008, 19, 26–47. [Google Scholar] [CrossRef]
  50. Miah, M.R.; Hossain, A.; Shikder, R.; Saha, T.; Neger, M. Evaluating the impact of social media on online shopping behavior during COVID-19 pandemic: A Bangladeshi consumers’ perspectives. Heliyon 2022, 8, e10600. [Google Scholar] [CrossRef] [PubMed]
  51. Khlifi, Y. An advanced authentication scheme for e-evaluation using students behaviors over e-learning platform. Int. J. Emerg. Technol. Learn. 2020, 15, 90–111. [Google Scholar] [CrossRef]
  52. Wu, W.; Hwang, L.-Y. The effectiveness of e-learning for blended courses in colleges: A multi-level empirical study. Int. J. Electron. Bus. Manag. 2010, 8, 312. [Google Scholar]
  53. Sridharan, B.; Deng, H.; Corbitt, B. The perceptions of learners on the effectiveness of e-learning in higher education: An empirical study. In Proceedings of the 2010 2nd International Conference on Education Technology and Computer, Shanghai, China, 22–24 June 2010. [Google Scholar]
  54. Abdullah, F.; Ward, R. Developing a General Extended Technology Acceptance Model for E-Learning (GETAMEL) by analysing commonly used external factors. Comput. Hum. Behav. 2016, 56, 238–256. [Google Scholar] [CrossRef]
  55. Hadley, G.; Grogan, M. Using repertory grids as a tool for mixed methods research: A critical assessment. J. Mix. Methods Res. 2023, 17, 209–227. [Google Scholar] [CrossRef]
  56. Armezzani, M.; Chiari, G. Ideas for a phenomenological interpretation and elaboration of personal construct theory. Part 1. Kelly between constructivism and phenomenology. Costruttivismi 2014, 1, 136–149. [Google Scholar]
  57. Feixas, G. Personal constructs in systemic practice. In Constructivism in Psychotherapy; American Psychological Association: Washington, DC, USA, 1995. [Google Scholar]
  58. Kelly, G.A. The Psychology of Personal Constructs: A Theory of Personality; Norton: New York, NY, USA, 1995. [Google Scholar]
  59. Danilova, S.S. The Theory of Personal Constructs J. Kelly. American Psychologist George Kelly (George Alexander Kelly): Biography. Personality Construct Theory George Kelly Biography. 2022. Available online: https://amikamoda.ru/en/teoriya-lichnostnyh-konstruktov-dzh-kelli-amerikanskii-psiholog.html (accessed on 28 September 2024).
  60. Samonas, S.; Dhillon, G.; Almusharraf, A. Stakeholder perceptions of information security policy: Analyzing personal constructs. Int. J. Inf. Manag. 2020, 50, 144–154. [Google Scholar] [CrossRef]
  61. Tan, F.B.; Hunter, M.G. The repertory grid technique: A method for the study of cognition in information systems. MIS Q. 2002, 26, 39–57. [Google Scholar] [CrossRef]
  62. Napier, N.P.; Keil, M.; Tan, F.B. IT project managers’ construction of successful project management practice: A repertory grid investigation. Inf. Syst. J. 2009, 19, 255–282. [Google Scholar] [CrossRef]
  63. Easterby-Smith, M. The design, analysis and interpretation of repertory grids. Int. J. Man-Mach. Stud. 1980, 13, 3–24. [Google Scholar] [CrossRef]
  64. Moon, K.; Blackman, D.A.; Adams, V.M.; Kool, J. Perception matrices: An adaptation of repertory grid technique. Land Use Policy 2017, 64, 451–460. [Google Scholar] [CrossRef]
  65. Gewers, F.L.; Ferreira, G.R.; Arruda, H.F.; de Silva, F.N.; Comin, C.H.; Amancio, D.R.; Costa, L.; Costa, L.D.F. Principal component analysis: A natural approach to data exploration. ACM Comput. Surv. 2021, 54, 1–34. [Google Scholar] [CrossRef]
  66. Alexander, P.; van Loggerenberg, J.; Lotriet, H.; Phahlamohlaka, J. The use of the repertory grid for collaboration and reflection in a research context. Group Decis. Negot. 2010, 19, 479–504. [Google Scholar] [CrossRef]
  67. Chang, Y.-H.; Chao, P.-C.; Fang, R.-J. ARCS and RGT Integrated High-Efficiency E-Books. Educ. Sci. 2019, 9, 94. [Google Scholar] [CrossRef]
  68. Rahman, R.; Bidoun, D.; Agiel, A.; Albdour, A. Advancing the use of the repertory grid technique in the built environment: A systematic review. Front. Built Environ. 2022, 8, 1082149. [Google Scholar] [CrossRef]
  69. Zuber-Skerritt, O. A repertory grid study of staff and students’ personal constructs of educational research. High. Educ. 1987, 16, 603–623. [Google Scholar] [CrossRef]
  70. Salloum, S.A.; Alshurideh, M.; Elnagar, A.; Shaalan, K. Mining in educational data: Review and future directions. In Proceedings of the International Conference on Artificial Intelligence and Computer Vision (AICV2020), Marrakesh, Morocco, 5–7 March 2020; pp. 92–102. [Google Scholar]
  71. Fromm, M. Introduction to the Repertory Grid Interview; Waxmann Verlag: München, Germany, 2004. [Google Scholar]
  72. Wright, R.P. Mapping cognitions to better understand attitudinal and behavioral responses in appraisal research. J. Organ. Behav. 2004, 25, 339–374. [Google Scholar] [CrossRef]
  73. Williams, S.R. Predications of the limit concept: An application of repertory grids. J. Res. Math. Educ. 2001, 32, 341–367. [Google Scholar] [CrossRef]
  74. Goffin, K.; Lemke, F.; Koners, U. Repertory grid technique. Essent. Ski. Manag. Res. 2002, 1, 199–225. [Google Scholar]
  75. Ginsberg, A. Construing The Business Portfolio: A Cognitive Model Of Diversification. J. Manag. Stud. 1989, 26, 417–438. [Google Scholar] [CrossRef]
  76. Zhang, X.; Chignell, M. Assessment of the effects of user characteristics on mental models of information retrieval systems. J. Am. Soc. Inf. Sci. Technol. 2001, 52, 445–459. [Google Scholar] [CrossRef]
  77. Bernard, T.; Flitman, A. Using repertory grid analysis to gather qualitative data for information systems research. In Proceeding of the Australasian Conference on Information Systems 2002, Melbourne, Australia, 3–6 December 2002; pp. 745–756. [Google Scholar]
  78. Hedman, J.; Tan, F.B.; Holst, J.; Kjeldsen, M. Taxonomy of payments: A repertory grid analysis. Int. J. Bank Mark. 2017, 35, 75–96. [Google Scholar] [CrossRef]
  79. Bourne, D.; Jankowicz, D.A. The repertory grid technique. Qualitative Methodologies in Organization Studies. Methods Possibilities 2018, 2, 127–149. [Google Scholar]
  80. Pervin, L.A. Definitions, measurements, and classifications of stimuli, situations, and environments. Hum. Ecol. 1978, 6, 71–105. [Google Scholar] [CrossRef]
  81. Hunter, M.G.; Beck, J.E. Using repertory grids to conduct cross-cultural information systems research. Inf. Syst. Res. 2000, 11, 93–101. [Google Scholar] [CrossRef]
  82. Marsden, D.; Littler, D. Exploring consumer product construct systems with the repertory grid technique. Qual. Mark. Res. Int. J. 2000, 3, 127–144. [Google Scholar] [CrossRef]
  83. Honey, P. The repertory grid in action: How to use it to conduct an attitude survey. Ind. Commer. Train. 1979, 11, 452–459. [Google Scholar] [CrossRef]
  84. Jankowicz, D. The Easy Guide to Repertory Grids; John Wiley Sons: Hoboken, NJ, USA, 2005. [Google Scholar]
  85. Gorman, B.S. Principal Components Analysis as an Alternative to Kendall’s Coefficient of Concordance, W1. Educ. Psychol. Meas. 1976, 36, 627–629. [Google Scholar] [CrossRef]
  86. Abdi, H.; Williams, L.J. Principal component analysis. Wiley Interdiscip. Rev. Comput. Stat. 2010, 2, 433–459. [Google Scholar] [CrossRef]
  87. Lever, J.; Krzywinski, M.; Altman, N. Points of significance: Principal component analysis. Nat. Methods 2017, 14, 641–643. [Google Scholar] [CrossRef]
  88. Bell, R.C. Analytic issues in the use of repertory grid technique. Adv. Pers. Constr. Psychol. 1990, 1, 25–48. [Google Scholar]
  89. Demir, F.; Bruce-Kotey, C.; Alenezi, F. User experience matters: Does one size fit all? Evaluation of learning management systems. Technol. Knowl. Learn. 2022, 27, 49–67. [Google Scholar] [CrossRef]
  90. Estrada-Molina, O.; Fuentes-Cancell, D.R.; Morales, A.A. The assessment of the usability of digital educational resources: An interdisciplinary analysis from two systematic reviews. Educ. Inf. Technol. 2022, 27, 4037–4063. [Google Scholar] [CrossRef]
  91. Gunesekera, A.I.; Bao, Y.; Kibelloh, M. The role of usability on e-learning user interactions and satisfaction: A literature review. J. Syst. Inf. Technol. 2019, 21, 368–394. [Google Scholar] [CrossRef]
  92. Ingavélez-Guerra, P.; Otón-Tortosa, S.; Hilera-González, J.; Sánchez-Gordón, M. The use of accessibility metadata in e-learning environments: A systematic literature review. Univers. Access Inf. Soc. 2023, 22, 445–461. [Google Scholar] [CrossRef]
  93. Jan, S.K.; Vlachopoulos, P. Social network analysis: A framework for identifying communities in higher education online learning. Technol. Knowl. Learn. 2019, 24, 621–639. [Google Scholar] [CrossRef]
  94. Alturki, U.; Aldraiweesh, A. Application of learning management system (Lms) during the COVID-19 pandemic: A sustainable acceptance model of the expansion technology approach. Sustainability 2021, 13, 10991. [Google Scholar] [CrossRef]
  95. Ellianawati, E.; Subali, B.; Khotimah, S.N.; Cholila, M.; Darmahastuti, H. Face to Face Mode vs. Online Mode: A Discrepancy in Analogy-Based Learning During COVID-19 Pandemic. J. Pendidik. IPA Indones. 2021, 10, 368–377. [Google Scholar] [CrossRef]
  96. Abu-Hashem, M.A.; Gutub, A.; Salem, O.; Shambour, M.K.; Shambour, Q.; Shehab, M.; Alrawashdeh, M.J. Discrepancies of remote techno-tolerance due to COVID-19 pandemic within Arab middle-east countries. J. Umm Al-Qura Univ. Eng. Archit. 2023, 14, 151–165. [Google Scholar] [CrossRef]
  97. Gligorea, I.; Cioca, M.; Oancea, R.; Gorski, A.T.; Gorski, H.; Tudorache, P. Adaptive learning using artificial intelligence in e-learning: A literature review. Educ. Sci. 2023, 13, 1216. [Google Scholar] [CrossRef]
  98. Halkiopoulos, C.; Gkintoni, E. Leveraging AI in e-learning: Personalized learning and adaptive assessment through cognitive neuropsychology—A systematic analysis. Electronics 2024, 13, 3762. [Google Scholar] [CrossRef]
Figure 1. The percentage of constructs that were ranked as high (H), medium (M), or low (L) for each group of constructs.
Figure 1. The percentage of constructs that were ranked as high (H), medium (M), or low (L) for each group of constructs.
Sustainability 16 10037 g001
Figure 2. Perception of participants.
Figure 2. Perception of participants.
Sustainability 16 10037 g002
Table 1. Constructs are grouped by usability and accessibility, functionality and diversity, or reliability and importance categories.
Table 1. Constructs are grouped by usability and accessibility, functionality and diversity, or reliability and importance categories.
Usability and AccessibilityFunctionality and DiversityReliability and Importance
Clear/organizedIncludes a variety of options/diverseCommonly used
Easy to access/easy to reachUnlimited functions/comprehensiveInformation provided is up-to-date
InteractiveHelpful and usefulReliable
Easy to useEnhance student learningReflect students’ performance
Attractive/user-friendly-Important
Facilitate the work-Available for a long time
Table 2. The highest-rated constructs for each group of constructs.
Table 2. The highest-rated constructs for each group of constructs.
GroupConstructs
Usability and AccessibilityFacilitate the work
Functionality and DiversityHelpful and useful
Enhance student learning
Reliability and ImportanceInformation provided is up-to-date
Table 3. The number of components under each label.
Table 3. The number of components under each label.
Labels# of Components
Accessibility and Usability16
Interactivity and Engagement18
Customization and Flexibility16
Data Analytics and Reporting12
Scalability and Integration8
Ambiguous2
Total72
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Almusharraf, A.I. An Investigation of University Students’ Perceptions of Learning Management Systems: Insights for Enhancing Usability and Engagement. Sustainability 2024, 16, 10037. https://doi.org/10.3390/su162210037

AMA Style

Almusharraf AI. An Investigation of University Students’ Perceptions of Learning Management Systems: Insights for Enhancing Usability and Engagement. Sustainability. 2024; 16(22):10037. https://doi.org/10.3390/su162210037

Chicago/Turabian Style

Almusharraf, Ahlam I. 2024. "An Investigation of University Students’ Perceptions of Learning Management Systems: Insights for Enhancing Usability and Engagement" Sustainability 16, no. 22: 10037. https://doi.org/10.3390/su162210037

APA Style

Almusharraf, A. I. (2024). An Investigation of University Students’ Perceptions of Learning Management Systems: Insights for Enhancing Usability and Engagement. Sustainability, 16(22), 10037. https://doi.org/10.3390/su162210037

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop