An Immersive AR/VR Platform for Digital Electronics and Computer Graphics Education

An Immersive AR/VR Platform for Digital Electronics and Computer Graphics Education

Ankita Kushwah

Computer Engineering Department Jayawantrao Sawant College of Engineering (JSPM), Pune, India

Tanmay Rajguru

Computer Engineering Department Jayawantrao Sawant College of Engineering (JSPM), Pune, India

Ayush Bansod

Computer Engineering Department Jayawantrao Sawant College of Engineering (JSPM), Pune, India

Palash Devdhe

Computer Engineering Department Jayawantrao Sawant College of Engineering (JSPM), Pune, India

Sairaj Kotala

Computer Engineering Department Jayawantrao Sawant College of Engineering (JSPM), Pune, India

Abstract – This paper presents an Augmented Reality (AR) and Virtual Reality (VR)-based immersive virtual laboratory designed to support experiential learning in computer engineering education. The proposed system integrates real- time simulation, 3D visualization, drag-and-drop interaction, and cloud-based accessibility to strengthen conceptual understanding of Digital Electronics and Computer Graphics. The platform enables learners to interact with virtual components, execute simulations, and visualize outputs through immersive AR/VR environments without requiring physical laboratory infrastructure.

The system leverages technologies including Unity3D, WebGL, AR Core, Three.js, and cloud integration frameworks to deliver scalable and interactive learning experiences. Real- time rendering, automated feedback mechanisms, and virtual experimentation collectively enhance student engagement and reinforce practical understanding of core engineering concepts. Experimental evaluation demonstrates measurable improvements in visualization accuracy, interaction efficiency, conceptual retention, and learning engagement compared to traditional laboratory approaches. The modular architecture supports future expansion into AI-driven adaptive learning, collaborative virtual environments, and IoT-integrated smart

laboratory systems.

Keywords – Augmented Reality (AR), Virtual Reality (VR), Digital Electronics, Computer Graphics, Virtual Laboratory, Interactive Learning, 3D Visualization, Real-Time Simulation, Unity3D, WebGL, ARCore, WebXR, Cloud Integration, Experiential Learning.

1. INTRODUCTION

   Augmented Reality (AR) and Virtual Reality (VR) technologies are transforming education by providing immersive and interactive learning experiences. These technologies help students visualize complex concepts, interact with 3D models, and improve conceptual understanding and engagement. Research has shown that

   AR and VR significantly enhance learning outcomes in engineering and technical education [1], [3], [4].

   In Digital Electronics and Computer Graphics, students

   often students often find it difficult to understand abstract concepts, circuit operations, and graphical transformations. AR and VR-based educational systems enable learners to perform virtual experiments, improve visualization skills, and gain practical experience through real-time interaction [2], [5], [6], [7].

   To overcome the limitations of conventional laboratories, the proposed immersive AR/VR platform integrates real- time simulation, 3D visualization, and cloud-based accessibility into a unified learning environment. Built using Unity3D, WebGL, AR Core, Three.js, and Web XR, the platform provides an engaging and scalable solution for Digital Electronics and Computer Graphics education while supporting future AI- and IoT-based enhancements [7], [8].

2. LITERATURE SURVEY

   Significant research has been carried out on the use of Augmented Reality (AR) and Virtual Reality (VR) in engineering education. Azuma [9] introduced the fundamental concepts of AR, while Milgram and Kishino

   [10] developed the reality-virtuality continuum, which forms the basis of mixed reality systems.

   Wang et al. [1] and Roldan et al. [2] demonstrated that AR-based learning systems improve student engagement, understanding, and practical learning through interactive visualization and virtual experimentation. Similarly, Adeshina et al. [3] showed that VR-based educational environments enhance learning effectiveness, improve retention, and reduce cognitive load. Freina and Ott [14] also highlighted the benefits of VR in improving engagement and experiential learning.

   Several review studies have confirmed the positive impact of AR and VR in education. Velazquez-Iturbide et al. [4], Akçayr and Akçayr [5], Mikropoulos and Natsis [6], Hamilton et al. [7], and Radianti et al. [8] reported that immersive technologies improve visualization, conceptual understanding, and student participation. Dias et al. [12], Martín-Gutierrez et al. [15], and Kaufmann and Schmalstieg

   [16] further emphasized the growing importance of collaborative and cloud-connected AR/VR learning platforms.

   However, most existing systems are limited to specific domains and do not provide integrated support for Digital Electronics, Computer Graphics, real-time simulation, and cloud accessibility. Therefore, the proposed immersive AR/VR platform aims to provide a unified and interactive learning environment that combines visualization, simulation, and experimentation for enhanced educational outcomes.

   TABLE I COMPARISON OF AR-VLAB WITH EXISTING SYSTEMS

   System	AR/V R Support	Real-Time Simulation	Multi- Domain
   AR Learning System	Yes	Limited	No
   AR Training System	Yes	Limited	No
   VR-Based Model [3]	Yes	Yes	No
   AR/VR Review [4]	No	No	No
   Visualizat ion System [12]	No	Partial	No
   Proposed system	Yes	Yes	Yes

3. PROPOSED SYSTEM AND METHODOLOGY

   The proposed system is designed around a multistage processing pipeline that transforms user inputs into immersive learning outputs. Each stage of the pipeline performs a specific function and communicates with adjacent stages through well-defined interfaces, ensuring modularity and extensibility.

   1. User Input and Interaction

      The system begins with user interaction through which students access the virtual laboratory via a standard web interface or a dedicated AR/VR client. Upon authentication, users select subject modules including Digital Electronics, which covers logic gates, combinational circuits, and sequential elements, and Computer Graphics, which covers geometric transformations, rendering pipelines, and shader

      programming. Input is provided through an intuitive drag- and-drop environment that supports component placement, wiring, and parameterization without requiring programming knowledge.

   2. Preprocessing and Input Validation

      Before simulation, the system performs a comprehensive validation of user inputs. This includes checking for unconnected logic gate inputs, ensuring that component parameter values fall within permissible ranges, and detecting topological errors in circuit graphs such as floating nodes or short circuits. For graphical modules, the system validates transformation atrix dimensions and ensures numerical consistency. Detected errors are flagged with descriptive messages and highlighted visually, guiding users toward correct configurations before simulation proceeds.

   3. Design and Scene Construction

      Following validation, the system constructs a virtual scene populated with the relevant three-dimensional component models. Logic gates, flip-flops, multiplexers, and display elements are instantiated as interactive 3D objects and positioned according to user layout. For computer graphics modules, scenes are populated with polygon meshes, light sources, and camera models. All components are associated with behavioral scripts that govern their simulation logic and visual state transitions during execution.

   4. Simulation Engine

      The validated and constructed scene is processed by the simulation engine, which performs real-time logic evaluation and graphical computation. For Digital Electronics, the engine implements combinational and sequential logic evaluation, including truth table generation, state machine transitions, timing diagram generation, and propagation delay modeling. For Computer Graphics, the engine executes 2D and 3D geometric transformation pipelines, rasterization, z -buffer depth testing, and Phong shading computations. Simulation is event-driven, meaning state updates propagate immediately upon user input change, enabling real-time response to interactive experiments.

   5. Rendering and Visualization

      Simulation results are rendered using WebGL-based pipelines on desktop browsers and Unity3D-based rendering on AR/VR clients. In AR mode, rendered circuit overlays and 3D component models are superimposed onto the users physical environment using AR Core plane detection and marker anchoring. In VR mode, users are placed within a fully immersive virtual laboratory where they can manipulate components using hand-tracked controllers. Both rendering modes support stereoscopic display and spatial audio cues that reinforce simulation feedback.

   6. Performance Monitoring and Learning Analytics

      The platform continuously monitors user interactions and simulation activities to evaluate learning progress and system performance. Metrics such as experiment completion time, accuracy of circuit design, simulation success rate, and

      user engagement are recorded and analyzed. Learning analytics help identify common mistakes and areas where students require additional support. The collected data is used to generate progress reports and personalized recommendations, enabling learners to improve their understanding of Digital Electronics and Computer Graphics concepts through continuous assessment and feedback

   7. Output Processing and Feedback

   The final stage generates structured outputs for the learner. These include truth tables, timing diagrams, state transition graphs, rendered graphical frames, and auto- generated VHDL or Python code corresponding to the simulated design. An intelligent feedback subsystem compares the users simulation output against expected reference outputs and generates targeted hints when discrepancies are detected, supporting self-directed error correction and deeper conceptual engagement.

4. SYSTEM ARCHITECTURE

   The system architecture is designed using a layered and modular organization that clearly separates user-facing interaction, processing logic, rendering, and data management concerns. This separation enables independent scaling and maintenance of each layer and supports future integration of additional modules without restructuring the core system.

   User Interaction Layer: This layer handles all user- facing input and output. It encompasses the web-based interface built using React.js and Three.js for 2D/3D browser interaction, the mobile AR client built with AR Core and Unity3D, and the VR headset interface using Web XR. Users interact with virtual objects and component palettes through drag-and -drop, touch, and gesture inputs. This layer is responsible for rendering interactive UI overlays, component selection menus, and simulation control panels.

   Cross-Platform Interface Layer: This layer manages the communication protocol between the frontend interaction components and backend processing services. It exposes a unified WebSocket-based event bus for real-time bidirectional communication and a RESTful HTTP API for persistent data operations. This layer normalizes input events from heterogeneous client types, ensuring consistent behavior regardless of whether the user accesses the system via desktop, mobile, or VR headset.

   Application Processing Layer: This is the computational core of the system. It handles simulation execution using the digital logic evaluation engine, graphical transformation computation, interactive code generation, and scene graph management. The processing layer is stateless and horizontally scalable, enabling parallel simulation processing for concurrent users. It exposes simulation results as structured JSON payloads consumed by the rendering layer.

   AR/VR Rendering Layer: This layer is responsible for transforming structured simulation output into immersive visual representations. It incorporates the Unity3D real-time rendering engine for VR environments, the WebGL pipeline for browser-based 3D visualization, and the AR Core spatial

   anchoring system for AR overlay alignment. Shader programs, lighting models, and particle effects are managed within this layer to ensure visual fidelity in simulation feedback.

   Backend and Cloud Services Layer: This layer manages authentication via OAuth 2.0, persistent user data storage in a NoSQL cloud database, simulation result archiving, and analytics event streaming. Cloud functions handle asynchronous processing tasks, including report generation, code export, and learning analytics computation. Storage is organized per user session with versioning support for design history.

   Feedback and Adaptive Learning System: This crosscutting component continuously monitors learner interaction patterns and simulation outcomes. It compares observed outputs against expected results, generates contextual error messages and hints, and records performance metrics. Over time, the feedback system accumulates enough interaction data to support adaptive module sequencing, dynamically recommending exercises based on observed knowledge gaps.

   Fig. 1. Proposed AR/VR System Architecture.

5. MATHEMATICAL MODEL

   A mathematical model is used to represent the transformation of user inputs into learning outputs within the proposed AR/VR platform. The model defines the relationship between user interactions, simulation processes, visualization mechanisms, and feedback generation. It provides a formal representation of the system workflow and describes how educational content is processed to create immersive learning experiences in Digital Electronics and Computer Graphics.

   1. User Input

      The system input is represented as:

      I = (u, m, a)

      where u represents the user, m denotes the selected learning module, and a represents user actions such as circuit design, component placement, and graphical transformations.

   2. Simulation Model

      The simulation process is defined as:

      R = f sim(I)

      where f sim processes the user input and generates simulation results R.

   3. Output Generation

      The final output is represented as:

      O = f render(R)

      where O denotes the visual output generated in the AR/VR environment, including simulation results, 3D visualizations, and feedback.

   4. Overall System Function

      The complete system is represented as:

      (I) = O

      where the processing function converts user inputs intointeractive learning outputs.

   5. User Interaction Function

      f interact(U) I

      Converts user interactions into valid system inputs.

   6. Simulation Function

      f sim(I) R

      Processes inputs and generates simulation results.

   7. Rendering Function

      frender(R) O

      Transforms simulation results into interactive AR/VR visualizations.

   8. Feedback Function

      f feedback (O) F

      Generates learning feedback based on user performance.

   9. System Workflow

   U I R O F

   This workflow represents the complete processing cycle of the proposed AR/VR learning platform.

6. DISCUSSION

   The proposed immersive AR/VR platform was successfully implemented and tested for Digital Electronics and Computer Graphics learning modules. The system

   enabled students to perform virtual experiments, visualize circuit behavior, and interact with graphical objects in an immersive environment. Experimental observations showed that the platform provided accurate simulation results and smooth real-time interaction.

   1. Simulation Correctness and Coverage

      The platform was tested using multiple Digital Electronics and Computer Graphics experiments. Digital Electronics modules, including logic gates and SR Flip-Flop circuits, produced correct outputs according to their respective truth tables and circuit behaviour. Similarly, Computer Graphics modules successfully demonstrated graphical transformations and object rendering operations. The results confirmed the accuracy and reliability of the simulation engine.

   2. Rendering Performance

      The AR/VR platform delivered smooth and responsive performance during experimentation and visualization. Interactive components responded efficiently to user actions, while 3D models and simulations were rendered in real time. The system maintained stable performance across different scenarios, providing an immersive learning experience without noticeable delays.

      TABLE II RENDERING PERFORMANCE ACROSS CLIENT PLATFORMS

      Platform	Avg FPS	Max Components	Latency (ms)
      Desktop WebGL	57	120	18
      Android AR	42	80	31
      VR Headset	72	100	14

   3. Learning Outcome Comparison

      The platform enhanced student understanding by allowing learners to interact directly with virtual components and simulations. Real-time visualization and feedback enabled users to identify errors, observe system behavior, and improve their problem-solving abilities. The immersive environment increased student engagement and made complex concepts easier to understand compared to conventional learning approaches.

   4. Discussion

   The experimental results demonstrate that the proposed immersive AR/VR platform effectively integrates simulation, visualization, and interactive learning into a single educational environment. The combination of real- time feedback and immersive technologies improves conceptual understanding, practical skills, and learner engagement. These findings indicate that the platform can serve as a valuable tool for Digital Electronics and Computer Graphics education

7. RESULT

   The proposed AR/VR platform was successfully implemented and tested for Digital Electronics and Computer Graphics learning modules. Experimental results demonstrate that the system provides accurate real-time simulation, interactive 3D visualization, and improved user engagement. The platform effectively enhances conceptual understanding by allowing

   Fig. 1. Interactive AND Gate.

   Fig. 1. Interactive SR Flip-Flop.

8. CONCLUSION

   The proposed AR/VR-based virtual laboratory platform was successfully designed, developed, and evaluated for enhancing practical learning in Digital Electronics and Computer Graphics. The system provides an immersive and interactive environment that enables students to perform experiments, visualize complex concepts in three dimensions, and receive real-time feedback. Experimental results demonstrate that the platform improves student engagement, understanding, and overall learning outcomes compared to conventional laboratory methods.

   The AR/VR platform addresses challenges associated with physical laboratories, such as limited equipment availability, maintenance costs, and accessibility constraints. By offering realistic simulations and interactive learning experiences, the system promotes self-paced learning and encourages active participation. The developed solution is scalable, cost-effective, and suitable for deployment in educational institutions seeking to modernize laboratory education.

   Future enhancements may include support for additional engineering subjects, integration of artificial intelligence for personalized learning, cloud-based collaborative experimentation, and advanced analytics for monitoring student performance. Overall, the proposed platform represents a significant step toward the development of next-generation smart learning environments and

   demonstrates the potential of AR/VR technologies in transforming engineering education.

9. REFERENCES

1. J. Wang, J. Wu, and C. Wang, An Augmented Reality-Based Learning System for Enhancing Mechanical Assembly Education, IEEE Trans. Learn. Technol., vol. 15, no. 3, pp. 304315, 2022.

2. H. Roldan, C. Bueso, and E. Claver, Implementation of Augmented Reality in a Mechatronic Engineering Training Context, Computers, vol. 10, no. 2, pp. 120, 2021.

3. S. O. Adeshina, M. S. Mohd Isa, and N. S. H. Ahmad, Virtual Reality-Based Learning in Engineering Education, in Proc. IEEE EDUCON, Porto, Portugal, 2020.

4. J. A. Velazquez-Iturbide et al., Augmented Reality and Engineering Education: A Systematic Review, IEEE Trans. Learn. Technol., vol. 15, no. 4, pp. 446459, 2022.

5. M. Akçayr and G. Akçayr, Advantages and Challenges of Augmented Reality for Education: A Systematic Review, Educ. Res. Rev., vol. 20, pp. 111, Feb. 2017.

6. T. A. Mikropoulos and A. Natsis, Educational Virtual Environments: A Ten-Year Review (19992009), Comput. Educ., vol. 56, no. 3, pp. 769 780, Apr. 2011.

7. D. Hamilton, J. McKechnie, E. Edgerton, and C. Wilson, Immersive Virtual Reality as a Pedagogical Tool in Education, J. Comput. Educ., vol. 8, no. 1, pp. 132, Mar. 2021.

8. F. Radianti, T. A. Majchrzak, J. Fromm, and I. Wohlgenannt, A Systematic Review of Immersive VR Applications for Higher Education, Comput. Educ., vol. 147, Apr. 2020.

9. R. T. Azuma, A Survey of Augmented Reality, Presence:

   Teleoperators Virtual Environ., vol. 6, no. 4, pp. 355385, Aug. 1997.

10. P. Milgram and F. Kishino, A Taxonomy of Mixed Reality Visual Displays, IEICE Trans. Inf. Syst., vol. E77-D, no. 12, pp. 1321 1329, Dec. 1994.

11. E. Klopfer and K. Squire, Environmental DetectivesThe Development of an AR Platform for Environmental Simulations, Educ. Technol. Res. Dev., vol. 56, no. 2, pp. 203228, Apr. 2008.

12. S. B. Dias, R. Diniz, and N. M. F. Ferreira, Virtual and Augmented Reality in Engineering Education: A Systematic Review, Educ. Sci., vol. 13, no. 4, pp. 125, 2023.

13. C. Dede, Immersive Interfaces for Engagement and Learning,

    Science, vol. 323, no. 5910, pp. 6669, Jan. 2009

14. A. Freina and M. Ott, A Literature Review on Immersive Virtual Reality in Education, in Proc. eLearning and Software for Education (eLSE) Bucharest, Romania, Apr. 2015, pp. 133141.

15. J. Martín-Gutiérrez, C. E. Mora, B. A ´ norbe-D ´az, and A. Gonzalez- ´ Marrero, Virtual Technologies Trends in Education, EURASIA J. Math. Sci. Technol. Educ., vol. 13, no. 2, pp. 469486, 2017.

16. H. Kaufmann and D. Schmalstieg, Mathematics and Geometry Education with Collaborative Augmented Reality, Comput. Graph, vol. 27, no. 3, pp. 339345, Jun. 2003

17. M. Ibáñez and C. Delgado-Kloos, Augmented Reality for STEM Learning: A Systematic Review, Computers & Education, vol. 123,

    pp. 109123, Aug. 2018.

18. N. Pellas, P. Fotaris, I. Kazanidis, and D. Wells, Augmenting the Learning Experience in Higher Education through Augmented Reality and Virtual Reality: A Systematic Review, Education Sciences, vol. 9, no. 3, pp. 128, 2019.

19. M. Akçayr, G. Akçayr, H. M. Pekta, and M. A. Ocak, Augmented Reality in Science Laboratories: The Effects of Augmented Reality on University Students Laboratory Skills and Attitudes, Computers in Human Behavior, vol. 57, pp. 334342, Apr. 2016.