Feasibility of Crowd-Aware AR Indoor Navigation Using YOLOv8

Evianita Dewi Fajrianti; Amma Liesvarastranta Haz; Aris Kurniawan; Andharu Raffi; Hadi Muhammad Hafiiz Hilmi; Saniyatul Mawaddah; Nirwana Haidar Hari

doi:10.59976/jurit.v4i3.402

Authors

Evianita Dewi Fajrianti Politeknik Elektronika Negeri Surabaya
Amma Liesvarastranta Haz Politeknik Elektronika Negeri Surabaya
Aris Kurniawan Politeknik Elektronika Negeri Surabaya
Andharu Raffi Politeknik Elektronika Negeri Surabaya
Hadi Muhammad Hafiiz Hilmi Politeknik Elektronika Negeri Surabaya
Saniyatul Mawaddah Politeknik Elektronika Negeri Surabaya
Nirwana Haidar Hari Politeknik Elektronika Negeri Surabaya

DOI:

https://doi.org/10.59976/jurit.v4i3.402

Keywords:

AR Indoor Navigation, Dynamic Routing, Crowd-Level Monitoring, YoloV8s, NavMesh

Abstract

Augmented reality (AR) indoor navigation provides visual guidance, while crowd-responsive route selection requires current crowd information to be connected to route planning. This study evaluates the integration of camera-based crowd monitoring with AR route adaptation and measures its response time on local infrastructure. The proposed system uses YOLOv8s to detect people, classifies crowd levels from person counts, and uses Unity NavMesh to compute alternative routes displayed through AR on a smartphone. The integration extends static routing by using crowd levels estimated from camera feeds to temporarily exclude highly crowded passages from route planning and update the displayed AR route when an alternative path is available. Evaluation covered detection, crowd-level classification, rerouting, response time, and a static–dynamic routing comparison. Detection mAP@0.5 was 91.92%, and crowd-level classification accuracy was 90.67% across 75 observations. Rerouting succeeded in all 30 controlled events, with an average response time of 2.772 s from the first classification of a zone as highly crowded to the display of the updated AR route. The suitability of this response time for hospital navigation requires further evaluation. In 30 paired trials, dynamic routing avoided the designated crowded zones but increased mean path length and navigation time in all three zones. Testing was limited to one hospital floor with three monitored zones. User comfort, accessibility, and performance in larger buildings require further evaluation.

References

W. C. S. S. Simões, G. S. Machado, A. M. A. Sales, M. M. de Lucena, N. Jazdi, and V. F. de Lucena, “A Review of Technologies and Techniques for Indoor Navigation Systems for the Visually Impaired,” Sensors, vol. 20, no. 14, 2020, doi: 10.3390/s20143935.

H. Liu, H. Darabi, P. Banerjee, and J. Liu, “Survey of Wireless Indoor Positioning Techniques and Systems,” IEEE Transactions on Systems Man and Cybernetics Part C (Applications and Reviews), vol. 37, no. 6, pp. 1067–1080, Nov. 2007, doi: 10.1109/TSMCC.2007.905750.

J. Drewlow, M. Dappen, and M. Lehmann, “Navigation with Augmented Reality in a Hospital,” Stud. Health Technol. Inform., vol. 292, pp. 111–114, 2022, doi: 10.3233/SHTI220335.

B. C. Huang, J. Hsu, E. T. H. Chu, and H. M. Wu, “ARBIN: Augmented Reality Based Indoor Navigation System,” Sensors 2020, Vol. 20, vol. 20, no. 20, pp. 1–20, Oct. 2020, doi: 10.3390/S20205890.

H. Iftikhar, P. Shah, and Y. Luximon, “Human wayfinding behaviour and metrics in complex environments: a systematic literature review,” Archit. Sci. Rev., vol. 64, no. 5, pp. 452–463, Sep. 2021, doi: 10.1080/00038628.2020.1777386.

E. D. Fajrianti, A. L. Haz, Y. A. Sari, S. Sukaridhoto, Z. M. Achmad, and R. P. N. Budiarti, “Comparative Analysis of Automated Cloud-Based Mapping and Manual 3D Modeling for AR-Based Indoor Navigation,” Journal of Imaging 2026, Vol. 12, Page 452, vol. 12, no. 9, p. 452, Sep. 2026, doi: 10.3390/JIMAGING12090452.

B. Rokesh Maran, L. Giridharan, and R. Krishnaveni, “Augmented Reality-based Indoor Navigation using Unity Engine,” in 2023 International Conference on Sustainable Computing and Smart Systems (ICSCSS), 2023, pp. 1696–1700. doi: 10.1109/ICSCSS57650.2023.10169855.

Z. Qiu, A. Mostafavi, and S. Kalantari, “Use of augmented reality in human wayfinding: a systematic review,” Virtual Reality 2025 29:4, vol. 29, no. 4, pp. 154-, Sep. 2025, doi: 10.1007/S10055-025-01226-W.

G. Parnass, O. Levtzion-Korach, R. Peres, and M. Assaf, “Estimating emergency department crowding with stochastic population models,” PLoS One, vol. 18, no. 12, p. e0295130, Dec. 2023, doi: 10.1371/JOURNAL.PONE.0295130.

E. D. Fajrianti, A. L. Haz, N. Funabiki, and S. Sukaridhoto, “A Cross-Platform Implementation of Indoor Navigation System Using Unity and Smartphone INSUS,” in 2023 Sixth International Conference on Vocational Education and Electrical Engineering (ICVEE), 2023, pp. 249–254. doi: 10.1109/ICVEE59738.2023.10348217.

E. D. Fajrianti et al., “INSUS: Indoor Navigation System Using Unity and Smartphone for User Ambulation Assistance,” Information, vol. 14, no. 7, 2023, doi: 10.3390/info14070359.

E. D. Fajrianti, Y. Y. F. Panduman, N. Funabiki, A. L. Haz, K. C. Brata, and S. Sukaridhoto, “A User Location Reset Method through Object Recognition in Indoor Navigation System Using Unity and a Smartphone (INSUS),” Network 2024, Vol. 4, Pages 295-312, vol. 4, no. 3, pp. 295–312, Jul. 2024, doi: 10.3390/NETWORK4030014.

E. D. Fajrianti, N. Funabiki, A. L. Haz, and S. Sukaridhoto, “A Proposal of OCR-based User Positioning Method in Indoor Navigation System Using Unity and Smartphone (INSUS),” in Proceedings of the 2023 12th International Conference on Networks, Communication and Computing, in ICNCC ’23. New York, NY, USA: Association for Computing Machinery, 2024, pp. 99–105. doi: 10.1145/3638837.3638852.

Z. Zhang, H. Liu, Z. Jiao, Y. Zhu, and S.-C. Zhu, “Congestion-aware Evacuation Routing using Augmented Reality Devices,” in ICRA, 2020.

A. Elaoua, M. Nadour, L. Cherroun, and A. Elasri, “Real-Time People Counting System using YOLOv8 Object Detection,” in 2023 2nd International Conference on Electronics, Energy and Measurement (IC2EM), 2023, pp. 1–5. doi: 10.1109/IC2EM59347.2023.10419684.

A. Cortesi et al., “Integration of Deep Learning into the IoT: A Survey of Techniques and Challenges for Real-World Applications,” Electronics 2023, Vol. 12, Page 4925, vol. 12, no. 24, p. 4925, Dec. 2023, doi: 10.3390/ELECTRONICS12244925.

Unity Technology, “Unity - Manual: NavMesh Obstacle.” Accessed: Jul. 13, 2026. [Online]. Available: https://docs.unity3d.com/530/Documentation/Manual/class-NavMeshObstacle.html

G. Jocher, A. Chaurasia, and J. Qiu, “Ultralytics YOLOv8,” 2023. [Online]. Available: https://github.com/ultralytics/ultralytics