Agnostic Extended Reality Development Strategies and Policies: A Systematic Literature Review
DOI:
https://doi.org/10.5281/zenodo.17259575Keywords:
PRISMA systematic review, XR development strategy and policy framework, XR literature sources, Title-focused Boolean search, Co-occurrence phrase searchAbstract
This work performed two PRISMA studies on literature from four academic databases, two search platforms, ten non-indexed journals, and eight XR websites from March to May 2023. The first study used a title-focused Boolean keyword search. The second study used a co-occurrence phrase search. The keywords and phrases relate to finding literature containing an XR development strategy or policy. The exclusion criteria involved non-English records, publications before 2019, and titles omitting search keywords or literature without co-occurrence phrases. The studies produced one eligible record. It is the authors’ 2023 publication of an agnostic XR development reference strategy used for the research questions, inclusion and exclusion criteria, and codebook. This research creates a systematic exclusion structure that researchers and stakeholders can adopt to identify potential XR development strategies or policies. The quantified breakdown of excluded and included literature from various sources and search strategies can guide future research work. This paper addresses the challenges of finding suitable literature and recommends removing data limitations, increasing literature sources, utilising non-academic search engines and AI LLMs, and implementing real-time alerts for new publications. The single eligible record highlights the research gap. It justifies the research focus on stakeholders' opinions and perspectives. The study identifies existing XR development literature with the potential to contribute to a partial strategy. It emphasises the need for more publications on clearly defined agnostic XR development strategies and policies. This paper demonstrates the value of reporting and publishing PRISMA studies that contain one or fewer records in the inclusion dataset.
Downloads
References
Alsanea, Z. and Alawaidi, A. (2021). The reality of social studies teachers awareness regarding the notion of augmented reality technology and the strategy of its usage in teaching to develop geographical phenomena from the social studies teachers perspectives. Journal of Educational and Psychological Sciences, 5(41):57–39.
Barteit, S., Lanfermann, L., Bärnighausen, T., Neuhann, F., and Beiersmann, C. (2021). Augmented, mixed, and virtual reality-based head-mounted devices for medical education. Systematic Review. JMIR Serious Games, 9(3):29080.
Créquit, P., Trinquart, L., Yavchitz, A., and Ravaud, P. (2016). Wasted research when systematic reviews fail to provide a complete and up-to-date evidence synthesis: The example of lung cancer. BMC Medicine, 14(1):1–15.
de Winter, J., Zadpoor, A., and Dodou, D. (2013). The expansion of google scholar versus web of science: a longitudinal study. Scientometrics, 98(2):1547–1565.
Diaba-Nuhoho, P. and Amponsah-Offeh, M. (2021). Reproducibility and research integrity: the role of scientists and institutions. BMC Research Notes, 14(1):451.
Elliott, J., Turner, T., Clavisi, O., Thomas, J., Higgins, J., Mavergames, C., and Gruen, R. (2014). Living systematic reviews: An emerging opportunity to narrow the evidence-practice gap. PLoS Medicine, 11(2):1001603
EON Reality (2023). Eon reality. https://eonreality .com/. Retrieved May 24, 2023.
EuroXR Association (2023). Euroxr. https://www.euro xr-association.org/. Retrieved January 13, 2023.
Ghobakhloo, M., Iranmanesh, M., Morales, M., Nilashi, M., and Amran, A. (2023). Actions and approaches for enabling industry 5.0-driven sustainable industrial transformation: A strategy roadmap. Corporate Social Responsibility and Environmental Management, 30(3):1473–1494.
Giustini, D. and Kamel Boulos, M. (2013). Google scholar is not enough to be used alone for systematic reviews. Online Journal of Public Health Informatics, 5(2):214.
Gray, R. (2021). Empty systematic reviews: Identifying gaps in knowledge or a waste of time and effort? Nurse Author & Editor, 31(2):42–44.
Gusenbauer, M. (2019). Google scholar to overshadow them all? comparing the sizes of 12 academic search engines and bibliographic databases. Scientometrics, 118(1):177–214.
Haddaway, N., Collins, A., Coughlin, D., and Kirk, S. (2015). The role of google scholar in evidence reviews and its applicability to grey literature searching. PLoS ONE, 10(9).
Haddaway, N., Page, M., Pritchard, C., and McGuinness, L. (2022). Prisma2020: An r package and shiny app for producing prisma 2020-compliant flow diagrams, with interactivity for optimised digital transparency and open synthesis. Campbell Systematic Reviews, 18(2):1230.
Hizam-Hanafiah, M., Soomro, M., and Abdullah, N. (2020). Industry 4.0 readiness models: A systematic literature review of model dimensions. Information, 11(7):364.
IDB Lab (2022). Metaverse communities challenge. https: //convocatorias.iadb.org/en/bid- lab/met averse-communities.
IJSIM (2023). https://revistas.ulusofona.pt/in dex.php/stereo/about. Retrieved January 30, 2023.
IJVR (2023). https://ijvr.eu/about. Retrieved January 10, 2023.
Ikhsan, M., Guntur, S., Setyaningrum, W., Retnawati, H., Marsigit, M., Saragih, N., and Kahir Bin Noordin, M. (2019). Developing augmented reality in mathematics learning: The challenges and strategies. Jurnal Riset Pendidikan Matematika, 6(2):211–221.
Iqbal, S., Wallach, J., Khoury, M., Schully, S., and Ioannidis, J. (2016). Reproducible research practices and transparency across the biomedical literature. PLOS Biology, 14(1):1002333.
ISVR (2023). https://fatcat.wiki/container/e2 adeuzd2zcotj2f6hxoab5wfq. Retrieved January 1, 2023.
IVRPA (2023). International virtual reality professionals association. https://ivrpa.org/. Retrieved January 13, 2023.
JIMCA (2023). https://jimca.org/index.php/1/ about. n.d.). Retrieved January 30, 2023.
JJMVR (2023). https://www.jstage.jst.go.jp /browse/jmvr/_pubinfo/-char/en. Retrieved January 10, 2023.
JSMVR (2023). https://www.jstage.jst.go.jp /browse/jsmvr/_pubinfo/-char/en. Retrieved January 10, 2023.
JVRSJ (2023). https://www.jstage.jst.go.jp/bro wse/jvrsj/_pubinfo/-char/en. n.d.). Retrieved January 10, 2023.
Kiani, S., Rezaei, I., Abasi, S., Zakerabasali, S., and Yazdani, A. (2023). Technical aspects of virtual augmented reality-based rehabilitation systems for musculoskeletal disorders of the lower limbs: a systematic review. BMC Musculoskeletal Disorders, 24(1):4.
Lee, E.-T. and Im, S. (2022). A development study of instructional design strategies for metaverse based on goal-directed design methodology. Korean Association for Educational Information and Media, 28(4):983–1010.
Liao, Y., Deschamps, F., Loures, E. F., and Ramos, L. (2017). Past, present and future of industry 4.0 a systematic literature review and research agenda proposal. International Journal of Production Research, 55(12):3609–3629.
Liu, H. (2022). Building the “complete game”: An overview study of a development strategy for geo ar mobile games. In Lecture Notes in Computer Science (Including Subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), 13517 LNCS, page 604–622. Springer, Cham.
Loutoo, J. (2021). Uwi secures us$25 million technology grant. Trinidad and Tobago Newsday.
Matthews, B., See, Z., and Day, J. (2021). Crisis and extended realities: remote presence in the time of covid19. Media International Australia, 178(1):198–209.
McGuirt, J., Cooke, N., Burgermaster, M., Enahora, B., Huebner, G., Meng, Y., Tripicchio, G., Dyson, O., Stage, V., and Wong, S. (2020). Extended reality technologies in nutrition education and behavior. Comprehensive Scoping Review and Future Directions. Nutrients, 12(9):2899.
Meta (2023). Meta. https://www.meta.com/. Retrieved May 24, 2023.
Metaverse (2023). https://aber.apacsci.com/ind ex.php/met/index. Retrieved January 10, 2023.
Moher, D., Shamseer, L., Clarke, M., Ghersi, D., Liberati, A., Petticrew, M., Shekelle, P., and Stewart, L. (2015). Preferred reporting items for systematic review and meta-analysis protocols (prisma-p) 2015 statement. Systematic Reviews, 4(1):1.
Montgomery, P. (2017). How empty are empty reviews? https://www.birmingham.ac.uk/schools/soc ial-policy/departments/social-policy-soc iology-criminology/research/projects/201 7/Empty-reviews.aspx. Retrieved April 27, 2023.
Mustapha, I., Ali, M., Khan, N., and Sikandar, H. (2023). The impact of industry 4.0 on innovative organisations, a thematic review using the prisma statement 2020. International Journal of Interactive Mobile Technologies (IJIM, 17(09):88–105.
Naseem, M. and Yang, J. (2021). Role of industry 4.0 in supply chains sustainability: A systematic literature review. Sustainability, 13(17):9544.
Nassereddine, H. (2019). Design, development and validation of an augmented reality-enabled production strategy process for the construction industry. https: //www.proquest.com/central/docview/22316 30646/fulltextPDF/EA7029A0B6F14E94PQ/1?a ccountid=45039.
Nassereddine, H., Veeramani, D., and Hanna, A. (2022). Design, development, and validation of an augmented reality-enabled production strategy process. Frontiers in Built Environment, 8:5.
OAS (2021). Oas and meta partner to train thousands of latin american and caribbean creators in augmented reality. https://www.oas.org/en/media_cente r/press_release.asp?sCodigo=E-116/21.
Object Management Group (2023). Area. https://thea rea.org/. Retrieved January 13, 2023.
Orduna-Malea, E., Martín-Martín, A., and López-Cózar, E. (2017). Google scholar as a source for scholarly evaluation: a bibliographic review of database errors. Revista Española de Documentación Científica, 40(4):1–33.
Oyekan, J., Hutabarat, W., Tiwari, A., Grech, R., Aung, M., Mariani, M., López-Dávalos, L., Ricaud, T., Singh, S., and Dupuis, C. (2019). The effectiveness of virtual environments in developing collaborative strategies between industrial robots and humans. Robotics and Computer-Integrated Manufacturing, 55:41–54.
Page, M., McKenzie, J., Bossuyt, P., Boutron, I., Hoffmann, T., Mulrow, C., Shamseer, L., Tetzlaff, J., Akl, E., Brennan, S., Chou, R., Glanville, J., Grimshaw, J., Hróbjartsson, A., Lalu, M., Li, T., Loder, E., Mayo-Wilson, E., McDonald, S., and Moher, D. (2021). The prisma 2020 statement: an updated guideline for reporting systematic reviews. Systematic Reviews, 10(1):1–11.
Park, S. and Kim, Y. (2022). A metaverse: Taxonomy, components, applications, and open challenges. IEEE Access, 10:4209–4251.
Phaal, R., Farrukh, C., and Probert, D. (2004). Technology roadmapping—a planning framework for evolution and revolution. Technological Forecasting and Social Change, 71(1–2):5–26.
Phaal, R., Farrukh, C., and Probert, D. (2009). Visualising strategy: a classification of graphical roadmap forms. International Journal of Technology Management, 47(4):286.
Rameshwar, J. and King, G. (2020). Case studies in engineering and technology innovation in the caribbean: A focus on educolcom and bevcom. In Chowdary, B., editor, Proceedings of the International Conference on Emerging Trends in Engineering & Technology (IConETech2020, page 574–584. Faculty of Engineering, The University of the West Indies, St. Augustine.
Rameshwar, J. and King, G. (2022). Caribbean metaverse development: A literature review perspective. Journal of Metaverse, 2(2):83–99.
Rameshwar, J. and King, G. (2023a). Analysis of caribbean xr survey creates an xr development strategy as a path to the regional metaverse evolution. Journal of Metaverse, 3(1):43–65.
Rameshwar, J. and King, G. (2023b). An explanation of the codebook for analysing xr development. International Journal of Advanced Virtual Reality, 1(2):52–69.
Rauschnabel, P., Felix, R., Hinsch, C., Shahab, H., and Alt, F. (2022). What is xr? towards a framework for augmented and virtual reality. Computers in Human Behavior, 133:107289.
Rethlefsen, M., Kirtley, S., Waffenschmidt, S., Ayala, A., Moher, D., Page, M., Koffel, J., Blunt, H., Brigham, T., Chang, S., Clark, J., Conway, A., Couban, R., Kock, S., Farrah, K., Fehrmann, P., Foster, M., Fowler, S., Glanville, J., and Young, S. (2021). Prisma-s: an extension to the prisma statement for reporting literature searches in systematic reviews. Systematic Reviews, 10(1):1–19.
The Alma Jordan Library (2023). Uwilinc. https://uw in-primo.hosted.exlibrisgroup.com/prim o-explore/search?vid=STA. Retrieved January 7, 2023.
The Khronos Group (2023). The metaverse standards forum. https://metaverse-standards.org/. Retrieved January 13, 2023.
The VR/AR Association (2023). The vr/ar association. https://www.thevrara.com/. Retrieved January 13, 2023.
The XR Association (2023). Xr association. https://xr a.org/. Retrieved January 13, 2023.
TVRSJ (2023). https://www.jstage.jst.go.jp /browse/tvrsj/_pubinfo/-char/en. Retrieved January 10, 2023.
Tynes, C. and Seo, J. (2019). Making multi-platform vr development more accessible: A platform agnostic vr framework. In Stephanidis, C., editor, HCI International 2019 - Posters. HCII 2019. Communications in Computer and Information Science, volume 1033, page 440–445. Springer Verlag.
Vasarainen, M., Paavola, S., and Vetoshkina, L. (2021). A systematic literature review on extended reality: Virtual, augmented and mixed reality in working life. International Journal of Virtual Reality, 21(2):1–28.
VRIH (2023). https://www.sciencedirect.com/jo urnal/virtual- reality- and- intelligent- h ardware. Retrieved May 5, 2023.
Welch, V., Petticrew, M., Tugwell, P., Moher, D., O’Neill, J., Waters, E., White, H., Atun, R., Awasthi, S., Barbour, V., Bhutta, Z., Cuervo, L., Grimshaw, J., Groves, T., Koehlmoos-Perez, T., Kristjansson, E., O’Neill, J., Oxman, A., Pantoja, T., and Wells, G. (2012). Prisma-equity 2012 extension: Reporting guidelines for systematic reviews with a focus on health equity. PLOS Medicine, 9(10):1001333.
XR Association (2018). Xra’s developers guide, chapter one: Fundamental design principles for immersive experiences. https://xra.org/research/xr-pri mer-1-0-a-starter-guide-for-developers/.
XR Association (2019). Xra’s developers guide, chapter two: Creating safe, inclusive, and respectful immersive experiences. https://xra.org/research/xr-pri mer-2-0-a-starter-guide-for-developers/.
XR Association (2020). Xra’s developers guide, chapter three: Accessibility & inclusive design in immersive experiences. https://xra.org/research/xra-d evelopers- guide- accessibility- and- inclu sive-design/.
XR Association (2022). Xra’s developers guide, chapter four: Designing immersive learning for secondary education. https://xra.org/research/xras-d evelopers-guide-chapter-four-designing-i mmersive-learning-for-secondary-educati on/.
Yaffe, J., Montgomery, P., Hopewell, S., and Shepard, L. (2012). Empty reviews: A description and consideration of cochrane systematic reviews with no included studies. PLoS ONE, 7(5).
Downloads
Published
How to Cite
Issue
Section
License
Copyright (c) 2025 Jason Robert Rameshwar, Graham S. King

This work is licensed under a Creative Commons Attribution 4.0 International License.
Accepted 2024-03-29
Published 2025-10-03
