Augmented and virtual reality (AR/VR) is transforming how humans interact with technology in a wide range of fields and industries, from healthcare and education to entertainment. However, current device limitations have impeded wider integration. Tunable holographic metasurfaces represent a promising platform for revolutionizing AR/VR devices by precisely controlling light at the subwavelength scale. This article examines current challenges and opportunities from both the AR/VR and holographic metamaterial perspectives and explores how improvements to state-of-the-art approaches can address these challenges. In particular, we propose a focus on easily manufacturable and broadly electrically tunable metasurface technologies including liquid crystal integration and excitonic tuning in 2D materials. Advanced metasurface optimization techniques including machine learning will also be crucial for exploring the large design space.