In this issue we will learn about one of the most advanced display for AR glasses from Tomas Sluka, co-founder of CREAL, a Swiss AR startup building for the future generation of lightweight AR glasses. I will also share a web XR app you can try on your Quest or mobile to experience first-hand a future with AR and AI merging together.
Interview with Tomas Sluka
Can you give us a quick overview of what CREAL does?
Tomas Sluka: Sure! CREAL is focused on developing innovative display technologies for augmented reality (AR). Our goal is to create displays that are comfortable for the human eye and simulate how the human eye naturally sees and focuses on near and far objects. This level of immersion is something that hasn't been achieved before in AR, and we believe it will transform how digital information blends with our natural environment.
What are the main technological challenges in developing AR glasses that look like regular glasses?
Tomas Sluka: The main challenge is combining the functionality of high-performance AR devices with the small form factor of regular glasses. It's incredibly difficult to fit all the necessary technology into such a small space without compromising performance. Additionally, the display technology needs to be advanced enough to provide a comfortable and believable AR experience without causing issues like eye strain or motion sickness.
Can you explain the importance of eye comfort in AR displays?
Tomas Sluka: Eye comfort is crucial because a significant portion of our interaction with the world comes through our eyes. Current AR displays often cause discomfort because they don't fully replicate how our eyes naturally see and focus. This can lead to issues like eye strain and motion sickness.
How does CREAL's display technology differ from other AR display technologies on the market?
Tomas Sluka: Our technology uses a fast display modulator combined with a holographic film on the lens. This setup allows us to project multiple images at different angles very quickly, simulating how the eye perceives depth. Unlike other AR displays that might use two flat screens, our approach provides a more natural and comfortable viewing experience, reducing issues like motion sickness (learn more about CREAL technology here).
What are the key properties of high-quality AR content according to you?
Tomas Sluka: Beyond high resolution and a wide field of view, it's essential for AR content to match the real-world environment in terms of lighting, color balance, and highlights. When digital content has the same visual properties as the surrounding environment, it becomes much more believable and immersive. The human eye and brain are very sensitive to these details, and getting them right can significantly enhance the AR experience.
How do you see AI and AR glasses merging in the future?
Tomas Sluka: AI has advanced much faster than anyone anticipated, and it's set to become a central component of AR glasses. AR glasses will likely be the main human-AI interface, providing context-aware information and assistance. The ability of AR glasses to "see" with us and overlay relevant digital information makes them an ideal interface for AI, enhancing the overall utility and experience.
What are some current use cases for CREAL's technology?
Tomas Sluka: One of our primary markets is the vision care industry. Our displays are used for advanced eye testing and can simulate various types of lenses digitally. This allows for a more tailored and precise vision correction experience. We're also collaborating with research groups and looking to integrate our technology into mainstream AR products developed by major tech companies.
How important is social acceptance for AR glasses?
Tomas Sluka: Social acceptance is massively important for consumer AR glasses. Eyewear is a fashion accessory and a part of personal identity, so AR glasses need to look and feel like regular glasses to be widely accepted. People are willing to invest in stylish eyewear, and AR glasses that meet these aesthetic standards while providing advanced functionality have a strong market potential.
What role does eye-tracking play in AR glasses?
Tomas Sluka: Eye-tracking is a complementary technology that can significantly enhance the efficiency and performance of AR glasses. By knowing where a person is looking, the device can render high-quality images only in the center of the gaze, reducing the need for high-resolution displays across the entire field of view. This can make the device more power-efficient and help achieve the form factor of regular glasses.
How do you address the challenge of using AR glasses in bright outdoor environments?
Tomas Sluka: While we focus on the display technology itself, we contribute by making our displays highly efficient in terms of light transmission. This allows for bright images even in well-lit environments. Additionally, technologies like active dimming can help by reducing the amount of ambient light that reaches the eyes, making the AR content more visible in bright conditions.
What are the manufacturing limitations of AR displays?
Tomas Sluka: Unlike electronics, optics don't follow Moore's Law, so there are more substantial limitations. For example, lenses need a certain size to maintain resolution, and power consumption is a significant concern. However, advancements in eye-tracking and efficient display technologies can help overcome some of these challenges by reducing the overall power and processing requirements.
How does CREAL plan to make its technology accessible for widespread use?
Tomas Sluka: We're working on a reference device that showcases our display technology's capabilities. This device will allow other companies to build their own products around our technology. By providing a commercially viable, high-performance display at an accessible price point, we aim to facilitate the integration of our technology into mainstream AR products.
What can we expect from CREAL in 2024?
Tomas Sluka: We have a big announcement coming up. After six years of development, we're finishing a project that brings our display technology closer to a commercially viable product. This new reference device, which resembles bulkier glasses but already performs like regular glasses, will be available for companies to use in their products. We're excited to see our technology making its way into more hands and eyes.
How do you see the future of AR and its integration into daily life?
Tomas Sluka: The future of AR involves a gradual transition from specialized applications to mainstream use. As technology advances, AR glasses will become more capable and socially acceptable. They will eventually become a primary interface for interacting with digital information, replacing many functions of smartphones and computers. However, this will happen step by step, with different types of AR devices catering to various needs along the way.
Product Spotlight: Meet Wol, your AI-powered guide to the redwood forest
Wol is an AI-enabled owl you can talk to about the forest ecosystem. It is a Mixed Reality experience that doesn’t require any installation app and that can be run on any smartphone or VR headset directly from the web.
It is a collaboration between Liquid City, 8th wall, inworld and Meta showing the capabilities of AI agents for education. You can read more about it in Niantic’s article.
I tried it out some time ago and it was one of the first convincing examples of how XR and AI collide providing an engaging and interactive learning experience that really takes advantage of mixed reality.
That’s it for today,
See you next week
