unilever has partnered with accessibility app specialist Be My Eyes to expand its use of AI, adding new tools to its products to help visually impaired consumers.
The new partnership expands on Unilever’s implementation of Persil’s on-pack accessible QR (AQR) codes developed by computer vision specialist Zapper. Coleman’s The product was launched in the UK last year.
Unilever is initially piloting the Be My Eyes technology in the UK with Coleman’s Singapore Noodle Meal Maker. If successful, the technology will be integrated into more Unilever brands throughout 2024.
By scanning the AQR code on the front of the pack, shoppers will be directed to the free Be My Eyes app and connected to a volunteer or virtual AI chat who will read and explain recipes and answer cooking questions. Product details, usage, recycling information, ingredients and nutritional values.
The AQR code developed by Zappar features a pattern with a dotted line around one corner, increasing detectability from long distances up to 1.1 meters, which is seven times the range of a typical QR scan. This allows visually impaired consumers to find desired products in stores and at home.
This is the first time the completely free Be My Eyes AI technology has been integrated with food.
Unilever’s customer support team will be integrated into the Be My Eyes app experience, allowing consumers to automatically connect to Colman’s support team.
Mike Buckley, CEO of Be My Eyes, said: The cooking experience for these consumers has long been compromised by the difficulty of reading ingredients and cooking instructions on packages. Unilever’s commitment to use new Zappar technology in Be My Eyes heralds a new era in product accessibility and convenience for people with disabilities. ”
Caspar Thykier, co-founder and CEO of Zappar, said: “Our integration with Be My Eyes is a very important step towards making access to information a basic human right. We are excited to combine Eyes’ new OpenAI, ChatGPT4 Vision integration to support a more conversational and supportive experience for Be My Eyes users with clear, structured and accurate data.”
Unilever will work with Be My Eyes and Zappar to use feedback to optimize the technology. The company aims to roll out this accessible technology to other Unilever products during 2024.