Will Sensors and Displays Eventually Merge in Consumer Electronic Devices?

Over the past 20 years at QD Vision, Apple, and now STMicroelectronics, I have focused on inventing building new display optical sensor technologies. Looking back what industry has achieved where we are going, see a trend of ideas technologies being merged with existing hardware to improve performance, cost, user experience. This, ultimately, is making components devices evermore complex as pack more functionality into smaller form factors that both easier interface pleasing. In world, added single-die sensors provide many capabilities possible in smallest factor. Soon, we'll be using consumer pixels detect visible infrared (IR) light, combine event-based imaging traditional imaging, complementary metal-oxide semiconductor (CMOS) nodes transistors per pixel, memory artificial intelligence (AI) layers stacked below—all single die. This could allow us leverage die enable all needed sensing, such ambient proximity, 3D, photography. Currently, most sensing architecture comprised discrete located bezel devices, some behind OLED display. Likely, eventually will placed below by leveraging developments, possibly integrated directly panel itself. Display technology seems tracking along similar path, complexity built thinner panels enjoyable experiences. Current LCD displays relatively complex, backlight unit, polarizers, thin-film transistors, light gate-based pixels, color filters. brought individual engineering pixel itself create light. The device stack highly engineered layering organic molecules very thin film enables designs combined better viewing experience (better contrast high dynamic range). comprises an make it virtually impossible integrate it, let alone inside it. Because so thin, photodetector limited, in-panel, modalities (such fingerprint) future. If shrink subpixels down 5 µm produce enough (brightness nits) over long period time (lifetime/hours) smartphone display, there would lots open area for place comfortably under (it transparent IR light). this were possible, also use available build panel's plane total thickness further. Unfortunately, currently not capable this, but replacing OLEDs gallium nitride (GaN)-based inorganic LEDs, can achieve dream, likely next evolutionary step technology. MicroLED promises exactly opening world opportunities merge device. Enhanced transparency easily rigid microLED displays, biggest gamechanger ability panel. Doing might become necessity when designing factor needs ultra-thin, zero bezel, bendable, flexible, stretchable, or transparent. To accomplish feat, probably need themselves. issue features articles detailing vision. Eric Virey from Yole Group discusses potential benefits including integrating various front plane. Francois Templier describes smart developed prototyped CEA-Leti. Edgar Hemery team Embodme cover IRIS its integration microLED-based David Slobodin IdeaFarm covers silicon-based micro-cameras meta-surface perform in-plane future displays. From diminishing panel, taking plunge exciting realms. It fascinating these explorations yield coming years. Jonathan Steckel Fellow Director Advanced Technology STMicroelectronics Grenoble, Auvergne-Rhône-Alpes, France. He may reached [email protected].