Camera hardware, real-time GPU processing and audio-driven camera selection for immersive communication.
32 imagesMultiple cameras, real-time processing and speaker-driven view selection.
Portable panoramic capture, stitching, streaming and hardware integration.
Working prototypes, software tests and enclosure design studies.
MultiView explored how a camera system could choose a useful view of the person speaking. The work brought cameras, microphones and real-time processing into one prototype.
We evaluated camera hardware, lenses and colour response, then connected multiple camera feeds to a GPU processing pipeline. The prototypes included five-camera arrays, network capture and software for processing and switching views.
Microphone-signal envelopes provided an indication of speech activity. We used that information to drive camera selection and tested microphone placement around the meeting table.
The development also tested facial-landmark tracking with NVIDIA Maxine. We compared visual tracking with audio-based selection, including the problems created by turned heads and multiple speakers.
32 images
32 images
32 images
32 images
32 images
32 images
32 images
32 images
32 images
32 images
32 images
32 images
32 images
32 imagesMobile Portrait investigated two hardware routes: a three-camera panoramic system and a separate single-fisheye-camera setup. The prototypes combined capture hardware, compact computing, streaming and portable power.
The three-camera route used calibrated stitching to combine the views. Development covered camera placement, parallax, capture interfaces and the practical integration of the electronics into a portable system.
The single-camera route reduced the hardware footprint. It offered another way to capture a wide view, with different trade-offs in image quality, processing and packaging.
32 images
32 images
32 images
32 images
32 images
32 images
32 images
32 images
32 images
32 imagesThese design studies explore a camera module mounted above a display. They show proposed housing, mounting and form; the renders are labelled separately from photographs of working prototypes.
32 images
32 images
32 images
32 images
32 images
32 images
32 images
32 images
32 imagesExplore camera assemblies, network and audio integration, processing interfaces, portable prototypes and enclosure concepts. Each image includes the best available date or project period.
Discuss camera systems, real-time GPU processing or spatial communication technology.
