During my time working at Disguise Technologies Ltd., I had the chance to work on the Mixed Augmented and Extended Reality Media Pipeline (MAX-R) international research collaboration.
One of Disguise's contributions to the research project was to develop a way for their closed system to communication audio, visual and metadata as open protocols to connect to any supporting 3rd party. Well defined APIs were created and available for any 3rd party to interface with the system to stream data out of the Disguise ecosystem. This project remained internal and for research purposes, and was not released to the public.
My contributions included:
Feedback on initial design of the project, including shaping of the API entry points.
Implementation of video and audio streaming using FFmpeg.
Implementing usage of gRPC to communicate information including metadata cross-node.
Maintenance of the underlying data pipelines as features and support grew.
Design and development of applications utilising the API endpoints, including examples of 3rd party usage (Twitch, VP9, RTMP), and Disguise Designer for API entrypoints.