Result description
Our COGNITUS media AI software platform enables crowd-sourced video content to be curated, aggregated, , automatically quality checked and enhanced to make it more appealing to audiences. A mobile phone app is used to record and upload video from non-professional sources to servers for processing using machine learning techniques to ‘professionalise’ its production values. The videos are also automatically analysed, metadata enriched to facilitate smart content discovery, and options for immersive sound are included. Using the COGNITUS smart production tools, the high-quality videos can then be searched and accessed by programme makers with criteria like visual similarity, and audio matches. Leveraging enhanced crowd-sourced content through COGNITUS, facilitates reductions in the cost of producing high quality ultra-high definition content. Furthermore, the COGNITUS platform offers a means of engagement for the general public to get involved in broadcast content production
The COGNITUS media AI software platform receives video from non-professional sources, and automatically quality checks and enhances the quality for creating high quality Ultra-High Definition (UHD) experiences. Machine learning techniques are applied to ‘professionalise’ its production values. Innovations include: User Generate Content (UGC) and production convergence; quality of experience, UHD broadcasting and High Dynamic Range, content enhancement, reward schemes for media content crowdsourcing, data compression and data coding, and creation of an immersive sound experience from the audio content. Features include spatial upscaling, framerate up-conversion, and dynamic range adaptation as visual enhancement mechanisms. Refinement modules, such as video stabilisation and portrait-to-landscape modules are also offered. Semantic enrichment of the metadata is achieved deep-learning algorithms which associate media annotations with respective visual and text data. Various audio enhancement tools handle a number of distortions that can occur in UGC such as wind noise or clipping, as well as audio synchronisation for alignment of overlapping audio and video streams.
Addressing target audiences and expressing needs
- Collaboration
We are looking for avenues to continue exploring our innovatons
- Research and Technology Organisations
R&D, Technology and Innovation aspects
The COGNITUS platform is near production ready. BBC in the UK and at FORTHNET in Greece have successfully trialled installations. Deployments were launched at high profile cultural entertainment and sports events across both countries. UGC video content was captured, enhanced and enriched by the COGNITUS technology components, and validation was provided by UGC contributors and producers.
Result submitted to Horizon Results Platform by BRITISH BROADCASTING CORPORATION
