Analyzing Content with AI and ML in OneDrive and SharePoint

by | Aug 31, 2018 | Collaboration | 0 comments

Microsoft recently announced two innovations in content storage which leverage artificial intelligence (AI) and machine learning (ML) to streamline user experience. They involve actively analyzing video, audio, and visual content and adding tags to improve search and storage capabilities. It may sound like science fiction, but these are just some of the ways AI and ML will completely change our expectations for technology.

The first feature involves automatically transcribing both audio and video content in real-time. Users will be able to see a full transcription while they are viewing a video or listening to an audio file, which will help them manage video and audio content while also sharing it with others. Utilizing Microsoft’s advances in artificial intelligence and machine learning, this new feature should make videos easier to catalogue, tag, and search. The program can handle over 320 different file types. More importantly, users of all that audio and video content will be able to leverage those services without leaving the Microsoft Cloud, so it is protected and is not passed through any potentially insecure third-party services.

The announcements came in a Microsoft blog by partner director of program management for OneDrive and SharePoint, Omar Shahine. “Once you’re ready to make a video broadly available across the organization, you can upload and publish to Microsoft Stream,” wrote Shahine. “You’ll continue to get transcription services plus other AI driven capabilities, including in-video face detection and automatic captions.”

The second feature focuses not on video and audio files, but images. All photos and other visuals stored within OneDrive or SharePoint will be analyzed for location of the image, objects within the image, and anywhere text may be present. It uses secure and native AI to make these determinations. The capability to extract this kind of detail from only an image is revolutionary. It gives users the ability to search for images just as easily as they search for documents. Using related keywords and associations, images can be found faster, understood better, and catalogued more accurately.

“For example, you could search a folder of scanned receipts for the receipt that mentions ‘sushi,’” Shahine explains. “Video and audio files also become fully searchable thanks to the transcription services described earlier.” With this innovation, a hard drive full of disparate images and content can be categorized and understood instantly. Whereas before, such a project would’ve taken an employee dozens of hours of meticulous work sorting through and tagging each image.

Microsoft is constantly innovating within its product offerings. Both features discussed here, video-and-audio-transcription and searching-audio-video-and-images, will be available on OneDrive and SharePoint before the end of 2018. Adopting these technologies within your organization is a great way to stay at the cutting edge of advancements in the tech sector. Microsoft has a been focusing on incorporating their newest innovations into their existing products, as can be seen with AI and ML. The best part is these features are usually included within routine updates at no cost to you.

Need help in deploying a OneDrive or SharePoint solution? Our team has unmatched experience in building, integrating, and maximizing these Microsoft technologies. No matter your needs, don’t hesitate to reach out to us at