Thursday, July 19, 2018
Search
  
Submit your own News for
inclusion in our Site.
Click here...
Breaking News
Comcast Won't Pursuit Fox assets, Focuses on Sky Offer
EU to Probe Qualcomm Over Pricing Case
Google's Project Fuchsia Could Be The Successor of Android Successor to Android
TSMC Cuts Sales, Spending Outlook
Alphabet to Deploy Balloon Internet in Kenya
New Xiaomi Mi Max 3 has a 6.9-inch Screen But Only 1080p
Corning Gorilla Glass 6 Promises Improved Durability for Mobile Devices
Samsung's Foldable Phone Coming Next Year, WSJ Claims
Active Discussions
Which of these DVD media are the best, most durable?
How to back up a PS2 DL game
Copy a protected DVD?
roxio issues with xp pro
Help make DVDInfoPro better with dvdinfomantis!!!
menu making
Optiarc AD-7260S review
cdrw trouble
 Home > News > General Computing > Microso...
Last 7 Days News : SU MO TU WE TH FR SA All News

Monday, June 18, 2018
Microsoft HoloLens Provides Access to Raw Image Sensor streams with Research Mode


The Research Mode of Microsoft HoloLens holographic computer, available in the newest release of Windows 10 for HoloLens, can be used as a potential computer vision research device.

Application code can not only access video and audio streams but can also at the same time leverage the results of built-in computer vision algorithms such as SLAM (simultaneous localization and mapping) to obtain the motion of the device as well as the spatial-mapping algorithms to obtain 3D meshes of the environment. These capabilities are made possible by several built-in image sensors that complement the color video camera normally accessible to applications.

Specifically, HoloLens has four gray-scale environment tracking cameras and a depth camera to sense its environment and capture gestures of the user. Two of the gray-scale cameras are configured as a stereo rig capturing the area in front of the device so that the absolute depth of tracked visual features can be determined through triangulation. Meanwhile the two additional gray-scale cameras help provide a wider field of view to keep track of features. These synchronized global-shutter cameras are significantly more light-sensitive than the color camera and can be used to capture images at a rate of up to 30 frames per second (FPS).

The depth camera uses active infrared (IR) illumination to determine depth through time-of-flight. The camera can operate in two modes. The first mode enables high-frequency (30 FPS) near-depth sensing, commonly used for hand tracking, while the other is used for lower-frequency (1-5 FPS) far-depth sensing, currently used by spatial mapping. In addition to depth, this camera also delivers actively illuminated IR images that can be valuable in their own right because they are illuminated from the HoloLens and reasonably unaffected by ambient light.

With the newest release of Windows 10 for HoloLens, researchers have the option to enable Research Mode on their HoloLens devices to gain access to all these raw image sensors streams, shown below.

Researchers can still use the results of the built-in computer vision algorithms but can now also choose to use the raw sensor data for their own algorithms. The sensors' streams can either be processed on device or transferred wirelessly to another PC or to the cloud for more computationally demanding tasks. This opens a wide range of new computer vision applications for HoloLens. In egocentric vision, HoloLens can be used to analyze the world from the perspective of a user wearing the device. For these applications, HoloLens abilities to visualize results of the algorithms in the 3D world in front of the user can be a key advantage. HoloLens sensing capabilities can also be very valuable for robotics where these can, for example, enable a robot to navigate its environment.

Microsoft will demonstrate these new HoloLens capabilities at a tutorial on June 19th, 2018, at the IEEE/CVF International Conference on Computer Vision and Pattern Recognition (CVPR) in Salt Lake City.



Previous
Next
Apple Fined in Australia Over Customer Misleading        All News        CCIX Consortium Base Specification 1.0 Allows Companies to Deliver CCIX Production Devices
Office to Include PDF Services from Adobe     General Computing News      YouTube Music and YouTube Premium Launch in More Countries

Get RSS feed Easy Print E-Mail this Message

Related News
Intel to Release its First Dedicated GPU In 2020, Next Playstation to Have AMD SoC Inside, and New Xbox and Hololens Stories
Microsoft HoloLens Expands Availability in Europe
Second Version of HoloLens HPU Will Incorporate AI Coprocessor For implementing DNNs
Microsoft Unveils First Windows Mixed Reality Dev Kit
Microsoft Unveils Tool to Help Others See What You See in HoloLens
Minimum PC Specs For Microsoft's Windows 10 VR Headsets Are User-friendly
Microsoft HoloLens Coming In More Countries
Microsoft Provides Glimpse Of 24-core Processor For HoloLens
Microsoft HoloLens Development Edition Updates Now Opened to Everyone In the United States and Canada
Microsoft Opens Windows Holographic to Partners, Skype And Office Coming To Xiaomi Android Smarphones
Microsoft's BUILD 2016 Conference Kicks Off
Microsoft Actiongram Allows Creation Of Augmented Reality Tales

Most Popular News
 
Home | News | All News | Reviews | Articles | Guides | Download | Expert Area | Forum | Site Info
Site best viewed at 1024x768+ - CDRINFO.COM 1998-2018 - All rights reserved -
Privacy policy - Contact Us .