Fujitsu Develops Technology to Help Field Workers in Remote Field Sites

Fujitsu Laboratories has developed 3D image synthesis technology that uses images captured by a worker-side camera to generate a 3D panoramic image to convey the entire scene of a field site in a way that is easy to grasp

Apac CIOOutlook | Monday, April 18, 2016

KAWASAKI, JAPAN: Fujitsu, a provider of information technology and services, announces the development of a new technology which generates synthesized 3D panoramic screens and provides them to remote supporting operators; enabling them to fully understand work site conditions and provide precise, omnidirectional instructions to field workers.

Fujitsu Laboratories has developed 3D image synthesis technology that uses images captured by a worker-side camera to generate a 3D panoramic image to convey the entire scene of a field site in a way that is easy to grasp. It has also developed user interface and work instruction AR presentation technology that, by using camera images and sensors to estimate a worker's position in real time, enables precise instructions to be conveyed directly to the field site from a remote location.

Stay ahead of the industry with exclusive feature stories on the top companies, expert insights and the latest news delivered straight to your inbox. Subscribe today.

Challenges faced by the technology

While there are technologies that capture still images of the field site with a smart device's built-in camera, transmit them to the remote support operator at a remote location, and enable the field worker to then receive instructions. The problem is that the narrow field of view of most cameras makes it difficult for the remote support operator to get a good grasp of overall conditions in the field. On the other hand, when transmitting live video, blurred images caused by the worker's irregular movements can leave remote support operators feeling dizzy.

Also, as these technologies cannot directly convey the worker's position and orientation within the workenvironment to the remote support operator, the two of them need to interrupt the task at hand to discuss such issues as the place being addressed in the instructions and the direction in which the worker should be looking. This then requires a discussion which takes time and reduces efficiency. The technology features:

Online 3D image synthesis technology for field site images

This technology extracts a number of characteristic points in a scene from multiple images shot at the worksite to tracks the camera's position and orientation in real time, and continuously estimates the worker's position and orientation. Using the estimate results, clean images that are not blurred are selected and placed at the appropriate spot and orientation in the 3D scene, and then transmitted to the remote support operator. On the remote support operator side, camera parameters such as focal length and image center are used to lay out the images in three-dimensional space in real time, with image sizes adjusted to take into account the distance between the camera and the characteristic points. By sequentially placing each selected image in three-dimensional space, it immediately and accurately displays a 3D image with a strong sense of presence that captures the entire scene of a work site over a wide scope.

Worker activity monitoring and AR presentation technology for work guidance

In order to faithfully reproduce the three-dimensional spatial structure of the actual worksite using a generated 3D image, this technology incorporates information from multiple sensors to make a highly precise estimate of the worker's position and orientation, which is used to depict a virtual scene that places the worker as a 3D model in a synthesized panoramic image. This allows the remote support operator to view the scene from any desired perspective and to monitor the worker's actions. In addition, the remote support operator can give guidance in the form of pointers or notes placed in the 3D image. This guidance is immediately conveyed to the worker's smart device and is presented as AR information in real time, corrected for the worker's position and orientation. Furthermore, if that AR information is outside of the worker's visual scope, the worker can be directed to that area, which improves the effectiveness of remote support.

This technology allows the worker to receive precise guidance from the remote support operator and enables less-experienced workers to expand their scope of operations. In addition skilled workers who may find it difficult to work in the field can effectively utilize their skills, enabling improved flexibility in leveraging the talents of employees.

More in News

Evolving Role of Surveillance in Security

Surveillance cameras are commonly perceived as vigilant observers, aimed at deterring crime. In reality, many of these cameras serve a passive function. They primarily act as a deterrent or offer valuable evidence when incidents occur. For instance, if your vehicle is stolen, you often hear, “Check the CCTV footage.” Although they are not constantly actively monitoring, these cameras play a crucial role in promoting safety and providing insights after an event has taken place. This scenario is however changing, and fast. Artificial intelligence is aiding surveillance cameras with the appropriate acumen to help the ‘watchful eyes’ to analyze live video footages, without requiring any human to govern it. This can be highly beneficial for public safety as it would help police and first responders to spot crimes and accidents easily. On the other hand, biometrics, which has remained a part of the security narrative for years now, is maturing evermore rapidly; allowing for retinal scanning, facial recognition, and even sitting posture, heartbeat, and body scent to recognize a human being. The age of privacy may have fallen behind, but security is still something everyone has to consider. Turning at the corner of a new reality, where abundantly available personal information makes it possible for criminals to target practically anyone, one would need to do more than just ‘employ’ the latest in security technology. Alongside, drones, which have been in use in the consumer market for quite some time now, have only recently started to become more common as a method of surveillance and security. Security drones can do everything from snapping pictures of suspicious or illegal activities, to actually chase down and follow potentially dangerous suspects. Some surveillance drones can hit speeds as fast as 50 miles per hour, and may also have the advantage of LED or infrared lights to better capture pictures and video. These new advances suggest public life can still be secure in an increasingly exposed world. Check out: Top Drone Technology Companies ...Read more

Strategized SEO for Profit

Online retail businesses need to maintain a lot of pages, making their SEO more complicated and time-consuming. Moreover, these online retailers need to adopt cutting-edge SEO solution for better results as search engines are incessantly regulation their algorithms. It not only optimizing the actual content of a company's website but also external factors such as the quality of the links that are pointing to the website and the company's social media presence. Visitors need to search for products based on a variety of different factors, and every product should come up when searched. Thus retail businesses have pages dedicated to every product that they sell. Companies should always try to obtain one of the top spots in the search engines to increase traffic, gain instant trust and decrease advertising costs. They should include the right keywords in their content, keeping in mind the types of words that people often type in. Companies can take the help of different keyword tools that help figure out which keywords and search phrases people use when they look for the items available in the store. To make it more beneficial, images can be added to the website which helps people get a better idea of what they are buying. Moreover, mages can come with a description and relevant keywords. Creating a more extensive site helps it rank better since search engines tend to favor larger sites over smaller ones. Additional content such as blog posts, interesting articles, or testimonials from past customers can also be included. Product reviews can also be beneficial for helping people find the products that they need. And last but not the least, the website should be mobile friendly and should be shared on as many social media platforms as possible. ...Read more

Enhancing Customer Insights: The Impact of AI in E-Commerce

AI existed mainly in the realm of science fiction. Recent years have brought a significant shift in this perception. Today, numerous industries have embraced AI technology, allowing them to engage with customers in ways that were previously unimaginable. The evolution highlights the growing importance of AI in enhancing communication and interaction between businesses and their clientele, marking a notable change in how companies operate and interact in the modern marketplace. While many industries have witnessed profound growth owing to the services of AI, e-commerce deserves a special mention because it has created several viable portals through AI to enhance the interaction channels of customers. During purchasing AI can act as a virtual assistant and give customers shopping notifications and personalized recommendations of the best-suited products. With AI machine learning, e-commerce portals can learn and remember customers’ preference so that it can recommend purchase items without doing any manual work. Many e-commerce providers also used chatbots to check the status of any specific order and ask questions if they have any doubt related to that account. Chatbots enables customers to make personalized service they need without waiting for a long time. The bots can scan the online profiles of customers and respond to their queries them in real time. Apart from rendering personalized customer services, bots also bring forth customer intelligence capabilities. If an e-commerce company uses chatbots for scanning customers’ profiles and purchasing history, they get a lot of data to improve their offerings and be competitive in the market. It also helps industries to leap ahead in the market race through keeping a competitive price with market standards. Used in almost every industry today, one can predict that more and more AI be leveraged in the coming years to determine the predictability of customer behavior. ...Read more

E-Commerce Reshaping the Cities

With commerce becoming e-commerce, major changes have been seen in the ways cities are being designed. According to experts, including automated vehicles and drone technology will drive the efficiencies of the e-commerce industry . Many automobile companies have already started integrating automated vehicles with drones. For instance, Mercedes has designed an automated vehicle with drones that fly high like an aircraft for delivery. With technology reaching every corner, e-commerce industry is chasing automated vehicles and drones to enhance delivery and cost efficiencies. The utilization of automated vehicles and drones with smaller vehicles can optimize delivery and routing and make effective use of the road space. According to experts, light vehicles will lead to more free space. With the advent of technology for automated vehicles and drones , organizations are trying to connect it with e-commerce. Customer acceptance and business models are key factors and because of which automation will continue to happen at a faster rate in e-commerce landscape. In addition to the business models and customer acceptance, government regulations also play an important role. Apart from the urban areas, the non-urban areas will also see a major prospect for automated vehicles and drone delivery in the days to come. Transport links like electric charging infrastructure will go through a drastic change as automated vehicles, drones, and electric charging infrastructure are expected to go hand in hand. With retail having a solid experiential part, e-commerce is likely to impact physical stores, and the degree to which conventional bricks-and-mortar will move to delivery following in-store shopping, and the suggestions on request, and how and where retail happens in the cities. Check out: Top Drone Technology Companies ...Read more