Japan Flying Labs Explores Revitalizing a Town with 3D Data through Drone and LiDAR Technology

By Japan Flying Labs

In the dynamic landscape of technological innovation, the fusion of 3D data, drones, and LiDAR technology is breathing life into the concept of a digital twin society. Here, we grapple with the intricacies of connecting with traditional web content. As we transition to this digital future, we must consider how we can contribute to smoothly shaping such a society.

As a member of Japan Flying Labs, I found myself at the crossroads of tradition and cutting-edge solutions when the Kindai University Alumni Association sought our expertise to revitalize local shopping streets battling depopulation and aging. The journey began in November 2021 as we gathered to formulate a transformative project led by Land and House Investigators specializing in cadastral surveying.   

Image source: Kindai Street 3D Project

Our Process

The town's decision to obtain point cloud data during a meeting in November 2021 propelled our project forward. Our target district was a shopping street of approximately 1 km, from Kindai University to Nagase Station, frequented by many students. 

The advantage of acquiring point cloud data is that it enables a lightweight representation of 3D data in the browser and shortens the processing steps. We needed to solicit investments from shops in the shopping district and make impactful presentations to other investors while keeping costs down. 

Armed with a Mavic 2 Pro drone, I captured 479 aerial photos (approximately 4 GB) to mitigate damage during a crash. We employed MetaShape Ver2.0 for Structure from Motion (SfM). Meanwhile, my colleagues on the ground used one Leica RTC360 and three BLK360 G1 LiDAR units to collect 1.7 billion point clouds, synthesized using Cyclone Register.

The measurement or aerial photography of 3D data was executed in February 2022 and subsequently analyzed and synthesized. 

Navigating Obstacles

Initially, the flight plan was conducted using the Sensefly eBee X drone. However, drone belly landings were not permitted due to the presence of safety nets, such as those for preventing the dispersion of balls, and a nuclear experimental training facility on the university grounds. Moreover, we required additional time to obtain flight permits for flights in densely populated areas, notify the relevant authorities of our plans, and reach out to the surrounding residents.

Redefining Commerce Using 3D Space

Following the down-grading of COVID-19 to a common infectious disease in Japan, we held a report meeting for Kindai University stakeholders and shopping street affiliates, showcasing the acquired data through a video presentation on monitors.

Demonstrating the potential of 3D data in revitalizing urban spaces, this data will be used as educational material for architecture students on designing interiors and as a key to building a metaverse space. Imagine shops and restaurants facing the street using this information, extracted from online store websites, to create immersive online experiences. This way, the commercial street of Kindai University, with a target audience of 300,000 alumni, could be constructed as a space that can be visited from a distance.

The development of commerce using 3D Space is a relatively new concept, and few people can envision it. Current solutions utilizing the metaverse often satisfy individuals content with avatars in the gaming world for communication. However, as real-world spaces find their presence in the metaverse, people may seek the value of information that allows them to reminisce about the past. From such spaces that people find interesting, the potential for applications in disaster prevention and community building, among other fields, could expand. 　 

The journey of constructing a digital twin society is about envisioning a future where the past and present seamlessly coexist, fueled by technological innovation. The metamorphosis of commerce in 3D Space is underway. As technicians specializing in metaverse creation implement processes and budget allocations for confirming and constructing the data, the horizon of possibilities expands, promising a future where the tangible and the virtual converge harmoniously.