This is Changing 3D Scanning!!
TLDRThe video discusses the advancements in 3D scanning technology, highlighting the Kiri engine as a significant tool for both AR technology and 3D scanning. It introduces a new feature called 'Neural Radiance Fields' (NeRF) and its improved version, 'Norlandulo', which allow for 3D scanning of objects without distinct features that traditional photogrammetry struggles with. Kiri engine's implementation of Norlandulo is particularly noteworthy as it overcomes limitations of scanning reflective or single-colored surfaces. The video also clarifies that while NeRF is an impressive technology, it is not yet a replacement for photogrammetry, but Norlandulo shows potential in this regard. The Kiri engine is available for free and compatible with both Android and iPhone devices.
Takeaways
- π **3D Scanning and Photogrammetry Growth**: The market is increasingly focusing on AI and AR, making 3D scanning and photogrammetry more accessible with new tools and apps.
- π± **Kiri Engine**: A tool for 3D scanning and AR technology, offering an alternative to iPhone 3D scanning apps like Polycam, now available for Android with QR support.
- π **Nerf Technology**: Kiri Engine introduces virtual scanning using Nerf (Neural Radiance Fields), a technique that can overcome some limitations of photogrammetry.
- π **Advancements in Technology**: Despite initial skepticism, technology like Nerf is advancing rapidly, with Kiri Engine being the first to offer it on both iPhone and Android.
- 𧩠**Mesh Quality**: Nerf doesn't produce high-quality meshes like photogrammetry, but Kiri Engine's future updates may address this with improved algorithms.
- π‘ **Featureless Scanning**: Kiri Engine's new feature allows scanning of objects without distinct features, such as reflective surfaces or single-colored objects, which traditional photogrammetry struggles with.
- π₯ **Scanning Process**: The process involves recording a video of the object from different angles, which is then submitted to the cloud for processing.
- β° **Time Limitations**: Kiri Engine limits the video length for scanning to 2 minutes due to server limitations, but this duration is generally sufficient for scanning objects.
- π₯ **Nerf vs. Photogrammetry**: Nerf is not expected to replace photogrammetry due to its current limitations, but technologies like Norlandulo may be stronger contenders in the future.
- π **Norlandulo**: A newer technique that improves upon Nerf by generating high-quality 3D models usable in software like Blender, based on the algorithm used in Kiri Engine's featureless mode.
- π **Further Exploration**: The video encourages viewers to learn more about these emerging technologies and try out Kiri Engine for free, highlighting its additional features beyond featureless scanning.
Q & A
What is the current state of 3D scanning in the industry?
-3D scanning is one of the most challenging subjects in 3D and is gaining more attention daily, especially with the market shifting towards artificial intelligence and augmented reality.
What is the Kiri engine and how does it relate to 3D scanning and AR technology?
-The Kiri engine is a tool for 3D scanning and AR technology that was reviewed as a great alternative to iPhone 3D scanning apps like Polycam, and it is also available for Android devices with QR supports.
What is the new feature in the Kiri engine that the speaker is particularly interested in?
-The speaker is particularly interested in the new feature called virtual scanning using NeRF technology, specifically a technique called Norlandulo.
What are some of the limitations of photogrammetry?
-Photogrammetry requires distinct features in an image of an object, such as changes in color or shape, to create a complete shape. It struggles with objects that lack feature points, like objects with a single color, or those that are transparent, translucent, or extremely reflective.
How does NeRF technology differ from photogrammetry?
-NeRF, which stands for Neural Radiance Field, is a machine learning technology that uses AI to reconstruct an entire 3D scene from a set of images or a video, and it can reconstruct scenes and objects that don't have enough feature points for photogrammetry.
What is Norlandulo and how does it improve upon NeRF technology?
-Norlandulo is a technique that not only generates neural rendered scenes like NeRF but also produces a high-quality mesh of the object that is usable in 3D software like Blender. It addresses some of the shortcomings of NeRF by improving cloud quality and mitigating issues with photogrammetry.
How does the Kiri engine's featureless object mode work?
-To use the featureless object mode in Kiri engine, you click the plus button, select the featureless option, and start recording a video of the object. You should circle around the object, trying to be steady and consistent, and perform the scan in different layers (top, middle, bottom). The video is then submitted to the cloud for processing.
What is the current limitation of the video length for scanning with the Kiri engine?
-The Kiri engine limits the video length for scanning to 2 minutes due to server limitation purposes.
Will NeRF technology replace photogrammetry?
-No, NeRF will not replace photogrammetry. While NeRF can handle scenes and objects that photogrammetry cannot, it currently can't produce high-quality 3D models and textures viable for a typical 3D pipeline. However, Norlandulo and its future versions are stronger contenders for replacing photogrammetry.
What are some of the other features of the Kiri engine besides the featureless mode?
-Other features of the Kiri engine include a web app, an accessible library, the ability to create a floor plane, in-app editing, texture toning, and more.
How can one try the Kiri engine for free?
-You can try the Kiri engine for free by downloading it from the link provided in the video description, which is compatible with both Android and iPhone devices.
What is the significance of the Kiri engine's ability to scan reflective surfaces or black colors?
-The Kiri engine's ability to scan reflective surfaces or black colors is significant because these are limitations that traditional 3D scanners often face, making the Kiri engine a more versatile tool for a wider range of scanning needs.
Outlines
π The Rise of 3D Scanning and Kiri Engine's Role
The first paragraph introduces the challenges and current trends in 3D scanning, highlighting its growing importance in industries converging with artificial intelligence and augmented reality. The Kiri engine is presented as a versatile tool for 3D scanning and AR technology, offering an alternative to other scanning apps like polycam and supporting both iPhone and Android. A significant focus is on the engine's new feature: virtual scanning using NeRF (Neural Radiance Fields) technology, which aims to address the limitations of photogrammetry, such as difficulties scanning reflective or black surfaces. The paragraph also mentions the potential of NeRF to improve mesh quality through future updates of the Kiri engine.
π NeRF and Norlandulo: The Future of 3D Scanning
The second paragraph delves into the capabilities and limitations of photogrammetry, contrasting it with the emerging NeRF technology. NeRF, which stands for neural radiance field, is a machine learning approach that uses AI to reconstruct 3D scenes from a series of images or video, overcoming the feature point limitations of photogrammetry. Norlandulo, a more advanced technique, is introduced as a method that not only generates neural rendered scenes but also produces usable 3D models compatible with software like Blender. The paragraph explains how to use the featureless object mode in the Kiri engine, which is based on the Norlandulo algorithm, and discusses the current limitations such as video length and processing time. It concludes by addressing whether NeRF will replace photogrammetry, suggesting that while NeRF is not yet capable of handling high-quality 3D models and textures, Norlandulo 2.0 shows promise in potentially replacing photogrammetry in the future.
Mindmap
Keywords
π‘3D Scanning
π‘Photogrammetry
π‘Kiri Engine
π‘NeRF (Neural Radiance Fields)
π‘Nerf Technology
π‘Norlandulo
π‘Featureless Object Mode
π‘Point Cloud
π‘Artificial Intelligence (AI)
π‘Augmented Reality (AR)
π‘Machine Learning
Highlights
3D scanning is a challenging subject in the 3D industry and is gaining attention with the market's shift towards AI and AR.
Kiri Engine is a tool for 3D scanning and AR technology, offering an alternative to iPhone 3D scanning apps like Polycam.
Kiri Engine now supports Android and has QR code support for those without the hardware for real-time 3D scanning.
A new feature in Kiri Engine is virtual scanning using NeRF technology, which aims to mitigate some of the shortcomings of photogrammetry.
NeRF, or Neural Radiance Fields, is an emerging technique that uses AI to reconstruct 3D scenes from a set of images or video.
Kiri Engine is the first app to offer NeRF technology on both iPhone and Android phones.
NeRF doesn't generate high-quality meshes like photogrammetry, but Kiri Engine's future updates are expected to improve this.
Photogrammetry requires distinct features in images, which can be a limitation when scanning objects with few features like single-color or reflective surfaces.
NeRF technology can reconstruct scenes and objects that lack sufficient feature points for photogrammetry.
Nerfalandulo is a technique that goes beyond NeRF by generating neural-rendered scenes and usable 3D objects.
Nerfalandulo is based on a research paper by Nvidia and is now being implemented in Kiri Engine, making it a powerful tool for 3D scanning.
To use the featureless object mode in Kiri Engine, users record a video of the object, which is then processed in the cloud.
Kiri Engine limits video length to 2 minutes for featureless scanning due to server limitations.
Processing time for featureless scanning may be longer than photogrammetry, as it is a new feature that is still being optimized.
NeRF is not expected to replace photogrammetry, but Nerfalandulo 2.0 may be a stronger contender due to its ability to address the shortcomings of both.
Kiri Engine offers more than just featureless mode, including a web app, access library, in-app editing, and more.
Kiri Engine can be downloaded for free and is compatible with both Android and iPhones.