gpt4 book ai didi

COLMAP camera pose reconstruction for NeRF(基于NERF的COLMAP摄像机位姿重建)

转载 作者:bug小助手 更新时间:2023-10-28 21:44:26 35 4
gpt4 key购买 nike



I am currently playing around with mesh reconstruction from NeRF models and I noticed that most NeRF implementations provide a python script for the extraction of camera poses from images via COLMAP.
It is my understanding that those scripts use sparse reconstruction or at least the feature extraction methods from COLMAP to determine camera poses and information.
The COLMAP Tutorial for feature extraction states that intrinsic parameters can be manually specified and now I can't help but wonder if there is a more efficient way to extract camera poses from images (because the quality of the NeRF often depends heavily on accurate camera poses).
Has anyone here ever tried to mess with the intrinsic parameters? Are there any more parameters to tweak to achieve better results in camera pose detection? Has anyone tried to create their own script for NeRF purposes?
I am thankful for all tips and tricks or nudges in the right direction. If you think the idea to try and mess with parameters is stupid in the first place please also feel free to let me know!
Also: If someone knows what parameters are really needed or most important for NeRF models (parmeters that can be reconstructed from a set of images) please let me know!

我目前正在尝试从NERF模型重建网格,我注意到大多数NERF实现都提供了一个Python脚本,用于通过COLMAP从图像中提取相机姿势。我的理解是,这些脚本使用稀疏重建,或者至少使用COLMAP的特征提取方法来确定相机姿势和信息。COLMAP的特征提取教程指出,内部参数可以手动指定,现在我忍不住想知道是否有更有效的方法从图像中提取相机姿势(因为NERF的质量通常在很大程度上依赖于准确的相机姿势)。这里有没有人试图扰乱内在参数?在相机姿势检测中,是否还有更多参数需要调整以获得更好的效果?有没有人尝试过为NERF目的创建自己的脚本?我感谢在正确方向上的所有提示和技巧或轻推。如果您一开始就认为尝试和修改参数的想法很愚蠢,也请随时让我知道!另外:如果有人知道NERF模型真正需要或最重要的参数是什么(可以从一组图像重建的参数),请让我知道!


I have so far tried to understand the provided python scripts and read the COLMAP tutorial section. I have not tried to extract camera poses myself using COLMAP because at this point I am not entirely what parameters are really needed for good results in NeRF modelling.

到目前为止,我已经尝试理解所提供的python脚本,并阅读了COLMAP教程部分。我没有尝试自己使用COLMAP提取相机姿势,因为在这一点上,我不完全知道在NERF建模中真正需要什么参数才能获得好的结果。


Please excuse the tags I couldn't find any that better suited the question in the suggestions.

请原谅我找不到更适合建议中问题的标签。


更多回答
优秀答案推荐

If you're working with NeRF and encountering issues where Colmap is preventing you from obtaining camera positions, I also faced a similar problem for several months as running NeRF you need the camera positions that is ditected by Colmap. I'm using TEM images to train with the NeRF model, but Colmap couldn't detect the camera positions.

如果你正在使用NERF,并且遇到了Colmap阻止你获得相机位置的问题,我在运行Nerf时也遇到了几个月的类似问题如果你需要Colmap丢弃的相机位置。我正在使用透射电子显微镜图像与NERF模型进行训练,但Colmap无法检测到相机位置。


I found a helpful workaround that saved me from this predicament. You can check out NerfMM. This tool works without the need for camera parameters. Give it a try; it might assist you in resolving your problem.

我找到了一个有用的解决办法,把我从这种困境中解救出来。您可以查看NerfMM。此工具无需相机参数即可工作。尝试一下,它可能会帮助你解决问题。



You can use other KIRI Engine app for example to get position when you take a photo. It gave me much better training results.

例如,当你拍照时,你可以使用其他Kiri Engine应用程序来定位。它给了我更好的训练结果。


更多回答

Isn't Kiri an App for photogrammetry? How can I use camera positions from Kiri for my NeRF model?

Kiri不是摄影测量的App吗?如何将Kiri的相机位置用于我的NERF模型?

Your answer could be improved with additional supporting information. Please edit to add further details, such as citations or documentation, so that others can confirm that your answer is correct. You can find more information on how to write good answers in the help center.

您的答案可以通过其他支持信息来改进。请编辑以添加更多详细信息,如引用或文档,以便其他人可以确认您的答案是正确的。你可以在帮助中心找到更多关于如何写出好答案的信息。

You can find developer mode in KIRI. If you turn it on, you will see position options. docs.nerf.studio/en/latest/quickstart/… you can have a look on that site. search kiri

您可以在KIRI中找到开发者模式。如果你打开它,你会看到位置选项。docs.nerf.studio/en/latest/quickstart/.你可以在那个网站上看看。搜索kiri

35 4 0
Copyright 2021 - 2024 cfsdn All Rights Reserved 蜀ICP备2022000587号
广告合作:1813099741@qq.com 6ren.com