Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

My own datasets #17

Open
Irina51244 opened this issue Oct 25, 2022 · 10 comments
Open

My own datasets #17

Irina51244 opened this issue Oct 25, 2022 · 10 comments

Comments

@Irina51244
Copy link

Could you please tell me how to create my own datasets if I want to reconstruct my school?

@DingYikang
Copy link
Collaborator

To use your own data, you need to (1) perform SfM using COLMAP, and (2) convert the COLMAP outputs to MVS format, and (3) use TransMVSNet to perform the final reconstruction. More instruction can be found here.

@Irina51244
Copy link
Author

Irina51244 commented Nov 8, 2022 via email

@DingYikang
Copy link
Collaborator

Hi,
(1) Would you mind showing some depth results or pcd results of your own data? So that we can find where the problem is.
(2) To retrain the model, you need a relative large dataset with high-quality GT depth, which might be hard to get.
(3) We didn't generate training data, and we use the the existing training dataset DTU and BlendedMVS. If you use TransMVSNet in outdoor scene, you can use the bld-finstuned ckpt.

@Irina51244
Copy link
Author

Irina51244 commented Nov 9, 2022 via email

@DingYikang
Copy link
Collaborator

After checking your results, I think the data format you used might have problems. For example, have you given the depth_min value and depth_max value in cam.txt with proper format? Which dataloader is used in your experiment? I recomend checking the cam.txt and the dataloader to verify if the depth range be read properly. You can send me an e-mail to add my wechat for more information.

@fanshixiong
Copy link

@DingYikang 您好,我用colmap稀疏重建后跑MVSNet,得到的深度范围一直是6-8,最后估计的深度图也不对,重建点云很少,效果很差,这个深度范围应该怎么修改呢?

@DingYikang
Copy link
Collaborator

@DingYikang 您好,我用colmap稀疏重建后跑MVSNet,得到的深度范围一直是6-8,最后估计的深度图也不对,重建点云很少,效果很差,这个深度范围应该怎么修改呢?

hi,建议您检查所使用的dataloader是否正确,如果使用colmap2mvsnet.py进行转换,建议使用general_eval.py,深度图不对的原因可能是在读取cams.txt时d_min,d_max读取错误,您可以对照检查自己的数据和公开数据集格式的区别,并修改dataloader进行适配。

@fanshixiong
Copy link

@DingYikang 你好,感谢你的回复,我在使用tnt数据的时候,用colmap2mvsnet转换出来跑,也是没有能够得到一个较好的结果,深度图很乱,生成的点云很小,cams.txt里面深度范围是3-40,但是我看transmvsnet提供的tnt数据txt深度值都是0.几,是不是这个原因导致了深度图输出错误了呢?如果是的话应该如何使用colmap去转换数据呢?感谢您的回复!

@DingYikang
Copy link
Collaborator

@DingYikang 你好,感谢你的回复,我在使用tnt数据的时候,用colmap2mvsnet转换出来跑,也是没有能够得到一个较好的结果,深度图很乱,生成的点云很小,cams.txt里面深度范围是3-40,但是我看transmvsnet提供的tnt数据txt深度值都是0.几,是不是这个原因导致了深度图输出错误了呢?如果是的话应该如何使用colmap去转换数据呢?感谢您的回复!

如果您重新用colmap2mvsnet跑了tnt的数据,在选择dataloader时应该将tnt_eval.py替换为general_eval.py,猜测是因为这个原因导致读取cam.txt中的内容出错了

@fanshixiong
Copy link

@DingYikang 你好,我的txt文件如下,我修改了colmap2mvsnet.py保存深度最小值和深度最大值,下图左图是从repo中下载的处理后的cam.txt文件,右图是用colmap2mvsnet转换出来的文件,深度差别很大,最后导致深度图和分割图就不对,点云文件很小,这个是什么原因呢?应该如何修改呢?感谢您的回复!
image
image

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants