Fix camera transformations in ARKitScenes and ScanNet #1544
Conversation
Fix camera coordinate system in ARKitScenes.
Fix camera coordinates in ScanNet.
* Update arkitscenes_dataparser.py Fix camera coordinate system in ARKitScenes. * Update scannet_dataparser.py Fix camera coordinates in ScanNet.
|
@ponimatkin When I used the 'ns-train nerfacto scannet-data --data ScanNet_path' command to train ScanNet scenes, I found that the scene were upside down. When I commented out 'pose[2, :] *= -1', the scene looked normal. Do you know why this is happening? If you could explain these lines of code for coordinate system transformation, it would be even better. Thank you for your work! 2023-04-17_231058.mp4
|
|
Hi @fanhongxing, ah I see, it seems I didn't order cameras correctly – when I was working on that PR I didn't have access to the viewer on my machines. I'll add a new PR soon to fix this issue for ScanNet and ARKitScenes. |
@ponimatkin Thank you for your quick response! Looking forward to your excellent work. |
…ject#1544) * Update arkitscenes_dataparser.py Fix camera coordinate system in ARKitScenes. * Update scannet_dataparser.py Fix camera coordinates in ScanNet.
I realized there is a mistake in the conversion code since ARKitScenes and ScanNet use OpenCV camera convention, so there were a missing parts in the code – those are added now.
Edit: Given that there is PR #1543, maybe we should merge this patch with it?