Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Depth measurement #42

Open
hello7623 opened this issue Mar 7, 2020 · 5 comments
Open

Depth measurement #42

hello7623 opened this issue Mar 7, 2020 · 5 comments

Comments

@hello7623
Copy link

111
I have evaluated the depth model you gave ,why is it different? What might be wrong?
My device is 1080ti and the model for the evaluation is k_depth.tar, and the code used is your evaluation code

@hello7623
Copy link
Author

And I found that I could not reproduce the results of your depth model,I trained from the beginning according to the code you gave me without any changes. What might be wrong?

@JiawangBian
Copy link
Owner

  1. The first problem may be little device difference, as you can see that the results are very similar. You can report your reproduced results in future paper for fair comparison.
  2. I guess that it is related to train/val partion, but I tried several partions that give similar results. How is about your reproduced results? Is it far from the reported?

@hello7623
Copy link
Author

hello7623 commented Mar 7, 2020

I am trying again and see what happens
my last result is
1583553374(1)

@hello7623
Copy link
Author

  1. The first problem may be little device difference, as you can see that the results are very similar. You can report your reproduced results in future paper for fair comparison.
  2. I guess that it is related to train/val partion, but I tried several partions that give similar results. How is about your reproduced results? Is it far from the reported?

image
I know problem about out on this division, with the use of set, so caused some randomness, which eventually led to the final result of the randomness of different, but the repetition of your thesis is vital tomy research, because I need him as the pretrained model, so can you give me your train, val list, or do you have any other good idea?

@Rashfu
Copy link

Rashfu commented Aug 9, 2021

Hi, @JiawangBian , @hello7623 :
I also meet the problem that I could not reproduce the results of depth model in paper. The result of my reproduced model is far from the reported as follow: (I may use the different kitti train/val set)

abs_rel sq_rel rmse rmse_log a1 a2 a3
0.284 0.273 9.412 0.404 0.481 0.756 0.892

I will use the kitti256 you release and try it again

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants