This is the final leaderboard from the competition hosted by the CVPR 2021 workshop on event-based vision. Check out the youtube video summarizing the winning approach.
Metrics: The main metric used for the ranking is the mean absolute error (MAE) of the disparity on the test set of DSEC.
We also provide the following error metrics:
- 1PE: 1-pixel-error, the percentage of ground truth pixels with disparity error > 1
- 2PE: 2-pixel-error, the percentage of ground truth pixels with disparity error > 2
- RMSE: Root mean square error of the disparity
Sensors: The competition allowed using both images (I) and events (E) to estimate disparity which was evaluated on the pixels in the rectified view of the left event camera.
Rank | Name | Sensors | Reference | MAE | 1PE | 2PE | RMSE |
---|---|---|---|---|---|---|---|
1 | EI-Stereo | E + I | report | 0.396 | 5.814 | 1.055 | 0.906 |
S. Mohammad Mostafavi I.* (1), Yeongwoo Nam* (1), Kuk-Jin Yoon (2), and Jonghyun Choi (1) * indicates equal contribution (1): Computer Vision Lab., GIST, South Korea. (2): Visual Intelligence Laboratory, Dept. Mechanical Engineering, KAIST, South Korea |
|||||||
2 | CESNet | E | report | 0.510 | 9.366 | 2.408 | 1.170 |
Hyeokjun Kweon, Jaeseok Jeong, Sung-hoon Yoon, Yujeong Chae, and Kuk-Jin Yoon Visual Intelligence Laboratory, Department of Mechanical Engineering, KAIST, Korea |
|||||||
3 | LSMonRGBE | E + I | report | 0.517 | 9.235 | 1.867 | 1.324 |
Runqiu Bao University of Tokyo |
|||||||
4 | E-Stereo | E | report | 0.529 | 9.958 | 2.645 | 1.222 |
Yeongwoo Nam* (1), S. Mohammad Mostafavi I.* (1), Kuk-Jin Yoon (2), and Jonghyun Choi (1) * indicates equal contribution (1): Computer Vision Lab., GIST, South Korea. (2): Visual Intelligence Laboratory, Dept. Mechanical Engineering, KAIST, South Korea |
|||||||
5 | TSTORE | E | report | 0.574 | 11.724 | 3.115 | 1.226 |
Ruixu Liu, R. Wes Baldwin, Vijayan Asari, and Keigo Hirakawa Department of Electrical and Computer Engineering, University of Dayton, Dayton, OH, US |
|||||||
6 | DSEC Baseline | E | report | 0.576 | 10.915 | 2.905 | 1.381 |
7 | CasStereoModel | N/A | N/A | 0.612 | 13.949 | 3.254 | 1.262 |
Yuan Wentao MEGVII-3D Research |
|||||||
8 | STADIE-Net | E | report | 1.007 | 26.769 | 9.624 | 2.024 |
Abhishek Tomy, Anshul Paigwar, Alessandro Renzaglia, and Christian Laugier Univ. Grenoble Alpes, Inria, Grenoble, France |