Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Unexpected termination when using multiple environments #527

Open
WooChengyuuuu opened this issue Dec 1, 2023 · 2 comments
Open

Unexpected termination when using multiple environments #527

WooChengyuuuu opened this issue Dec 1, 2023 · 2 comments

Comments

@WooChengyuuuu
Copy link

Dear professor,

Thanks a lot for developing this simulation tool. Our team is planning to run simulation with 50 environments. We set parameter num_envs to 50 in yaml file. We met problems when running simulation: Only 35 environments worked. We got an unexpected termination with "Segmentation fault (core dumped)". We tried simulation with a smaller number of environments. Surprisingly, the simulation worked well.

Our team is confused now. It seems that we have some memory issue in our build of simulation. We are unsure about if the issue is caused by running too much environments. We are still working hard to try to solve this problem. If you have any idea on this problem, please tell us.

@WooChengyuuuu
Copy link
Author

I want to add some additional information. Our team just find that we could run simulation on another computer. We guess that this issue may be caused by the difference of computer. Is there any thing we missed when choosing computer to run simulation?

@jhwangbo
Copy link
Contributor

jhwangbo commented Dec 1, 2023

Its usually the GPU memory limitation. Try to lower the No. of environments and see how much gpu memory it uses

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants