Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

bug(scan): commands output generates a lot of data in db #195

Open
3 tasks done
psyray opened this issue Sep 5, 2024 · 0 comments
Open
3 tasks done

bug(scan): commands output generates a lot of data in db #195

psyray opened this issue Sep 5, 2024 · 0 comments
Assignees
Labels
bug Something isn't working

Comments

@psyray
Copy link
Contributor

psyray commented Sep 5, 2024

Current Behavior

Commands like nuclei, fuff or httpx generate a lot of output.
Actually those output logs are stored in the db, it's a bad idea because it slows all transactions and generates bottleneck
There are used, for example, on the dashboard page.
And it could be linked with other records for displaying a table.
...

Expected Behavior

Huge output logs must be stored on disk or truncated, and we need to monitor this and propose to clean old scan

Steps To Reproduce

Launch a scan on vulnweb.com
Export the startScan db

docker exec -it rengine-celery-1 bash -c 'poetry run -C $HOME python3 manage.py dumpdata startScan --indent 2 > startScan/fixtures/startScan.json'

Some fields have huge data in the output field
image

Environment

- reNgine: 2.1.0
- OS: 
- Python: 
- Docker Engine: 
- Docker Compose: 
- Browser:

Anything else?

No response

Acknowledgements

  • This issue is not a duplicate of an existing bug report.
  • I have chosen an appropriate title.
  • All requested information has been provided properly.
@psyray psyray added the bug Something isn't working label Sep 5, 2024
@psyray psyray added this to the v2.2.0 release milestone Sep 5, 2024
@psyray psyray self-assigned this Sep 5, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

No branches or pull requests

1 participant