Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Feature]: Compress Logs During Rotation #38520

Open
1 task done
dreece-surefire opened this issue Jan 7, 2025 · 0 comments
Open
1 task done

[Feature]: Compress Logs During Rotation #38520

dreece-surefire opened this issue Jan 7, 2025 · 0 comments
Assignees
Labels
DevOps Pod Issues related to devops Enhancement New feature or request Supervisor Issues related to supervisor

Comments

@dreece-surefire
Copy link

Is there an existing issue for this?

  • I have searched the existing issues

Summary

Log files are currently not compressed during rotation, resulting in higher disk space usage. Implementing compression (e.g., gzip) for rotated logs would significantly reduce storage requirements while maintaining accessibility of historical log data.

Why should this be worked on?

Running Appsmith on a resource-constrained 30GB AWS drive requires careful storage management. Recently discovered uncompressed rotated supervisord logs consuming over 500MB (10 files at 51MB each), highlighting the need for log compression to prevent storage issues and maintain system stability.

root@appsmith:/appsmith-stacks/logs# ll supervisor/ -h
total 361M
drwxr-xr-x  2 root root 4.0K Jan  6 09:41 ./
drwxr-xr-x 14 root root 4.0K May 30  2024 ../
-rw-r--r--  1 root root  11M Jan  6 10:02 stdout-stdout---supervisor-wcx5ub0k.log
-rw-r--r--  1 root root  51M Jan  6 07:27 stdout-stdout---supervisor-wcx5ub0k.log.1
-rw-r--r--  1 root root  51M Jan  5 13:07 stdout-stdout---supervisor-wcx5ub0k.log.2
-rw-r--r--  1 root root  51M Jan  4 19:05 stdout-stdout---supervisor-wcx5ub0k.log.3
-rw-r--r--  1 root root  51M Jan  4 01:32 stdout-stdout---supervisor-wcx5ub0k.log.4
-rw-r--r--  1 root root  51M Jan  3 13:49 stdout-stdout---supervisor-wcx5ub0k.log.5
-rw-r--r--  1 root root  51M Jan  3 02:44 stdout-stdout---supervisor-wcx5ub0k.log.6
-rw-r--r--  1 root root  51M Jan  2 12:39 stdout-stdout---supervisor-wcx5ub0k.log.7
-rw-r--r--  1 root root 302K Jan  6 09:26 supervisord.log
@dreece-surefire dreece-surefire added the Enhancement New feature or request label Jan 7, 2025
@LagunaElectric LagunaElectric added the Supervisor Issues related to supervisor label Jan 7, 2025
@github-actions github-actions bot added the DevOps Pod Issues related to devops label Jan 7, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
DevOps Pod Issues related to devops Enhancement New feature or request Supervisor Issues related to supervisor
Projects
None yet
Development

No branches or pull requests

5 participants