Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

fix: added log retention to avoid storage buildup #16

Merged
merged 1 commit into from
Oct 15, 2024

Conversation

Tedbees
Copy link
Contributor

@Tedbees Tedbees commented Oct 15, 2024

Added log retention of 50m to both miner and validator manifests

@Tedbees Tedbees marked this pull request as draft October 15, 2024 07:33
@Tedbees Tedbees marked this pull request as ready for review October 15, 2024 10:57
@jarvis8x7b jarvis8x7b merged commit 4989184 into main Oct 15, 2024
1 of 4 checks passed
Tedbees pushed a commit that referenced this pull request Oct 15, 2024
## [1.1.2](v1.1.1...v1.1.2) (2024-10-15)

### Bug Fixes

* added log retention to avoid storage buildup ([#16](#16)) ([4989184](4989184))
@Tedbees
Copy link
Contributor Author

Tedbees commented Oct 15, 2024

🎉 This PR is included in version 1.1.2 🎉

The release is available on GitHub release

Your semantic-release bot 📦🚀

@Tedbees Tedbees deleted the fix/docker-compose-updates branch October 15, 2024 19:22
jarvis8x7b added a commit that referenced this pull request Oct 16, 2024
* fix: added log retention to avoid storage buildup (#16)

* chore: EOF formatting

* fix: add batching to DB calls, refactor in memory class attrs (#14)

* chore: add TODOs

* refactor: redesign prisma schema

* refactor: use one to one relation, remove unique key

* fix: ensure 1 to many mapping of ground truth

* refactor: add is_processed flag

* refactor: async generator for batching, add mapper func

* ci: disable ci for drafts

* refactor: define custom exceptions

* refactor: update score and send feedback function

* chore: remove unused function

* fix: merged, and combine changes

* refactor: mark is_processed flag

* refactor: add custom exceptions, remove old method, double validation, slowly remove dendrite query response

* refactor: get by task id

* refactor: remove convoluted function

* refactor: only load scores, simplify validator state loading

* fix: wip on dojo task tracker's monitor completion

* refactor: remove overwrite function, rename function

* chore: ruff lint

* refactor: move save task to orm

* refactor: simplify saving validator state, nuke data manager

* refactor: remove wrongly copied code

* fix: updated monitor_task_completions_draft

* refactor: clear all TODOs

* fix: add missing store ground truth

* fix: enable cli to point to env file

* refactor: simplify task tracking

* refactor: use validator objects directly

* fix: subtensor endpoint

---------

Co-authored-by: codebender <167290009+codebender37@users.noreply.github.com>

* fix: dubious ownership issue

chore: use dev image temporarily

fix: add missing vali dendrite hotkey, catch error properly

refactor(prisma): add createdat/updatedat

perf: add exception handling for miner create task

fix: ensure consistency of datetime formats and objects, cleanup logs

* fix: added batch_id count

* fix: change validator_hotkeys logic in monitoring func

* chore: add traceback, change log level

fix: add missing criteria models

chore: add ignore min stake cli arg

fix: use correct db field, add param, add expire_at cutoff method

fix: properly determine cutoff for scoring, ensure to mark as processed

* fix: fixed consensus scoring bugs

* refactor: rename method, explicitly set expire_at

perf: remove completion responses from miner data

chore: reduce num miners to query, shorten task deadline

fix: isnan args

fix: empty completion for miners

fix: consistency between torch and numpy

* refactor: clean up TODOs, make scoring happen every hour

---------

Co-authored-by: Tedbees <161680714+Tedbees@users.noreply.github.com>
Co-authored-by: codebender <167290009+codebender37@users.noreply.github.com>
Tedbees pushed a commit that referenced this pull request Oct 16, 2024
## [1.1.3](v1.1.2...v1.1.3) (2024-10-16)

### Bug Fixes

* add batching to DB calls, refactor in memory class attrs ([#14](#14)) ([4087de9](4087de9))
* added batch_id count ([fa66ea3](fa66ea3))
* added log retention to avoid storage buildup ([#16](#16)) ([39415dd](39415dd))
* change validator_hotkeys logic in monitoring func ([066c683](066c683))
* dubious ownership issue ([1c16d1d](1c16d1d))
* fixed consensus scoring bugs ([8d8cdf8](8d8cdf8))
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants