- Adding daemonization for daggyd

- Changing how parameter keys are stored in the map to allow for future key handling.
This commit is contained in:
Ian Roddis
2021-09-01 13:32:16 -03:00
parent 4e71bf5917
commit e746f8c163
6 changed files with 158 additions and 32 deletions

21
TODO.md
View File

@@ -4,11 +4,9 @@ Tasks
- Open
- REST Server
- [ ] Add in authorization scheme (maybe PAM auth endpoint with JWT?)
- [ ] Flesh out server and interface
- Core Functionality
- Allow `{{,!DATES}}` style interpolation, where values from `{{DATES}}` are preserved as a single, comma
separated list
- Add execution gates
- Executors
- [ ] Slurm Executor
- Loggers
@@ -17,12 +15,13 @@ Tasks
- [ ] Add more error checking
- [ ] General logger
- [ ] Redis DAGRunLogger
- Completed
- Core Functionality
- [X] Add ability to define child -> parent relationships
- [X] Rip apart scheduler and re-implement runDag as a utility function, taking an execution pool, task list,
and logger
- [X] Resume a failed DAG
- [X] Handle return on errored DAG / Task
- [X] Clearing a DAG Task
- Server
- [ ] Multiple execution pools
- [ ] per-Executor parameters
- Utilities
- daggyd
- [ ] Add config file support
- [ ] Support for all the different executors / state loggers
- daggyc
- [ ] Submission
- [ ] Querying