Update TODO with current goals.

This commit is contained in:
Ian Roddis
2021-09-22 10:43:03 -03:00
parent e7b15b3847
commit 33942e2c63

53
TODO.md
View File

@@ -2,27 +2,36 @@ Tasks
== ==
- REST Server - REST Server
- [ ] Add in authorization scheme (maybe PAM auth endpoint with JWT?) - [ ] Add in authorization scheme (maybe PAM auth endpoint with JWT?)
- Core Functionality - Core Functionality
- rename TaskList to TaskSet - Allow `{{,!DATES}}` style interpolation, where values from `{{DATES}}` are preserved as a single, comma separated
- Add support for Task.runSpec list
- Executors can validate runspecs - Improve DAG implementation
- Executors can expand runspecs - Need to support millions of vertices
- Allow `{{,!DATES}}` style interpolation, where values from `{{DATES}}` are preserved as a single, comma separated - Much faster cycle detection
list - Executors
- Loggers - Forking
- [ ] FileSystemLogger - Add support for environment variables with `execvpe`
- [ ] Add unit tests - Slurm
- [ ] Add more error checking - Add support for environment variables
- [ ] General logger - Loggers
- [ ] Redis DAGRunLogger - Add in ability for loggers to be asynchronous
- Server - Additional Methods
- [ ] Multiple execution pools - Get DAG State
- [ ] per-Executor parameters - Get Task Details
- Stream updates?
- Implementations
- [ ] General logger
- [ ] SQL logger (sqlite, postgres)
- [ ] Redis DAGRunLogger
- Server
- [ ] Multiple executors
- [ ] Log to general logger
- [ ] Recover on startup
- Utilities - Utilities
- daggyd - daggyd
- [ ] Add config file support - [ ] Add config file support
- [ ] Support for all the different executors / state loggers - [ ] Support for all the different executors / state loggers
- daggyc - daggyc
- [ ] Submission - [ ] Submission
- [ ] Querying - [ ] Querying