38 lines
1.0 KiB
Markdown
38 lines
1.0 KiB
Markdown
Tasks
|
|
==
|
|
|
|
- REST Server
|
|
- [ ] Add in authorization scheme (maybe PAM auth endpoint with JWT?)
|
|
- Core Functionality
|
|
- Allow `{{,!DATES}}` style interpolation, where values from `{{DATES}}` are preserved as a single, comma separated
|
|
list
|
|
- Improve DAG implementation
|
|
- Need to support millions of vertices
|
|
- Much faster cycle detection
|
|
- Executors
|
|
- Forking
|
|
- Add support for environment variables with `execvpe`
|
|
- Slurm
|
|
- Add support for environment variables
|
|
- Loggers
|
|
- Add in ability for loggers to be asynchronous
|
|
- Additional Methods
|
|
- Get DAG State
|
|
- Get Task Details
|
|
- Stream updates?
|
|
- Implementations
|
|
- [ ] General logger
|
|
- [ ] SQL logger (sqlite, postgres)
|
|
- [ ] Redis DAGRunLogger
|
|
- Server
|
|
- [ ] Multiple executors
|
|
- [ ] Log to general logger
|
|
- [ ] Recover on startup
|
|
- Utilities
|
|
- daggyd
|
|
- [ ] Add config file support
|
|
- [ ] Support for all the different executors / state loggers
|
|
- daggyc
|
|
- [ ] Submission
|
|
- [ ] Querying
|