Files
daggy/TODO.md
Ian Roddis d731f9f5b1 Adding support for execution on slurm grids
- Adding support for SlurmTaskExecutor in `daggyd` if DAGGY_ENABLE_SLURM is defined.
- Renaming some test cases
- Enabling compile-time slurm support
- Adding slurm documentation
2021-09-10 10:53:58 -03:00

866 B

Tasks

  • REST Server
    • Add in authorization scheme (maybe PAM auth endpoint with JWT?)
  • Core Functionality
    • rename TaskList to TaskSet
    • Add support for Task.runSpec
      • Executors can validate runspecs
      • Executors can expand runspecs
    • Allow {{,!DATES}} style interpolation, where values from {{DATES}} are preserved as a single, comma separated list
    • Loggers
      • FileSystemLogger
        • Add unit tests
        • Add more error checking
      • General logger
      • Redis DAGRunLogger
    • Server
      • Multiple execution pools
      • per-Executor parameters
  • Utilities
    • daggyd
      • Add config file support
      • Support for all the different executors / state loggers
    • daggyc
      • Submission
      • Querying