Kinesin/daggy
1
0
Fork 0
Code Issues Pull Requests Projects Releases Wiki Activity
Files
33942e2c6361512b7bc0fc8525216fab98f155c2
daggy/TODO.md
Ian Roddis 33942e2c63 Update TODO with current goals.
2021-09-22 10:43:03 -03:00

1.0 KiB
Raw Blame History

Tasks

  • REST Server
    • Add in authorization scheme (maybe PAM auth endpoint with JWT?)
  • Core Functionality
    • Allow {{,!DATES}} style interpolation, where values from {{DATES}} are preserved as a single, comma separated list
    • Improve DAG implementation
      • Need to support millions of vertices
      • Much faster cycle detection
    • Executors
      • Forking
        • Add support for environment variables with execvpe
      • Slurm
        • Add support for environment variables
    • Loggers
      • Add in ability for loggers to be asynchronous
      • Additional Methods
        • Get DAG State
        • Get Task Details
        • Stream updates?
      • Implementations
        • General logger
        • SQL logger (sqlite, postgres)
        • Redis DAGRunLogger
    • Server
      • Multiple executors
      • Log to general logger
      • Recover on startup
  • Utilities
    • daggyd
      • Add config file support
      • Support for all the different executors / state loggers
    • daggyc
      • Submission
      • Querying
Reference in New Issue View Git Blame Copy Permalink