Commit Graph

22 Commits

Author SHA1 Message Date
Ian Roddis
288ce28d29 Adding clang-format, and reformating all sourcecode 2021-09-21 09:41:11 -03:00
Ian Roddis
a6a7501d12 Changing how execution parallelism is handled, so that different
executors can implement their own idea of parallelism.
2021-09-15 13:05:04 -03:00
Ian Roddis
d731f9f5b1 Adding support for execution on slurm grids
- Adding support for SlurmTaskExecutor in `daggyd` if DAGGY_ENABLE_SLURM is defined.
- Renaming some test cases
- Enabling compile-time slurm support
- Adding slurm documentation
2021-09-10 10:53:58 -03:00
Ian Roddis
d15580f47f Massive re-org to allow per-executor job specification formats and executor-specific task validation and expansion.
A few different renames to try and keep things more consistent.
2021-09-03 09:10:38 -03:00
Ian Roddis
7fa47c1c4a More CI stupidity 2021-08-25 16:16:58 -03:00
Ian Roddis
6ed57806d0 - More fixes for CI failing tests 2021-08-24 07:58:58 -03:00
Ian Roddis
307cff73f8 - More fixes for CI failing tests 2021-08-23 17:58:43 -03:00
Ian Roddis
7016cb37ba - More fixes for CI failing tests 2021-08-23 17:53:47 -03:00
Ian Roddis
cf37f9a6fc - More fixes for CI failing tests 2021-08-23 17:49:04 -03:00
Ian Roddis
1bdc5dafd5 - More fixes for CI failing tests 2021-08-23 17:42:43 -03:00
Ian Roddis
d4c9b3fcee - Adjusting tests so they run without referencing /tmp 2021-08-23 17:37:33 -03:00
Ian Roddis
6b9baffe27 Changing Executor interface to allow for more flexible tasks down the road 2021-08-23 12:03:16 -03:00
Ian Roddis
9f90f54b67 - More work on DAGLoggers
- Still need unit tests for the FilesystemLogger
2021-08-13 10:23:55 -03:00
Ian Roddis
a97c3ff783 - Removing Catch2 code from codebase, will pull it via FetchContent instead.
- Changing StdOutLogger to OStreamLogger, so that test cases output can be silenced.
2021-08-09 15:48:53 -03:00
Ian Roddis
a8e85f8feb - Adding StdOutLogger and adding tests for DAG execution to verify it works.
- Roughing in FileSystemLogger
- Deleting Scheduler code and associated unit tests as being too complicated for maintenance.
- Refactoring namespaces for loggers and executors.
2021-08-09 14:59:23 -03:00
Ian Roddis
1849a2fee4 - Adding TODO list to keep track of things.
- Adding .idea to gitignore
- Adding DAG execution to utilities, redefining the logger
2021-08-05 15:24:17 -03:00
Ian Roddis
f2f3d22574 Renaming Executor to TaskEecutor 2021-08-01 11:28:30 -03:00
Ian Roddis
209ec6f380 Fixing up threadpool 2021-06-20 10:33:35 -03:00
Ian Roddis
a661125976 Changing unit test to a more standard file 2021-06-16 10:16:30 -03:00
Ian Roddis
d7b4309908 Changing unit test to a more standard file 2021-06-16 10:15:58 -03:00
Ian Roddis
40f6b283be Fixing things for programs with very large output. 2021-06-15 14:43:47 -03:00
Ian Roddis
81f0935f36 Adding local forking executor and associated tests 2021-06-15 13:38:54 -03:00