Ian Roddis
288ce28d29
Adding clang-format, and reformating all sourcecode
2021-09-21 09:41:11 -03:00
Ian Roddis
a6a7501d12
Changing how execution parallelism is handled, so that different
...
executors can implement their own idea of parallelism.
2021-09-15 13:05:04 -03:00
Ian Roddis
d731f9f5b1
Adding support for execution on slurm grids
...
- Adding support for SlurmTaskExecutor in `daggyd` if DAGGY_ENABLE_SLURM is defined.
- Renaming some test cases
- Enabling compile-time slurm support
- Adding slurm documentation
2021-09-10 10:53:58 -03:00
Ian Roddis
d15580f47f
Massive re-org to allow per-executor job specification formats and executor-specific task validation and expansion.
...
A few different renames to try and keep things more consistent.
2021-09-03 09:10:38 -03:00
Ian Roddis
7fa47c1c4a
More CI stupidity
2021-08-25 16:16:58 -03:00
Ian Roddis
6ed57806d0
- More fixes for CI failing tests
2021-08-24 07:58:58 -03:00
Ian Roddis
307cff73f8
- More fixes for CI failing tests
2021-08-23 17:58:43 -03:00
Ian Roddis
7016cb37ba
- More fixes for CI failing tests
2021-08-23 17:53:47 -03:00
Ian Roddis
cf37f9a6fc
- More fixes for CI failing tests
2021-08-23 17:49:04 -03:00
Ian Roddis
1bdc5dafd5
- More fixes for CI failing tests
2021-08-23 17:42:43 -03:00
Ian Roddis
d4c9b3fcee
- Adjusting tests so they run without referencing /tmp
2021-08-23 17:37:33 -03:00
Ian Roddis
6b9baffe27
Changing Executor interface to allow for more flexible tasks down the road
2021-08-23 12:03:16 -03:00
Ian Roddis
9f90f54b67
- More work on DAGLoggers
...
- Still need unit tests for the FilesystemLogger
2021-08-13 10:23:55 -03:00
Ian Roddis
a97c3ff783
- Removing Catch2 code from codebase, will pull it via FetchContent instead.
...
- Changing StdOutLogger to OStreamLogger, so that test cases output can be silenced.
2021-08-09 15:48:53 -03:00
Ian Roddis
a8e85f8feb
- Adding StdOutLogger and adding tests for DAG execution to verify it works.
...
- Roughing in FileSystemLogger
- Deleting Scheduler code and associated unit tests as being too complicated for maintenance.
- Refactoring namespaces for loggers and executors.
2021-08-09 14:59:23 -03:00
Ian Roddis
1849a2fee4
- Adding TODO list to keep track of things.
...
- Adding .idea to gitignore
- Adding DAG execution to utilities, redefining the logger
2021-08-05 15:24:17 -03:00
Ian Roddis
f2f3d22574
Renaming Executor to TaskEecutor
2021-08-01 11:28:30 -03:00
Ian Roddis
209ec6f380
Fixing up threadpool
2021-06-20 10:33:35 -03:00
Ian Roddis
a661125976
Changing unit test to a more standard file
2021-06-16 10:16:30 -03:00
Ian Roddis
d7b4309908
Changing unit test to a more standard file
2021-06-16 10:15:58 -03:00
Ian Roddis
40f6b283be
Fixing things for programs with very large output.
2021-06-15 14:43:47 -03:00
Ian Roddis
81f0935f36
Adding local forking executor and associated tests
2021-06-15 13:38:54 -03:00