Kinesin/daggy
1
0
Fork 0
Code Issues Pull Requests Projects Releases Wiki Activity
88 Commits 1 Branch 0 Tags
a83da567d0cff1726719a0586b7694d96c3d0bac
Commit Graph

38 Commits

Author SHA1 Message Date
Ian Roddis
2083b1c3f1 Refactoring RunState, fixing logic error in when to end errored DAG runs, added convenience functions to retry failed DAGs. 2021-08-20 21:44:12 -03:00
Ian Roddis
dc8ea4c369 - Adding support for state to OStreamLogger to make it more useful for test cases 
- Making runDAG return the end DAG
- Adding much more robust test for DAG execution for basic tests.
 2021-08-20 12:43:01 -03:00
Ian Roddis
1f2712b090 - Fixing issue with parameter expansion on DAG submission to server 
- Adding sections to unit_server tests
- Adding cleanup
 2021-08-20 11:11:12 -03:00
Ian Roddis
791e7a15a7 - Fixing request logic to avoid hangs when REQUIREs fail before the client has been shutdown. 2021-08-20 10:58:57 -03:00
Ian Roddis
db47bc1593 - Adding unit tests for Server 2021-08-20 10:58:57 -03:00
Ian Roddis
71344b3a2a - Sidequest: Clean up header-only library dependencies with cmake. 2021-08-20 10:58:57 -03:00
Ian Roddis
de8025e0f9 - Fixing bug that yielded empty expanded command sets. 2021-08-20 10:58:10 -03:00
Ian Roddis
1668117566 - Checkpointing work on expanding commands. 2021-08-20 10:39:39 -03:00
Ian Roddis
9f90f54b67 - More work on DAGLoggers 
- Still need unit tests for the FilesystemLogger
 2021-08-13 10:23:55 -03:00
Ian Roddis
4d519cc596 - Adding default pretty-printer for Task 
- Adding equivalency check for Task
- Adding test to ensure serialization / deserialization is reproducible.
 2021-08-11 10:16:38 -03:00
Ian Roddis
621467dd5a - Adding task serialization 
- Renaming DAGLogger to DAGRunLogger
- Adding more functionality to FileSystemLogger
 2021-08-10 11:44:56 -03:00
Ian Roddis
a97c3ff783 - Removing Catch2 code from codebase, will pull it via FetchContent instead. 
- Changing StdOutLogger to OStreamLogger, so that test cases output can be silenced.
 2021-08-09 15:48:53 -03:00
Ian Roddis
28c5b3eea3 - Adding StdOutLogger and adding tests for DAG execution to verify it works. 
- Roughing in FileSystemLogger
- Deleting Scheduler code and associated unit tests as being too complicated for maintenance.
- Refactoring namespaces for loggers and executors.
 2021-08-09 14:59:54 -03:00
Ian Roddis
a8e85f8feb - Adding StdOutLogger and adding tests for DAG execution to verify it works. 
- Roughing in FileSystemLogger
- Deleting Scheduler code and associated unit tests as being too complicated for maintenance.
- Refactoring namespaces for loggers and executors.
 2021-08-09 14:59:23 -03:00
Ian Roddis
0516bde09f - Refactoring struct (de)serialization 2021-08-09 10:33:49 -03:00
Ian Roddis
1849a2fee4 - Adding TODO list to keep track of things. 
- Adding .idea to gitignore
- Adding DAG execution to utilities, redefining the logger
 2021-08-05 15:24:17 -03:00
Ian Roddis
afcb917cc9 Completing task building. 2021-08-02 15:44:41 -03:00
Ian Roddis
54e8170c68 Adding JSON parsing helpers to Utilities. 2021-08-02 11:31:46 -03:00
Ian Roddis
f2f3d22574 Renaming Executor to TaskEecutor 2021-08-01 11:28:30 -03:00
Ian Roddis
0349a5109b * Formatting code with clang-tidy 
* Roughing in more metastore work
 2021-07-22 12:57:51 -03:00
Ian Roddis
987718334f Adding missing stdc++fs link for std::filesystem 2021-07-09 15:51:27 -03:00
Ian Roddis
a603ebead5 Scheduler now completing work 2021-07-06 11:35:30 -03:00
Ian Roddis
9b9409d504 Things mostly work, just a strange hang when executing code with forking executor 2021-07-05 15:37:29 -03:00
Ian Roddis
468993edb5 Checkpointing work 2021-07-05 11:57:38 -03:00
Ian Roddis
209ec6f380 Fixing up threadpool 2021-06-20 10:33:35 -03:00
Ian Roddis
1003e88303 adding unit test 2021-06-16 13:55:27 -03:00
Ian Roddis
a661125976 Changing unit test to a more standard file 2021-06-16 10:16:30 -03:00
Ian Roddis
d7b4309908 Changing unit test to a more standard file 2021-06-16 10:15:58 -03:00
Ian Roddis
40f6b283be Fixing things for programs with very large output. 2021-06-15 14:43:47 -03:00
Ian Roddis
81f0935f36 Adding local forking executor and associated tests 2021-06-15 13:38:54 -03:00
Ian Roddis
9cfa8cab7f Rejigging the DAG traversal so it is a bit more efficient 2021-06-11 10:20:15 -03:00
Ian Roddis
7a6dbb85c2 making test a bit more interesting 2021-06-10 09:35:53 -03:00
Ian Roddis
df854fc370 This is probably the stupidest implementation ever, but it works. To be fixed! 2021-06-09 21:52:10 -03:00
Ian Roddis
2030368c22 Adding DAG visitor and some unit tests around its function 2021-06-07 11:54:50 -03:00
Ian Roddis
315638f650 Adding rough-in for more components, pistache dependency pull 2021-06-03 17:57:56 -03:00
Ian Roddis
3d238df398 Fixing tests, roughing in iterator 2021-06-02 16:11:50 -03:00
Ian Roddis
44585ed339 Shortest path found 2021-06-02 13:55:12 -03:00
Ian Roddis
e64361c864 Initial Commit 2021-06-02 10:38:57 -03:00