Kinesin/daggy
1
0
Fork 0
Code Issues Pull Requests Projects Releases Wiki Activity
87 Commits 1 Branch 0 Tags
2083b1c3f1508dc56d3bebae3486faa78078bbc7
Commit Graph

87 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Ian Roddis
2083b1c3f1 Refactoring RunState, fixing logic error in when to end errored DAG runs, added convenience functions to retry failed DAGs. 2021-08-20 21:44:12 -03:00
Ian Roddis
dc8ea4c369 - Adding support for state to OStreamLogger to make it more useful for test cases 
- Making runDAG return the end DAG
- Adding much more robust test for DAG execution for basic tests.
 2021-08-20 12:43:01 -03:00
Ian Roddis
0f1f00362c - rest_server is now a complete binary, just needs more config options boilerplate. 2021-08-20 11:18:26 -03:00
Ian Roddis
1f2712b090 - Fixing issue with parameter expansion on DAG submission to server 
- Adding sections to unit_server tests
- Adding cleanup
 2021-08-20 11:11:12 -03:00
Ian Roddis
8fa9af95af Merge remote-tracking branch 'origin/rest_driver' into rest_driver 2021-08-20 10:59:52 -03:00
Ian Roddis
791e7a15a7 - Fixing request logic to avoid hangs when REQUIREs fail before the client has been shutdown. 2021-08-20 10:58:57 -03:00
Ian Roddis
db47bc1593 - Adding unit tests for Server 2021-08-20 10:58:57 -03:00
Ian Roddis
0a2a66bc59 - Adding dagRun REST method 2021-08-20 10:58:57 -03:00
Ian Roddis
ce2c0dd30f - Checkpointing work so I can switch computers. 2021-08-20 10:58:57 -03:00
Ian Roddis
c1489ce967 - Checkpointing work so I can switch computers. 2021-08-20 10:58:57 -03:00
Ian Roddis
3fde95339e - Checkpointing work before I restart the IDE. 2021-08-20 10:58:57 -03:00
Ian Roddis
35857f9513 - More cmake cleanup 2021-08-20 10:58:57 -03:00
Ian Roddis
71344b3a2a - Sidequest: Clean up header-only library dependencies with cmake. 2021-08-20 10:58:57 -03:00
Ian Roddis
de8025e0f9 - Fixing bug that yielded empty expanded command sets. 2021-08-20 10:58:10 -03:00
Ian Roddis
1668117566 - Checkpointing work on expanding commands. 2021-08-20 10:39:39 -03:00
Ian Roddis
6bf376984b - Fixing request logic to avoid hangs when REQUIREs fail before the client has been shutdown. 2021-08-19 14:46:57 -03:00
Ian Roddis
90f34c21b9 - Adding unit tests for Server 2021-08-19 14:23:40 -03:00
Ian Roddis
4c6bc2a540 - Adding dagRun REST method 2021-08-14 11:11:12 -03:00
Ian Roddis
2525731f5a - Checkpointing work so I can switch computers. 2021-08-14 08:36:55 -03:00
Ian Roddis
a668bf81f1 - Checkpointing work so I can switch computers. 2021-08-14 08:36:49 -03:00
Ian Roddis
eb8e530f9a - Checkpointing work before I restart the IDE. 2021-08-13 13:28:47 -03:00
Ian Roddis
d731f8b6dc - More cmake cleanup 2021-08-13 13:21:55 -03:00
Ian Roddis
dfb71b63b8 - Sidequest: Clean up header-only library dependencies with cmake. 2021-08-13 12:43:39 -03:00
Ian Roddis
9f90f54b67 - More work on DAGLoggers 
- Still need unit tests for the FilesystemLogger
 2021-08-13 10:23:55 -03:00
Ian Roddis
4d519cc596 - Adding default pretty-printer for Task 
- Adding equivalency check for Task
- Adding test to ensure serialization / deserialization is reproducible.
 2021-08-11 10:16:38 -03:00
Ian Roddis
a152588368 - Making task children unordered_set to avoid multiple edges between parent and child. 2021-08-10 12:42:54 -03:00
Ian Roddis
621467dd5a - Adding task serialization 
- Renaming DAGLogger to DAGRunLogger
- Adding more functionality to FileSystemLogger
 2021-08-10 11:44:56 -03:00
Ian Roddis
1af9ba2124 Adding more TODOs 2021-08-09 16:32:14 -03:00
Ian Roddis
a97c3ff783 - Removing Catch2 code from codebase, will pull it via FetchContent instead. 
- Changing StdOutLogger to OStreamLogger, so that test cases output can be silenced.
 2021-08-09 15:48:53 -03:00
Ian Roddis
9a3671aba4 - More refactoring 
- Fixing cmake source discovery with GLOB_RECURSE
 2021-08-09 15:24:28 -03:00
Ian Roddis
30aea0818c - Running project through clang-tidy formatter. 2021-08-09 15:07:16 -03:00
Ian Roddis
1fcdf66829 - Adjusting file layouts to match between include and src 
- Updating TODO items.
 2021-08-09 15:05:25 -03:00
Ian Roddis
28c5b3eea3 - Adding StdOutLogger and adding tests for DAG execution to verify it works. 
- Roughing in FileSystemLogger
- Deleting Scheduler code and associated unit tests as being too complicated for maintenance.
- Refactoring namespaces for loggers and executors.
 2021-08-09 14:59:54 -03:00
Ian Roddis
a8e85f8feb - Adding StdOutLogger and adding tests for DAG execution to verify it works. 
- Roughing in FileSystemLogger
- Deleting Scheduler code and associated unit tests as being too complicated for maintenance.
- Refactoring namespaces for loggers and executors.
 2021-08-09 14:59:23 -03:00
Ian Roddis
6a2c2ddb9a Merge remote-tracking branch 'origin/daglogger' into daglogger 
# Conflicts:
#	daggy/include/daggy/AttemptRecord.hpp
#	daggy/include/daggy/Utilities.hpp
 2021-08-09 11:15:28 -03:00
Ian Roddis
c3b88d24ac - Rebasing on master. 
- Fixes so all tests pass.
 2021-08-09 11:15:04 -03:00
Ian Roddis
df63d944c1 Checkpointing work, while serialization / deserialization is figured out. 2021-08-09 10:39:54 -03:00
Ian Roddis
1a467428a2 - Roughing out the DAGLogger interface 
- Adding spec for FileSystem Logger
 2021-08-09 10:39:46 -03:00
Ian Roddis
0516bde09f - Refactoring struct (de)serialization 2021-08-09 10:33:49 -03:00
Ian Roddis
7cd9fc5e6e - Refactoring Defines 
- Moving de/serialization routines to a separate header
 2021-08-08 13:13:32 -03:00
Ian Roddis
bea21d912f Checkpointing work, while serialization / deserialization is figured out. 2021-08-08 13:05:13 -03:00
Ian Roddis
5a3796a8a1 - Roughing out the DAGLogger interface 
- Adding spec for FileSystem Logger
 2021-08-08 12:22:39 -03:00
Ian Roddis
1849a2fee4 - Adding TODO list to keep track of things. 
- Adding .idea to gitignore
- Adding DAG execution to utilities, redefining the logger
 2021-08-05 15:24:17 -03:00
Ian Roddis
745c950280 - Adding TODO list to keep track of things. 
- Adding .idea to gitignore
 2021-08-02 15:50:20 -03:00
Ian Roddis
afcb917cc9 Completing task building. 2021-08-02 15:44:41 -03:00
Ian Roddis
a5b4e6ce42 Checkpointing progress on task builder. 2021-08-02 11:59:43 -03:00
Ian Roddis
54e8170c68 Adding JSON parsing helpers to Utilities. 2021-08-02 11:31:46 -03:00
Ian Roddis
f2f3d22574 Renaming Executor to TaskEecutor 2021-08-01 11:28:30 -03:00
Ian Roddis
0349a5109b * Formatting code with clang-tidy 
* Roughing in more metastore work
 2021-07-22 12:57:51 -03:00
Ian Roddis
987718334f Adding missing stdc++fs link for std::filesystem 2021-07-09 15:51:27 -03:00