Kinesin/daggy
1
0
Fork 0
Code Issues Pull Requests Projects Releases Wiki Activity
241 Commits 1 Branch 0 Tags
master
Commit Graph

241 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Ian Roddis
5b8d5fabe8 - Fixing errors in JSON 2021-08-23 14:18:16 -03:00
Ian Roddis
808a7f9af4 - Adding more documentation 
- Renaming "parameters" to "taskParameters" for clarity, and to distinguish from "executionParameters" that will be implemented down the road.
 2021-08-23 14:17:22 -03:00
Ian Roddis
6b9baffe27 Changing Executor interface to allow for more flexible tasks down the road 2021-08-23 12:03:16 -03:00
Ian Roddis
a83da567d0 - Updating TODOs 
- Adding jwt-cpp dependency (not really related to dag_execution)
 2021-08-21 12:18:01 -03:00
Ian Roddis
2083b1c3f1 Refactoring RunState, fixing logic error in when to end errored DAG runs, added convenience functions to retry failed DAGs. 2021-08-20 21:44:12 -03:00
Ian Roddis
dc8ea4c369 - Adding support for state to OStreamLogger to make it more useful for test cases 
- Making runDAG return the end DAG
- Adding much more robust test for DAG execution for basic tests.
 2021-08-20 12:43:01 -03:00
Ian Roddis
0f1f00362c - rest_server is now a complete binary, just needs more config options boilerplate. 2021-08-20 11:18:26 -03:00
Ian Roddis
1f2712b090 - Fixing issue with parameter expansion on DAG submission to server 
- Adding sections to unit_server tests
- Adding cleanup
 2021-08-20 11:11:12 -03:00
Ian Roddis
8fa9af95af Merge remote-tracking branch 'origin/rest_driver' into rest_driver 2021-08-20 10:59:52 -03:00
Ian Roddis
791e7a15a7 - Fixing request logic to avoid hangs when REQUIREs fail before the client has been shutdown. 2021-08-20 10:58:57 -03:00
Ian Roddis
db47bc1593 - Adding unit tests for Server 2021-08-20 10:58:57 -03:00
Ian Roddis
0a2a66bc59 - Adding dagRun REST method 2021-08-20 10:58:57 -03:00
Ian Roddis
ce2c0dd30f - Checkpointing work so I can switch computers. 2021-08-20 10:58:57 -03:00
Ian Roddis
c1489ce967 - Checkpointing work so I can switch computers. 2021-08-20 10:58:57 -03:00
Ian Roddis
3fde95339e - Checkpointing work before I restart the IDE. 2021-08-20 10:58:57 -03:00
Ian Roddis
35857f9513 - More cmake cleanup 2021-08-20 10:58:57 -03:00
Ian Roddis
71344b3a2a - Sidequest: Clean up header-only library dependencies with cmake. 2021-08-20 10:58:57 -03:00
Ian Roddis
de8025e0f9 - Fixing bug that yielded empty expanded command sets. 2021-08-20 10:58:10 -03:00
Ian Roddis
1668117566 - Checkpointing work on expanding commands. 2021-08-20 10:39:39 -03:00
Ian Roddis
6bf376984b - Fixing request logic to avoid hangs when REQUIREs fail before the client has been shutdown. 2021-08-19 14:46:57 -03:00
Ian Roddis
90f34c21b9 - Adding unit tests for Server 2021-08-19 14:23:40 -03:00
Ian Roddis
4c6bc2a540 - Adding dagRun REST method 2021-08-14 11:11:12 -03:00
Ian Roddis
2525731f5a - Checkpointing work so I can switch computers. 2021-08-14 08:36:55 -03:00
Ian Roddis
a668bf81f1 - Checkpointing work so I can switch computers. 2021-08-14 08:36:49 -03:00
Ian Roddis
eb8e530f9a - Checkpointing work before I restart the IDE. 2021-08-13 13:28:47 -03:00
Ian Roddis
d731f8b6dc - More cmake cleanup 2021-08-13 13:21:55 -03:00
Ian Roddis
dfb71b63b8 - Sidequest: Clean up header-only library dependencies with cmake. 2021-08-13 12:43:39 -03:00
Ian Roddis
9f90f54b67 - More work on DAGLoggers 
- Still need unit tests for the FilesystemLogger
 2021-08-13 10:23:55 -03:00
Ian Roddis
4d519cc596 - Adding default pretty-printer for Task 
- Adding equivalency check for Task
- Adding test to ensure serialization / deserialization is reproducible.
 2021-08-11 10:16:38 -03:00
Ian Roddis
a152588368 - Making task children unordered_set to avoid multiple edges between parent and child. 2021-08-10 12:42:54 -03:00
Ian Roddis
621467dd5a - Adding task serialization 
- Renaming DAGLogger to DAGRunLogger
- Adding more functionality to FileSystemLogger
 2021-08-10 11:44:56 -03:00
Ian Roddis
1af9ba2124 Adding more TODOs 2021-08-09 16:32:14 -03:00
Ian Roddis
a97c3ff783 - Removing Catch2 code from codebase, will pull it via FetchContent instead. 
- Changing StdOutLogger to OStreamLogger, so that test cases output can be silenced.
 2021-08-09 15:48:53 -03:00
Ian Roddis
9a3671aba4 - More refactoring 
- Fixing cmake source discovery with GLOB_RECURSE
 2021-08-09 15:24:28 -03:00
Ian Roddis
30aea0818c - Running project through clang-tidy formatter. 2021-08-09 15:07:16 -03:00
Ian Roddis
1fcdf66829 - Adjusting file layouts to match between include and src 
- Updating TODO items.
 2021-08-09 15:05:25 -03:00
Ian Roddis
28c5b3eea3 - Adding StdOutLogger and adding tests for DAG execution to verify it works. 
- Roughing in FileSystemLogger
- Deleting Scheduler code and associated unit tests as being too complicated for maintenance.
- Refactoring namespaces for loggers and executors.
 2021-08-09 14:59:54 -03:00
Ian Roddis
a8e85f8feb - Adding StdOutLogger and adding tests for DAG execution to verify it works. 
- Roughing in FileSystemLogger
- Deleting Scheduler code and associated unit tests as being too complicated for maintenance.
- Refactoring namespaces for loggers and executors.
 2021-08-09 14:59:23 -03:00
Ian Roddis
6a2c2ddb9a Merge remote-tracking branch 'origin/daglogger' into daglogger 
# Conflicts:
#	daggy/include/daggy/AttemptRecord.hpp
#	daggy/include/daggy/Utilities.hpp
 2021-08-09 11:15:28 -03:00
Ian Roddis
c3b88d24ac - Rebasing on master. 
- Fixes so all tests pass.
 2021-08-09 11:15:04 -03:00
Ian Roddis
df63d944c1 Checkpointing work, while serialization / deserialization is figured out. 2021-08-09 10:39:54 -03:00
Ian Roddis
1a467428a2 - Roughing out the DAGLogger interface 
- Adding spec for FileSystem Logger
 2021-08-09 10:39:46 -03:00
Ian Roddis
0516bde09f - Refactoring struct (de)serialization 2021-08-09 10:33:49 -03:00
Ian Roddis
7cd9fc5e6e - Refactoring Defines 
- Moving de/serialization routines to a separate header
 2021-08-08 13:13:32 -03:00
Ian Roddis
bea21d912f Checkpointing work, while serialization / deserialization is figured out. 2021-08-08 13:05:13 -03:00
Ian Roddis
5a3796a8a1 - Roughing out the DAGLogger interface 
- Adding spec for FileSystem Logger
 2021-08-08 12:22:39 -03:00
Ian Roddis
1849a2fee4 - Adding TODO list to keep track of things. 
- Adding .idea to gitignore
- Adding DAG execution to utilities, redefining the logger
 2021-08-05 15:24:17 -03:00
Ian Roddis
745c950280 - Adding TODO list to keep track of things. 
- Adding .idea to gitignore
 2021-08-02 15:50:20 -03:00
Ian Roddis
afcb917cc9 Completing task building. 2021-08-02 15:44:41 -03:00
Ian Roddis
a5b4e6ce42 Checkpointing progress on task builder. 2021-08-02 11:59:43 -03:00