Commit Graph

237 Commits

Author SHA1 Message Date
Ian Roddis 2083b1c3f1 Refactoring RunState, fixing logic error in when to end errored DAG runs, added convenience functions to retry failed DAGs. 2021-08-20 21:44:12 -03:00
Ian Roddis dc8ea4c369 - Adding support for state to OStreamLogger to make it more useful for test cases
- Making runDAG return the end DAG
- Adding much more robust test for DAG execution for basic tests.
2021-08-20 12:43:01 -03:00
Ian Roddis 0f1f00362c - rest_server is now a complete binary, just needs more config options boilerplate. 2021-08-20 11:18:26 -03:00
Ian Roddis 1f2712b090 - Fixing issue with parameter expansion on DAG submission to server
- Adding sections to unit_server tests
- Adding cleanup
2021-08-20 11:11:12 -03:00
Ian Roddis 8fa9af95af Merge remote-tracking branch 'origin/rest_driver' into rest_driver 2021-08-20 10:59:52 -03:00
Ian Roddis 791e7a15a7 - Fixing request logic to avoid hangs when REQUIREs fail before the client has been shutdown. 2021-08-20 10:58:57 -03:00
Ian Roddis db47bc1593 - Adding unit tests for Server 2021-08-20 10:58:57 -03:00
Ian Roddis 0a2a66bc59 - Adding dagRun REST method 2021-08-20 10:58:57 -03:00
Ian Roddis ce2c0dd30f - Checkpointing work so I can switch computers. 2021-08-20 10:58:57 -03:00
Ian Roddis c1489ce967 - Checkpointing work so I can switch computers. 2021-08-20 10:58:57 -03:00
Ian Roddis 3fde95339e - Checkpointing work before I restart the IDE. 2021-08-20 10:58:57 -03:00
Ian Roddis 35857f9513 - More cmake cleanup 2021-08-20 10:58:57 -03:00
Ian Roddis 71344b3a2a - Sidequest: Clean up header-only library dependencies with cmake. 2021-08-20 10:58:57 -03:00
Ian Roddis de8025e0f9 - Fixing bug that yielded empty expanded command sets. 2021-08-20 10:58:10 -03:00
Ian Roddis 1668117566 - Checkpointing work on expanding commands. 2021-08-20 10:39:39 -03:00
Ian Roddis 6bf376984b - Fixing request logic to avoid hangs when REQUIREs fail before the client has been shutdown. 2021-08-19 14:46:57 -03:00
Ian Roddis 90f34c21b9 - Adding unit tests for Server 2021-08-19 14:23:40 -03:00
Ian Roddis 4c6bc2a540 - Adding dagRun REST method 2021-08-14 11:11:12 -03:00
Ian Roddis 2525731f5a - Checkpointing work so I can switch computers. 2021-08-14 08:36:55 -03:00
Ian Roddis a668bf81f1 - Checkpointing work so I can switch computers. 2021-08-14 08:36:49 -03:00
Ian Roddis eb8e530f9a - Checkpointing work before I restart the IDE. 2021-08-13 13:28:47 -03:00
Ian Roddis d731f8b6dc - More cmake cleanup 2021-08-13 13:21:55 -03:00
Ian Roddis dfb71b63b8 - Sidequest: Clean up header-only library dependencies with cmake. 2021-08-13 12:43:39 -03:00
Ian Roddis 9f90f54b67 - More work on DAGLoggers
- Still need unit tests for the FilesystemLogger
2021-08-13 10:23:55 -03:00
Ian Roddis 4d519cc596 - Adding default pretty-printer for Task
- Adding equivalency check for Task
- Adding test to ensure serialization / deserialization is reproducible.
2021-08-11 10:16:38 -03:00
Ian Roddis a152588368 - Making task children unordered_set to avoid multiple edges between parent and child. 2021-08-10 12:42:54 -03:00
Ian Roddis 621467dd5a - Adding task serialization
- Renaming DAGLogger to DAGRunLogger
- Adding more functionality to FileSystemLogger
2021-08-10 11:44:56 -03:00
Ian Roddis 1af9ba2124 Adding more TODOs 2021-08-09 16:32:14 -03:00
Ian Roddis a97c3ff783 - Removing Catch2 code from codebase, will pull it via FetchContent instead.
- Changing StdOutLogger to OStreamLogger, so that test cases output can be silenced.
2021-08-09 15:48:53 -03:00
Ian Roddis 9a3671aba4 - More refactoring
- Fixing cmake source discovery with GLOB_RECURSE
2021-08-09 15:24:28 -03:00
Ian Roddis 30aea0818c - Running project through clang-tidy formatter. 2021-08-09 15:07:16 -03:00
Ian Roddis 1fcdf66829 - Adjusting file layouts to match between include and src
- Updating TODO items.
2021-08-09 15:05:25 -03:00
Ian Roddis 28c5b3eea3 - Adding StdOutLogger and adding tests for DAG execution to verify it works.
- Roughing in FileSystemLogger
- Deleting Scheduler code and associated unit tests as being too complicated for maintenance.
- Refactoring namespaces for loggers and executors.
2021-08-09 14:59:54 -03:00
Ian Roddis a8e85f8feb - Adding StdOutLogger and adding tests for DAG execution to verify it works.
- Roughing in FileSystemLogger
- Deleting Scheduler code and associated unit tests as being too complicated for maintenance.
- Refactoring namespaces for loggers and executors.
2021-08-09 14:59:23 -03:00
Ian Roddis 6a2c2ddb9a Merge remote-tracking branch 'origin/daglogger' into daglogger
# Conflicts:
#	daggy/include/daggy/AttemptRecord.hpp
#	daggy/include/daggy/Utilities.hpp
2021-08-09 11:15:28 -03:00
Ian Roddis c3b88d24ac - Rebasing on master.
- Fixes so all tests pass.
2021-08-09 11:15:04 -03:00
Ian Roddis df63d944c1 Checkpointing work, while serialization / deserialization is figured out. 2021-08-09 10:39:54 -03:00
Ian Roddis 1a467428a2 - Roughing out the DAGLogger interface
- Adding spec for FileSystem Logger
2021-08-09 10:39:46 -03:00
Ian Roddis 0516bde09f - Refactoring struct (de)serialization 2021-08-09 10:33:49 -03:00
Ian Roddis 7cd9fc5e6e - Refactoring Defines
- Moving de/serialization routines to a separate header
2021-08-08 13:13:32 -03:00
Ian Roddis bea21d912f Checkpointing work, while serialization / deserialization is figured out. 2021-08-08 13:05:13 -03:00
Ian Roddis 5a3796a8a1 - Roughing out the DAGLogger interface
- Adding spec for FileSystem Logger
2021-08-08 12:22:39 -03:00
Ian Roddis 1849a2fee4 - Adding TODO list to keep track of things.
- Adding .idea to gitignore
- Adding DAG execution to utilities, redefining the logger
2021-08-05 15:24:17 -03:00
Ian Roddis 745c950280 - Adding TODO list to keep track of things.
- Adding .idea to gitignore
2021-08-02 15:50:20 -03:00
Ian Roddis afcb917cc9 Completing task building. 2021-08-02 15:44:41 -03:00
Ian Roddis a5b4e6ce42 Checkpointing progress on task builder. 2021-08-02 11:59:43 -03:00
Ian Roddis 54e8170c68 Adding JSON parsing helpers to Utilities. 2021-08-02 11:31:46 -03:00
Ian Roddis f2f3d22574 Renaming Executor to TaskEecutor 2021-08-01 11:28:30 -03:00
Ian Roddis 0349a5109b * Formatting code with clang-tidy
* Roughing in more metastore work
2021-07-22 12:57:51 -03:00
Ian Roddis 987718334f Adding missing stdc++fs link for std::filesystem 2021-07-09 15:51:27 -03:00