Kinesin/daggy
1
0
Fork 0
Code Issues Pull Requests Projects Releases Wiki Activity
65 Commits 1 Branch 0 Tags
166811756602d363ecdcbe671a265e9bc22b9d41
Commit Graph

65 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Ian Roddis
1668117566 - Checkpointing work on expanding commands. 2021-08-20 10:39:39 -03:00
Ian Roddis
9f90f54b67 - More work on DAGLoggers 
- Still need unit tests for the FilesystemLogger
 2021-08-13 10:23:55 -03:00
Ian Roddis
4d519cc596 - Adding default pretty-printer for Task 
- Adding equivalency check for Task
- Adding test to ensure serialization / deserialization is reproducible.
 2021-08-11 10:16:38 -03:00
Ian Roddis
a152588368 - Making task children unordered_set to avoid multiple edges between parent and child. 2021-08-10 12:42:54 -03:00
Ian Roddis
621467dd5a - Adding task serialization 
- Renaming DAGLogger to DAGRunLogger
- Adding more functionality to FileSystemLogger
 2021-08-10 11:44:56 -03:00
Ian Roddis
1af9ba2124 Adding more TODOs 2021-08-09 16:32:14 -03:00
Ian Roddis
a97c3ff783 - Removing Catch2 code from codebase, will pull it via FetchContent instead. 
- Changing StdOutLogger to OStreamLogger, so that test cases output can be silenced.
 2021-08-09 15:48:53 -03:00
Ian Roddis
9a3671aba4 - More refactoring 
- Fixing cmake source discovery with GLOB_RECURSE
 2021-08-09 15:24:28 -03:00
Ian Roddis
30aea0818c - Running project through clang-tidy formatter. 2021-08-09 15:07:16 -03:00
Ian Roddis
1fcdf66829 - Adjusting file layouts to match between include and src 
- Updating TODO items.
 2021-08-09 15:05:25 -03:00
Ian Roddis
28c5b3eea3 - Adding StdOutLogger and adding tests for DAG execution to verify it works. 
- Roughing in FileSystemLogger
- Deleting Scheduler code and associated unit tests as being too complicated for maintenance.
- Refactoring namespaces for loggers and executors.
 2021-08-09 14:59:54 -03:00
Ian Roddis
a8e85f8feb - Adding StdOutLogger and adding tests for DAG execution to verify it works. 
- Roughing in FileSystemLogger
- Deleting Scheduler code and associated unit tests as being too complicated for maintenance.
- Refactoring namespaces for loggers and executors.
 2021-08-09 14:59:23 -03:00
Ian Roddis
6a2c2ddb9a Merge remote-tracking branch 'origin/daglogger' into daglogger 
# Conflicts:
#	daggy/include/daggy/AttemptRecord.hpp
#	daggy/include/daggy/Utilities.hpp
 2021-08-09 11:15:28 -03:00
Ian Roddis
c3b88d24ac - Rebasing on master. 
- Fixes so all tests pass.
 2021-08-09 11:15:04 -03:00
Ian Roddis
df63d944c1 Checkpointing work, while serialization / deserialization is figured out. 2021-08-09 10:39:54 -03:00
Ian Roddis
1a467428a2 - Roughing out the DAGLogger interface 
- Adding spec for FileSystem Logger
 2021-08-09 10:39:46 -03:00
Ian Roddis
0516bde09f - Refactoring struct (de)serialization 2021-08-09 10:33:49 -03:00
Ian Roddis
7cd9fc5e6e - Refactoring Defines 
- Moving de/serialization routines to a separate header
 2021-08-08 13:13:32 -03:00
Ian Roddis
bea21d912f Checkpointing work, while serialization / deserialization is figured out. 2021-08-08 13:05:13 -03:00
Ian Roddis
5a3796a8a1 - Roughing out the DAGLogger interface 
- Adding spec for FileSystem Logger
 2021-08-08 12:22:39 -03:00
Ian Roddis
1849a2fee4 - Adding TODO list to keep track of things. 
- Adding .idea to gitignore
- Adding DAG execution to utilities, redefining the logger
 2021-08-05 15:24:17 -03:00
Ian Roddis
745c950280 - Adding TODO list to keep track of things. 
- Adding .idea to gitignore
 2021-08-02 15:50:20 -03:00
Ian Roddis
afcb917cc9 Completing task building. 2021-08-02 15:44:41 -03:00
Ian Roddis
a5b4e6ce42 Checkpointing progress on task builder. 2021-08-02 11:59:43 -03:00
Ian Roddis
54e8170c68 Adding JSON parsing helpers to Utilities. 2021-08-02 11:31:46 -03:00
Ian Roddis
f2f3d22574 Renaming Executor to TaskEecutor 2021-08-01 11:28:30 -03:00
Ian Roddis
0349a5109b * Formatting code with clang-tidy 
* Roughing in more metastore work
 2021-07-22 12:57:51 -03:00
Ian Roddis
987718334f Adding missing stdc++fs link for std::filesystem 2021-07-09 15:51:27 -03:00
Ian Roddis
a603ebead5 Scheduler now completing work 2021-07-06 11:35:30 -03:00
Ian Roddis
9b9409d504 Things mostly work, just a strange hang when executing code with forking executor 2021-07-05 15:37:29 -03:00
Ian Roddis
468993edb5 Checkpointing work 2021-07-05 11:57:38 -03:00
Ian Roddis
b7b8d5b6a1 Checkpointing work 2021-06-20 12:05:13 -03:00
Ian Roddis
60cab3d5e0 Adding better implementation note 2021-06-20 10:34:48 -03:00
Ian Roddis
209ec6f380 Fixing up threadpool 2021-06-20 10:33:35 -03:00
Ian Roddis
1003e88303 adding unit test 2021-06-16 13:55:27 -03:00
Ian Roddis
5e3098c5f9 Checkpoint 2021-06-16 13:55:17 -03:00
Ian Roddis
01517f3421 adding futures 2021-06-16 10:51:38 -03:00
Ian Roddis
d871572d5e Checkpointing work on first-pass implementation 2021-06-16 10:48:31 -03:00
Ian Roddis
a661125976 Changing unit test to a more standard file 2021-06-16 10:16:30 -03:00
Ian Roddis
d7b4309908 Changing unit test to a more standard file 2021-06-16 10:15:58 -03:00
Ian Roddis
46118ce503 Fixing compiler errors and scheduler interface 2021-06-16 10:08:00 -03:00
Ian Roddis
e44b7c4e8f Roughing in more scheduler and threadpool 2021-06-16 07:36:17 -03:00
Ian Roddis
40f6b283be Fixing things for programs with very large output. 2021-06-15 14:43:47 -03:00
Ian Roddis
81f0935f36 Adding local forking executor and associated tests 2021-06-15 13:38:54 -03:00
Ian Roddis
2cfe3e21d5 checkpointing 2021-06-13 09:29:48 -03:00
Ian Roddis
9cfa8cab7f Rejigging the DAG traversal so it is a bit more efficient 2021-06-11 10:20:15 -03:00
Ian Roddis
7a6dbb85c2 making test a bit more interesting 2021-06-10 09:35:53 -03:00
Ian Roddis
df854fc370 This is probably the stupidest implementation ever, but it works. To be fixed! 2021-06-09 21:52:10 -03:00
Ian Roddis
2030368c22 Adding DAG visitor and some unit tests around its function 2021-06-07 11:54:50 -03:00
Ian Roddis
e36b3a2012 checkpoint 2021-06-05 19:56:40 -03:00