Kinesin/daggy
1
0
Fork 0
Code Issues Pull Requests Projects Releases Wiki Activity

Commit Graph

  • d4b79c48b0 Adding claude directive master Ian Roddis 2025-05-31 10:13:54 -03:00
  • 0e0406c425 Adding unit test Ian Roddis 2025-05-31 10:13:32 -03:00
  • ddca9d3b72 Adding JWT token auth Ian Roddis 2025-05-31 10:13:09 -03:00
  • 539dcebbe1 Relicensing to AGPL Kinesin Data Technologies Incorporated 2023-08-13 11:26:07 -03:00
  • d51d772929 Merge branch 'master' of ssh://gitlab.com/iroddis/daggy Ian Roddis 2022-03-16 08:14:55 -03:00
  • 84f4c00a0c Fixing sorting for states and names Ian Roddis 2022-03-16 08:14:46 -03:00
  • 0ef9738f2e Adding more robust checking for json parsing Ian Roddis 2022-03-07 09:57:41 -04:00
  • e924e065a2 forcing light scheme Ian Roddis 2022-02-28 11:07:58 -04:00
  • 086f29b054 Changing preferences for dark theme Ian Roddis 2022-02-28 10:20:32 -04:00
  • e13cf512b7 Removing stdout line Ian Roddis 2022-02-28 10:07:20 -04:00
  • 197af4c76a Making task endpoint a bit more useful, including state changes and attempts Ian Roddis 2022-02-25 14:17:36 -04:00
  • 7510fc288d Reducing fontsize for pre tags, adding snappier updates when changing refresh rate or base url Ian Roddis 2022-02-24 11:59:37 -04:00
  • 9de8165aae Reducing font size Ian Roddis 2022-02-24 11:56:19 -04:00
  • 2be0f22c71 Adding header Ian Roddis 2022-02-24 11:52:10 -04:00
  • 694ae62c55 CSS override to make accent colour grey Ian Roddis 2022-02-24 11:51:28 -04:00
  • 0603285c10 Adding Vue.js webui Ian Roddis 2022-02-24 11:40:18 -04:00
  • 93ab2f38c9 Adding fix for uninitialized char * Ian Roddis 2022-02-24 10:46:52 -04:00
  • 4e5ca633d8 Adding error messaging when failing to execvpe Ian Roddis 2022-02-23 21:36:48 -04:00
  • 0b195da309 Making response a JSON object with trailing newline Ian Roddis 2022-02-23 13:51:01 -04:00
  • 3822426446 Adding check for unsatisfyable requirements in a remote task Ian Roddis 2022-02-23 13:34:28 -04:00
  • 6389f1a508 fixing up rst Ian Roddis 2022-02-22 10:36:34 -04:00
  • b63739c0a9 Adding StopTask endpoint and endpoint documentation Ian Roddis 2022-02-22 10:32:31 -04:00
  • 0ee198e3e7 Fixing issue building dag with states where states were not properly transfered Ian Roddis 2022-02-16 14:33:04 -04:00
  • 3866332e77 Reverting to rapidjson for attempt record serialization Ian Roddis 2022-02-16 10:06:48 -04:00
  • 71756d9ec2 Fixing daggyr issues when reporting on tasks with very large outputs (>10kb). Ian Roddis 2022-02-15 11:22:21 -04:00
  • 0d365f3a7b Increasing curl timeout Ian Roddis 2022-02-11 22:29:27 -04:00
  • 80cca0d6bf removing cout statement Ian Roddis 2022-02-11 13:12:08 -04:00
  • f08b17317c Simplifying code Ian Roddis 2022-02-11 13:09:01 -04:00
  • 443bc789cf Unlocking unique lock to prevent one bad agent stalling the rest Ian Roddis 2022-02-11 13:06:20 -04:00
  • 6aab7be0a1 Same without buttons Ian Roddis 2022-02-10 17:18:27 -04:00
  • 015c3a3e04 Adding in minimal js to resubmit jobs, still need to get functionality working Ian Roddis 2022-02-10 17:15:11 -04:00
  • 0fba67adce Making logging to stdout the default. To disable logging use --log-level NONE Ian Roddis 2022-02-04 12:47:01 -04:00
  • 61e392cba3 Fixing unit tests, fixing cmake so make test works properly Ian Roddis 2022-02-04 12:36:15 -04:00
  • ea3f67f226 Adding a general logger and integrating it with daggyr Ian Roddis 2022-02-04 11:58:45 -04:00
  • 57e93b5045 Simplifying daggyr server, and returning to a task submit / task poll model. Ian Roddis 2022-02-02 21:12:05 -04:00
  • c9bfce31e6 I cannot type today Ian Roddis 2022-02-01 13:38:08 -04:00
  • b3397381dc Fixing logic error in submission batches Ian Roddis 2022-02-01 13:34:19 -04:00
  • df108dfd28 Increasing curl timeout Ian Roddis 2022-02-01 11:02:33 -04:00
  • cc7646f386 Adding delete method Ian Roddis 2022-02-01 10:32:31 -04:00
  • 3fdd568b00 Adding samples Ian Roddis 2022-01-29 13:25:40 -04:00
  • e3a6c9086a Removing verbose logging Ian Roddis 2022-01-28 14:36:33 -04:00
  • 782e6a8b97 Changing behaviour of runner to submit at most MAX_SUBMITS for execution before checking for completed tasks Ian Roddis 2022-01-28 14:28:46 -04:00
  • 5af8deabec Making DaggyTaskRunner block until a runner is available Ian Roddis 2022-01-28 14:18:01 -04:00
  • cbd493ec38 Fixing issue with daggyd config parsing Ian Roddis 2022-01-28 13:28:29 -04:00
  • c9820c19a0 Small fixes to test cases Ian Roddis 2022-01-28 10:23:21 -04:00
  • c09d5b7d8b Adding in queuing in the daggyd process for more even distribution Ian Roddis 2022-01-13 16:17:43 -04:00
  • 070d2ceddf Adding support for environment variables Ian Roddis 2022-01-18 10:54:25 -04:00
  • 2784aeee28 Adding in check for cores and memoryMB Ian Roddis 2022-01-14 15:48:06 -04:00
  • 07646de2cd Adding SSH executor Ian Roddis 2022-01-14 15:39:57 -04:00
  • 9e7d78788b Fixing issue in dagrunner where tasks were never removed from running list Ian Roddis 2022-01-13 12:52:00 -04:00
  • 854ca5be22 Reducing the scope of a lock Ian Roddis 2022-01-13 10:49:09 -04:00
  • 3f5d31e036 Removing needless second map lookup Ian Roddis 2022-01-12 19:59:10 -04:00
  • c143034c00 Implementing a redirect for a GET on / to list of dagruns Ian Roddis 2022-01-12 15:17:00 -04:00
  • 868e74fbeb Seems to work now Ian Roddis 2022-01-12 13:11:55 -04:00
  • 9a5a247f15 Checkpointing work Ian Roddis 2022-01-12 12:50:46 -04:00
  • 04e95cfcf3 Making fork process more descriptive in the case of failure Ian Roddis 2022-01-10 13:12:19 -04:00
  • 7312776e39 Fixing issue with logic for daggyr submission Ian Roddis 2022-01-10 13:09:11 -04:00
  • 53308c063d Fixing a number of scaling issues: - Missed closing of file descriptor made ForkingTaskExecutor silently die after running out of FDs - Tightened up scope for locks to prevent http timeout - Simplified threadpool Ian Roddis 2022-01-10 13:02:10 -04:00
  • efd4078f70 Adding executor log to output Ian Roddis 2022-01-07 17:40:07 -04:00
  • db6fd64601 Fixing dagrun counts Ian Roddis 2022-01-07 17:38:29 -04:00
  • d58dc2fc35 Removing ability for multiple servers to listen to the same address Ian Roddis 2022-01-07 16:31:07 -04:00
  • 58604d98cd Removing extra prints Ian Roddis 2022-01-07 16:14:39 -04:00
  • 6ed15b17b2 Fixing issue with querying dag as json Ian Roddis 2022-01-07 16:13:12 -04:00
  • f9076be081 Adding fix for race condition in task resource management Ian Roddis 2022-01-07 16:00:04 -04:00
  • 4da78c9dd6 Adding executor description for verbose output, adding output directory for build artifacts Ian Roddis 2022-01-07 14:37:06 -04:00
  • 856e5bd2f4 Adding in task attempts drilldown Ian Roddis 2022-01-06 15:20:06 -04:00
  • 1786b53f7b Fixing sample dag Ian Roddis 2022-01-04 17:05:45 -04:00
  • 64a85cd996 Updating example dag Ian Roddis 2022-01-04 17:03:42 -04:00
  • f1479a72d9 Fixing test cases on daggyr for new polling Ian Roddis 2022-01-04 17:03:11 -04:00
  • 5a4c6d0756 Fixing invalid URL Ian Roddis 2021-12-30 14:32:43 -04:00
  • a4b26bce04 Handling http errors a bit more gracefully Ian Roddis 2021-12-30 14:29:56 -04:00
  • d9479f14e0 Adding in check for no such file Ian Roddis 2021-12-30 14:06:28 -04:00
  • ac490b6f3e Adding html output Ian Roddis 2021-12-30 13:44:17 -04:00
  • 509a1fcd23 Fixing argument parsing for integers Ian Roddis 2021-12-27 22:15:16 -04:00
  • 3c6966a9ac Adding discovery of capacities after the fact. Ian Roddis 2021-12-24 10:52:06 -04:00
  • 8ca5cdafe2 Fixing issue with resolving Ian Roddis 2021-12-24 10:44:19 -04:00
  • d832b935d7 Moving to a poll method for workers, and daggyd-preserved capacities Ian Roddis 2021-12-24 10:22:58 -04:00
  • 779d6adaea Moving to a poll method for workers, and daggyd-preserved capacities Ian Roddis 2021-12-24 10:21:19 -04:00
  • 0914ede8fb Fixing test, since executor now autovivifies certain job attributes Ian Roddis 2021-12-23 11:50:16 -04:00
  • dd473ab8f0 Adjusting capacity impact calculation to yield a more even distribution of jobs Ian Roddis 2021-12-23 11:47:55 -04:00
  • 85d252f43c Small bug fixes Ian Roddis 2021-12-21 17:23:58 -04:00
  • d90f49b2bb Lots of fixes to poor daggyr implementation, added debugging messages Ian Roddis 2021-12-21 16:49:45 -04:00
  • 505ffb02bd Incorporating ifdefs for features in daggyd Ian Roddis 2021-12-16 15:18:29 -04:00
  • 2d35d6ed4a Making features opt-in Ian Roddis 2021-12-16 14:17:44 -04:00
  • a035010669 Fixing feature checking Ian Roddis 2021-12-16 14:17:03 -04:00
  • 8d00621908 Adding support for remote execution daemons. Ian Roddis 2021-12-16 12:16:12 -04:00
  • 14d0ef4a3f Adding environment interpolation for noop, forking, and slurm executors Ian Roddis 2021-11-13 12:09:51 -04:00
  • c0315b4f0b Changing up variable interpolation in preparation of supporting interpolation for environments Ian Roddis 2021-11-12 16:08:57 -04:00
  • ac3928c7f6 fixing error messages Ian Roddis 2021-11-11 12:02:37 -04:00
  • e7980d666b Adding in missing stdc++fs linkage Ian Roddis 2021-11-11 10:24:56 -04:00
  • 470a6f2bb7 Large re-organization to split daggyd away from the core libdaggy. Ian Roddis 2021-10-18 16:28:40 -03:00
  • 612bc8af8a Adding config file supoprt for daggyd Ian Roddis 2021-10-18 12:12:04 -03:00
  • ff4b9ff08b Applying changes to fix build issues Ian Roddis 2021-10-18 11:14:48 -03:00
  • 860cea6004 Adding support for cmake test, breaking tests apart a bit for easier testing Ian Roddis 2021-10-17 17:25:33 -03:00
  • e4e50fc219 Migrating to vanilla redis from rejson, using a threadsafe RedisHelper Ian Roddis 2021-10-17 10:52:27 -03:00
  • 08260043d0 Adding RedisLogger as a default for daggyd Ian Roddis 2021-10-13 15:30:13 -03:00
  • 9a0d2bb145 Adding support for RedisJSON logger Ian Roddis 2021-10-13 15:18:01 -03:00
  • 0d4c45f5fc Adding missing header to SlurmExecutor Ian Roddis 2021-10-07 10:26:39 -03:00
  • cfefdae4f3 Squashed commit of the following: Ian Roddis 2021-10-05 17:26:30 -03:00
  • 65ab439848 Squashed commit of the following: Ian Roddis 2021-10-05 11:57:55 -03:00