orcaLog in

Runs · run 735

load_day 2023-01-17, attempt 1 succeeded

Host
d3d1748bf284:13067
Started
2026-11-07T13:49:13Z
Ended
2026-11-07T13:52:21Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/735/load_day/2023-01-17/1.log
Code
pipelines/gharchive.mojo:116

Log

2026-11-07T13:49:13Z [load_day 2023-01-17] attempt 1 started
2026-11-07T13:49:14Z [load_day 2023-01-17] 2023-01-17: 2 hours in flight, about 1200 MB
2026-11-07T13:49:27Z [load_day 2023-01-17] 2023-01-17 hour 0: 148617 events in 3 files, snapshot 1319508808030372828 (task 10813 ms: download 4918 ms overlapping gunzip 678 ms, parse 3079 ms, sort 81 ms, write 5713 ms, index 433 ms: 6 candidates, 68292 repo-hours, 810 releases; waiting 520 ms; commit 1157 ms)
2026-11-07T13:49:29Z [load_day 2023-01-17] 2023-01-17 hour 1: 144478 events in 3 files, snapshot 5179767089720911382 (task 10401 ms: download 4540 ms overlapping gunzip 617 ms, parse 2757 ms, sort 68 ms, write 5664 ms, index 472 ms: 5 candidates, 73154 repo-hours, 709 releases; waiting 531 ms; commit 1359 ms)
2026-11-07T13:49:38Z [load_day 2023-01-17] 2023-01-17 hour 2: 134636 events in 3 files, snapshot 6664830113340304165 (task 9530 ms: download 4182 ms overlapping gunzip 567 ms, parse 2438 ms, sort 72 ms, write 5250 ms, index 391 ms: 4 candidates, 60830 repo-hours, 704 releases; waiting 510 ms; commit 1281 ms)
2026-11-07T13:49:39Z [load_day 2023-01-17] 2023-01-17 hour 3: 140152 events in 3 files, snapshot 1873997825920820340 (task 10170 ms: download 4561 ms overlapping gunzip 668 ms, parse 2793 ms, sort 70 ms, write 5350 ms, index 335 ms: 2 candidates, 52462 repo-hours, 792 releases; waiting 565 ms; commit 1211 ms)
2026-11-07T13:49:47Z [load_day 2023-01-17] 2023-01-17 hour 4: 132193 events in 3 files, snapshot 6105765168491072697 (task 9349 ms: download 4234 ms overlapping gunzip 588 ms, parse 2481 ms, sort 68 ms, write 4923 ms, index 317 ms: 3 candidates, 49487 repo-hours, 573 releases; waiting 644 ms; commit 1176 ms)
2026-11-07T13:49:50Z [load_day 2023-01-17] 2023-01-17 hour 5: 138167 events in 3 files, snapshot 7104942825713893157 (task 9966 ms: download 4575 ms overlapping gunzip 582 ms, parse 2529 ms, sort 63 ms, write 5070 ms, index 331 ms: 1 candidates, 52853 repo-hours, 696 releases; waiting 1039 ms; commit 1315 ms)
2026-11-07T13:49:59Z [load_day 2023-01-17] 2023-01-17 hour 6: 153830 events in 4 files, snapshot 1968869381640739588 (task 10906 ms: download 4574 ms overlapping gunzip 697 ms, parse 2966 ms, sort 89 ms, write 5909 ms, index 425 ms: 3 candidates, 63476 repo-hours, 884 releases; waiting 508 ms; commit 1321 ms)
2026-11-07T13:50:03Z [load_day 2023-01-17] 2023-01-17 hour 7: 166482 events in 4 files, snapshot 6460461759932521656 (task 12230 ms: download 4948 ms overlapping gunzip 740 ms, parse 3185 ms, sort 97 ms, write 6970 ms, index 454 ms: 4 candidates, 66830 repo-hours, 900 releases; waiting 516 ms; commit 1469 ms)
2026-11-07T13:50:14Z [load_day 2023-01-17] 2023-01-17 hour 8: 173410 events in 4 files, snapshot 1709588678175750129 (task 14026 ms: download 8404 ms overlapping gunzip 846 ms, parse 3686 ms, sort 88 ms, write 8082 ms, index 479 ms: 5 candidates, 73370 repo-hours, 873 releases; waiting 566 ms; commit 1243 ms)
2026-11-07T13:50:20Z [load_day 2023-01-17] 2023-01-17 hour 9: 187652 events in 4 files, snapshot 1947655553074578033 (task 16107 ms: download 9377 ms overlapping gunzip 956 ms, parse 4158 ms, sort 105 ms, write 8977 ms, index 539 ms: 1 candidates, 78280 repo-hours, 1005 releases; waiting 980 ms; commit 1266 ms)
2026-11-07T13:50:30Z [load_day 2023-01-17] 2023-01-17 hour 10: 188740 events in 4 files, snapshot 2120380856126230360 (task 15055 ms: download 8685 ms overlapping gunzip 978 ms, parse 4152 ms, sort 101 ms, write 8743 ms, index 479 ms: 7 candidates, 77479 repo-hours, 1035 releases; waiting 314 ms; commit 1431 ms)
2026-11-07T13:50:35Z [load_day 2023-01-17] 2023-01-17 hour 11: 181981 events in 4 files, snapshot 8493297180918776432 (task 14511 ms: download 8468 ms overlapping gunzip 914 ms, parse 3890 ms, sort 96 ms, write 8343 ms, index 469 ms: 8 candidates, 73358 repo-hours, 1000 releases; waiting 464 ms; commit 1275 ms)
2026-11-07T13:50:46Z [load_day 2023-01-17] 2023-01-17 hour 12: 210204 events in 5 files, snapshot 8681929220604602044 (task 15464 ms: download 8262 ms overlapping gunzip 928 ms, parse 4150 ms, sort 113 ms, write 8810 ms, index 616 ms: 5 candidates, 101413 repo-hours, 1032 releases; waiting 537 ms; commit 1445 ms)
2026-11-07T13:50:53Z [load_day 2023-01-17] 2023-01-17 hour 13: 214105 events in 5 files, snapshot 7748910177985826857 (task 16947 ms: download 11165 ms overlapping gunzip 1013 ms, parse 4430 ms, sort 142 ms, write 9552 ms, index 610 ms: 3 candidates, 99330 repo-hours, 1067 releases; waiting 689 ms; commit 1265 ms)
2026-11-07T13:51:04Z [load_day 2023-01-17] 2023-01-17 hour 14: 211691 events in 5 files, snapshot 7024262135822546970 (task 17065 ms: download 9274 ms overlapping gunzip 1026 ms, parse 4496 ms, sort 128 ms, write 9752 ms, index 641 ms: 6 candidates, 90116 repo-hours, 1161 releases; waiting 586 ms; commit 1341 ms)
2026-11-07T13:51:11Z [load_day 2023-01-17] 2023-01-17 hour 15: 210708 events in 5 files, snapshot 3345376215789225665 (task 17241 ms: download 9291 ms overlapping gunzip 1016 ms, parse 4624 ms, sort 123 ms, write 9980 ms, index 643 ms: 4 candidates, 91757 repo-hours, 1240 releases; waiting 505 ms; commit 1345 ms)
2026-11-07T13:51:22Z [load_day 2023-01-17] 2023-01-17 hour 16: 198496 events in 4 files, snapshot 3151146150271457727 (task 17358 ms: download 9960 ms overlapping gunzip 1037 ms, parse 4513 ms, sort 129 ms, write 9573 ms, index 622 ms: 13 candidates, 87608 repo-hours, 1098 releases; waiting 1105 ms; commit 1273 ms)
2026-11-07T13:51:29Z [load_day 2023-01-17] 2023-01-17 hour 17: 199870 events in 4 files, snapshot 8337314577461251069 (task 16742 ms: download 9342 ms overlapping gunzip 1029 ms, parse 4429 ms, sort 114 ms, write 9650 ms, index 568 ms: 5 candidates, 84093 repo-hours, 947 releases; waiting 509 ms; commit 1423 ms)
2026-11-07T13:51:38Z [load_day 2023-01-17] 2023-01-17 hour 18: 196008 events in 4 files, snapshot 720829865215518142 (task 16210 ms: download 9196 ms overlapping gunzip 998 ms, parse 4348 ms, sort 115 ms, write 9071 ms, index 570 ms: 11 candidates, 84064 repo-hours, 1017 releases; waiting 690 ms; commit 1269 ms)
2026-11-07T13:51:44Z [load_day 2023-01-17] 2023-01-17 hour 19: 188896 events in 4 files, snapshot 5911689045754545491 (task 14998 ms: download 8518 ms overlapping gunzip 909 ms, parse 4010 ms, sort 114 ms, write 8562 ms, index 549 ms: 8 candidates, 75611 repo-hours, 1050 releases; waiting 565 ms; commit 1384 ms)
2026-11-07T13:51:55Z [load_day 2023-01-17] 2023-01-17 hour 20: 187158 events in 4 files, snapshot 3916228001208350507 (task 15319 ms: download 8971 ms overlapping gunzip 916 ms, parse 3943 ms, sort 104 ms, write 8617 ms, index 514 ms: 6 candidates, 75166 repo-hours, 1002 releases; waiting 903 ms; commit 1348 ms)
2026-11-07T13:51:59Z [load_day 2023-01-17] 2023-01-17 hour 21: 177469 events in 4 files, snapshot 3483920593700074711 (task 14538 ms: download 8573 ms overlapping gunzip 927 ms, parse 3846 ms, sort 99 ms, write 8330 ms, index 473 ms: 8 candidates, 68751 repo-hours, 1018 releases; waiting 599 ms; commit 1345 ms)
2026-11-07T13:52:09Z [load_day 2023-01-17] 2023-01-17 hour 22: 166380 events in 4 files, snapshot 2630377651978349097 (task 13705 ms: download 5679 ms overlapping gunzip 857 ms, parse 3599 ms, sort 84 ms, write 7897 ms, index 487 ms: 3 candidates, 62738 repo-hours, 912 releases; waiting 511 ms; commit 1270 ms)
2026-11-07T13:52:12Z [load_day 2023-01-17] 2023-01-17 hour 23: 145154 events in 3 files, snapshot 5627820653033267802 (task 11499 ms: download 5264 ms overlapping gunzip 714 ms, parse 3084 ms, sort 82 ms, write 6413 ms, index 368 ms: 19 candidates, 57451 repo-hours, 824 releases; waiting 523 ms; commit 1259 ms)
2026-11-07T13:52:19Z [load_day 2023-01-17] 2023-01-17: repo_hour merged from 24 files to 1 (1767969 rows, 7287 ms)
2026-11-07T13:52:21Z [load_day 2023-01-17] 2023-01-17: index committed in 9147 ms (24 + 1 + 24 files)
2026-11-07T13:52:21Z [load_day 2023-01-17] 2023-01-17: 4196477 events in 24 hours
2026-11-07T13:52:21Z [load_day 2023-01-17] attempt 1 succeeded