orcaLog in

Runs · run 2375

load_day 2024-04-26, attempt 1 succeeded

Host
73ccef5e07c2:114543
Started
2026-11-08T05:48:03Z
Ended
2026-11-08T05:50:19Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
689 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
192.3 s, up to 2.8 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/2375/load_day/2024-04-26/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T05:48:03Z [load_day 2024-04-26] attempt 1 started
2026-11-08T05:48:04Z [load_day 2024-04-26] 2024-04-26: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T05:48:13Z [load_day 2024-04-26] 2024-04-26 hour 0: 220616 events in 0 files, snapshot none (task 7949 ms: download 4995 ms overlapping gunzip 1138 ms, parse 5148 ms, sort 0 ms, write 0 ms, index 905 ms: 14 candidates, 96126 repo-hours, 1130 releases; waiting 482 ms; commit 0 ms)
2026-11-08T05:48:13Z [load_day 2024-04-26] 2024-04-26 hour 1: 208240 events in 0 files, snapshot none (task 7774 ms: download 4851 ms overlapping gunzip 1089 ms, parse 5021 ms, sort 0 ms, write 0 ms, index 848 ms: 10 candidates, 100547 repo-hours, 908 releases; waiting 462 ms; commit 0 ms)
2026-11-08T05:48:21Z [load_day 2024-04-26] 2024-04-26 hour 2: 177334 events in 0 files, snapshot none (task 7955 ms: download 4991 ms overlapping gunzip 1182 ms, parse 5446 ms, sort 0 ms, write 0 ms, index 579 ms: 7 candidates, 66408 repo-hours, 816 releases; waiting 495 ms; commit 0 ms)
2026-11-08T05:48:22Z [load_day 2024-04-26] 2024-04-26 hour 3: 183153 events in 0 files, snapshot none (task 8565 ms: download 5495 ms overlapping gunzip 1369 ms, parse 5690 ms, sort 0 ms, write 0 ms, index 588 ms: 3 candidates, 69501 repo-hours, 3393 releases; waiting 556 ms; commit 0 ms)
2026-11-08T05:48:28Z [load_day 2024-04-26] 2024-04-26 hour 4: 169559 events in 0 files, snapshot none (task 6716 ms: download 3811 ms overlapping gunzip 1020 ms, parse 4149 ms, sort 0 ms, write 0 ms, index 703 ms: 4 candidates, 60321 repo-hours, 716 releases; waiting 518 ms; commit 0 ms)
2026-11-08T05:48:29Z [load_day 2024-04-26] 2024-04-26 hour 5: 181209 events in 0 files, snapshot none (task 7257 ms: download 4364 ms overlapping gunzip 1187 ms, parse 4881 ms, sort 0 ms, write 0 ms, index 699 ms: 5 candidates, 65759 repo-hours, 833 releases; waiting 181 ms; commit 0 ms)
2026-11-08T05:48:37Z [load_day 2024-04-26] 2024-04-26 hour 6: 215382 events in 0 files, snapshot none (task 8792 ms: download 5753 ms overlapping gunzip 1324 ms, parse 5831 ms, sort 0 ms, write 0 ms, index 701 ms: 12 candidates, 84259 repo-hours, 1176 releases; waiting 639 ms; commit 0 ms)
2026-11-08T05:48:38Z [load_day 2024-04-26] 2024-04-26 hour 7: 222685 events in 0 files, snapshot none (task 8437 ms: download 5692 ms overlapping gunzip 1283 ms, parse 5587 ms, sort 0 ms, write 0 ms, index 740 ms: 4 candidates, 83347 repo-hours, 1270 releases; waiting 513 ms; commit 0 ms)
2026-11-08T05:48:47Z [load_day 2024-04-26] 2024-04-26 hour 8: 237035 events in 0 files, snapshot none (task 9568 ms: download 6477 ms overlapping gunzip 1528 ms, parse 6500 ms, sort 0 ms, write 0 ms, index 819 ms: 8 candidates, 93234 repo-hours, 1237 releases; waiting 417 ms; commit 0 ms)
2026-11-08T05:48:52Z [load_day 2024-04-26] 2024-04-26 hour 9: 231724 events in 0 files, snapshot none (task 13025 ms: download 6894 ms overlapping gunzip 1502 ms, parse 6602 ms, sort 0 ms, write 0 ms, index 4151 ms: 11 candidates, 91828 repo-hours, 1369 releases; waiting 484 ms; commit 0 ms)
2026-11-08T05:49:14Z [load_day 2024-04-26] 2024-04-26 hour 10: 234983 events in 0 files, snapshot none (task 11248 ms: download 8606 ms overlapping gunzip 1851 ms, parse 7938 ms, sort 0 ms, write 0 ms, index 627 ms: 9 candidates, 83232 repo-hours, 1091 releases; waiting 526 ms; commit 0 ms)
2026-11-08T05:49:14Z [load_day 2024-04-26] 2024-04-26 hour 11: 228965 events in 0 files, snapshot none (task 9825 ms: download 7068 ms overlapping gunzip 1565 ms, parse 6884 ms, sort 0 ms, write 0 ms, index 591 ms: 10 candidates, 80494 repo-hours, 1057 releases; waiting 467 ms; commit 0 ms)
2026-11-08T05:49:22Z [load_day 2024-04-26] 2024-04-26 hour 12: 273252 events in 0 files, snapshot none (task 7586 ms: download 4824 ms overlapping gunzip 1123 ms, parse 4902 ms, sort 0 ms, write 0 ms, index 766 ms: 7 candidates, 114466 repo-hours, 1584 releases; waiting 503 ms; commit 0 ms)
2026-11-08T05:49:23Z [load_day 2024-04-26] 2024-04-26 hour 13: 263554 events in 0 files, snapshot none (task 8938 ms: download 6124 ms overlapping gunzip 1352 ms, parse 5868 ms, sort 0 ms, write 0 ms, index 833 ms: 14 candidates, 112976 repo-hours, 1290 releases; waiting 555 ms; commit 0 ms)
2026-11-08T05:49:32Z [load_day 2024-04-26] 2024-04-26 hour 14: 255430 events in 0 files, snapshot none (task 9727 ms: download 6229 ms overlapping gunzip 1510 ms, parse 6530 ms, sort 0 ms, write 0 ms, index 847 ms: 20 candidates, 98193 repo-hours, 1275 releases; waiting 519 ms; commit 0 ms)
2026-11-08T05:49:34Z [load_day 2024-04-26] 2024-04-26 hour 15: 254454 events in 0 files, snapshot none (task 10203 ms: download 7455 ms overlapping gunzip 1517 ms, parse 6907 ms, sort 0 ms, write 0 ms, index 748 ms: 12 candidates, 97483 repo-hours, 1304 releases; waiting 757 ms; commit 0 ms)
2026-11-08T05:49:42Z [load_day 2024-04-26] 2024-04-26 hour 16: 239522 events in 0 files, snapshot none (task 9562 ms: download 6566 ms overlapping gunzip 1426 ms, parse 6330 ms, sort 0 ms, write 0 ms, index 1034 ms: 14 candidates, 92821 repo-hours, 1261 releases; waiting 547 ms; commit 0 ms)
2026-11-08T05:49:43Z [load_day 2024-04-26] 2024-04-26 hour 17: 223542 events in 0 files, snapshot none (task 8908 ms: download 5755 ms overlapping gunzip 1402 ms, parse 6097 ms, sort 0 ms, write 0 ms, index 641 ms: 2 candidates, 84655 repo-hours, 1193 releases; waiting 498 ms; commit 0 ms)
2026-11-08T05:49:51Z [load_day 2024-04-26] 2024-04-26 hour 18: 231171 events in 0 files, snapshot none (task 8595 ms: download 5725 ms overlapping gunzip 1272 ms, parse 5916 ms, sort 0 ms, write 0 ms, index 678 ms: 10 candidates, 90584 repo-hours, 1215 releases; waiting 452 ms; commit 0 ms)
2026-11-08T05:49:52Z [load_day 2024-04-26] 2024-04-26 hour 19: 212393 events in 0 files, snapshot none (task 8063 ms: download 5518 ms overlapping gunzip 1196 ms, parse 5436 ms, sort 0 ms, write 0 ms, index 638 ms: 7 candidates, 74019 repo-hours, 1054 releases; waiting 499 ms; commit 0 ms)
2026-11-08T05:50:00Z [load_day 2024-04-26] 2024-04-26 hour 20: 212852 events in 0 files, snapshot none (task 7743 ms: download 5205 ms overlapping gunzip 1193 ms, parse 5440 ms, sort 0 ms, write 0 ms, index 623 ms: 9 candidates, 72412 repo-hours, 877 releases; waiting 232 ms; commit 0 ms)
2026-11-08T05:50:00Z [load_day 2024-04-26] 2024-04-26 hour 21: 187146 events in 0 files, snapshot none (task 7468 ms: download 4654 ms overlapping gunzip 1152 ms, parse 4710 ms, sort 0 ms, write 0 ms, index 768 ms: 5 candidates, 67145 repo-hours, 1001 releases; waiting 515 ms; commit 0 ms)
2026-11-08T05:50:07Z [load_day 2024-04-26] 2024-04-26 hour 22: 175235 events in 0 files, snapshot none (task 6906 ms: download 3767 ms overlapping gunzip 1108 ms, parse 4460 ms, sort 0 ms, write 0 ms, index 456 ms: 14 candidates, 56951 repo-hours, 920 releases; waiting 481 ms; commit 0 ms)
2026-11-08T05:50:07Z [load_day 2024-04-26] 2024-04-26 hour 23: 149074 events in 0 files, snapshot none (task 5038 ms: download 2705 ms overlapping gunzip 744 ms, parse 3019 ms, sort 0 ms, write 0 ms, index 489 ms: 9 candidates, 52523 repo-hours, 724 releases; waiting 511 ms; commit 0 ms)
2026-11-08T05:50:16Z [load_day 2024-04-26] 2024-04-26: repo_hour merged from 24 files to 1 (1989284 rows, 9184 ms)
2026-11-08T05:50:19Z [load_day 2024-04-26] 2024-04-26: index committed in 11511 ms (24 + 1 + 24 files)
2026-11-08T05:50:19Z [load_day 2024-04-26] 2024-04-26: 5188510 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T05:50:19Z [load_day 2024-04-26] attempt 1 succeeded