orcaLog in

Runs · run 2420

load_day 2024-05-07, attempt 1 succeeded

Host
73ccef5e07c2:119040
Started
2026-11-08T05:58:44Z
Ended
2026-11-08T06:00:47Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
736 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
192.3 s, up to 3.1 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/2420/load_day/2024-05-07/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T05:58:44Z [load_day 2024-05-07] attempt 1 started
2026-11-08T05:58:45Z [load_day 2024-05-07] 2024-05-07: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T05:58:55Z [load_day 2024-05-07] 2024-05-07 hour 0: 199459 events in 0 files, snapshot none (task 9619 ms: download 6218 ms overlapping gunzip 1559 ms, parse 6305 ms, sort 0 ms, write 0 ms, index 990 ms: 9 candidates, 102254 repo-hours, 1089 releases; waiting 518 ms; commit 0 ms)
2026-11-08T05:58:55Z [load_day 2024-05-07] 2024-05-07 hour 1: 205222 events in 0 files, snapshot none (task 9168 ms: download 5376 ms overlapping gunzip 1372 ms, parse 5823 ms, sort 0 ms, write 0 ms, index 1152 ms: 9 candidates, 107708 repo-hours, 931 releases; waiting 472 ms; commit 0 ms)
2026-11-08T05:59:02Z [load_day 2024-05-07] 2024-05-07 hour 2: 170864 events in 0 files, snapshot none (task 6479 ms: download 3728 ms overlapping gunzip 951 ms, parse 4031 ms, sort 0 ms, write 0 ms, index 704 ms: 7 candidates, 71981 repo-hours, 900 releases; waiting 489 ms; commit 0 ms)
2026-11-08T05:59:02Z [load_day 2024-05-07] 2024-05-07 hour 3: 182544 events in 0 files, snapshot none (task 6130 ms: download 3216 ms overlapping gunzip 881 ms, parse 3635 ms, sort 0 ms, write 0 ms, index 995 ms: 18 candidates, 76149 repo-hours, 2741 releases; waiting 335 ms; commit 0 ms)
2026-11-08T05:59:09Z [load_day 2024-05-07] 2024-05-07 hour 4: 167572 events in 0 files, snapshot none (task 6121 ms: download 3514 ms overlapping gunzip 1020 ms, parse 3867 ms, sort 0 ms, write 0 ms, index 468 ms: 12 candidates, 64850 repo-hours, 759 releases; waiting 506 ms; commit 0 ms)
2026-11-08T05:59:11Z [load_day 2024-05-07] 2024-05-07 hour 5: 190476 events in 0 files, snapshot none (task 7484 ms: download 5185 ms overlapping gunzip 1202 ms, parse 4925 ms, sort 0 ms, write 0 ms, index 557 ms: 15 candidates, 70742 repo-hours, 889 releases; waiting 519 ms; commit 0 ms)
2026-11-08T05:59:18Z [load_day 2024-05-07] 2024-05-07 hour 6: 215541 events in 0 files, snapshot none (task 8403 ms: download 5085 ms overlapping gunzip 1268 ms, parse 5324 ms, sort 0 ms, write 0 ms, index 976 ms: 8 candidates, 94008 repo-hours, 1005 releases; waiting 529 ms; commit 0 ms)
2026-11-08T05:59:20Z [load_day 2024-05-07] 2024-05-07 hour 7: 216723 events in 0 files, snapshot none (task 9341 ms: download 6507 ms overlapping gunzip 1476 ms, parse 6342 ms, sort 0 ms, write 0 ms, index 756 ms: 9 candidates, 89367 repo-hours, 1174 releases; waiting 535 ms; commit 0 ms)
2026-11-08T05:59:29Z [load_day 2024-05-07] 2024-05-07 hour 8: 235027 events in 0 files, snapshot none (task 10548 ms: download 7393 ms overlapping gunzip 1646 ms, parse 7004 ms, sort 0 ms, write 0 ms, index 836 ms: 12 candidates, 97182 repo-hours, 1369 releases; waiting 602 ms; commit 0 ms)
2026-11-08T05:59:31Z [load_day 2024-05-07] 2024-05-07 hour 9: 234312 events in 0 files, snapshot none (task 10642 ms: download 7713 ms overlapping gunzip 1696 ms, parse 7121 ms, sort 0 ms, write 0 ms, index 821 ms: 13 candidates, 100549 repo-hours, 1532 releases; waiting 616 ms; commit 0 ms)
2026-11-08T05:59:37Z [load_day 2024-05-07] 2024-05-07 hour 10: 225368 events in 0 files, snapshot none (task 7726 ms: download 5036 ms overlapping gunzip 1172 ms, parse 5032 ms, sort 0 ms, write 0 ms, index 789 ms: 11 candidates, 93563 repo-hours, 1381 releases; waiting 522 ms; commit 0 ms)
2026-11-08T05:59:39Z [load_day 2024-05-07] 2024-05-07 hour 11: 226709 events in 0 files, snapshot none (task 7481 ms: download 5054 ms overlapping gunzip 1222 ms, parse 4951 ms, sort 0 ms, write 0 ms, index 662 ms: 9 candidates, 90984 repo-hours, 1341 releases; waiting 437 ms; commit 0 ms)
2026-11-08T05:59:46Z [load_day 2024-05-07] 2024-05-07 hour 12: 272076 events in 0 files, snapshot none (task 8498 ms: download 5183 ms overlapping gunzip 1139 ms, parse 4808 ms, sort 0 ms, write 0 ms, index 1230 ms: 8 candidates, 125395 repo-hours, 1590 releases; waiting 864 ms; commit 0 ms)
2026-11-08T05:59:49Z [load_day 2024-05-07] 2024-05-07 hour 13: 262319 events in 0 files, snapshot none (task 8826 ms: download 5387 ms overlapping gunzip 1388 ms, parse 5837 ms, sort 0 ms, write 0 ms, index 1019 ms: 9 candidates, 119683 repo-hours, 1416 releases; waiting 346 ms; commit 0 ms)
2026-11-08T05:59:59Z [load_day 2024-05-07] 2024-05-07 hour 14: 265499 events in 0 files, snapshot none (task 12157 ms: download 9148 ms overlapping gunzip 1819 ms, parse 7573 ms, sort 0 ms, write 0 ms, index 773 ms: 8 candidates, 106159 repo-hours, 1339 releases; waiting 1534 ms; commit 0 ms)
2026-11-08T05:59:59Z [load_day 2024-05-07] 2024-05-07 hour 15: 257150 events in 0 files, snapshot none (task 10125 ms: download 7422 ms overlapping gunzip 1673 ms, parse 6909 ms, sort 0 ms, write 0 ms, index 821 ms: 13 candidates, 110792 repo-hours, 1399 releases; waiting 471 ms; commit 0 ms)
2026-11-08T06:00:09Z [load_day 2024-05-07] 2024-05-07 hour 16: 246568 events in 0 files, snapshot none (task 9796 ms: download 6964 ms overlapping gunzip 1555 ms, parse 6609 ms, sort 0 ms, write 0 ms, index 939 ms: 10 candidates, 99796 repo-hours, 1309 releases; waiting 465 ms; commit 0 ms)
2026-11-08T06:00:09Z [load_day 2024-05-07] 2024-05-07 hour 17: 240912 events in 0 files, snapshot none (task 9198 ms: download 6457 ms overlapping gunzip 1485 ms, parse 6124 ms, sort 0 ms, write 0 ms, index 870 ms: 22 candidates, 91597 repo-hours, 1144 releases; waiting 454 ms; commit 0 ms)
2026-11-08T06:00:19Z [load_day 2024-05-07] 2024-05-07 hour 18: 239675 events in 0 files, snapshot none (task 8764 ms: download 5493 ms overlapping gunzip 1332 ms, parse 5643 ms, sort 0 ms, write 0 ms, index 1058 ms: 13 candidates, 101266 repo-hours, 1303 releases; waiting 467 ms; commit 0 ms)
2026-11-08T06:00:19Z [load_day 2024-05-07] 2024-05-07 hour 19: 210788 events in 0 files, snapshot none (task 8436 ms: download 5094 ms overlapping gunzip 1198 ms, parse 5107 ms, sort 0 ms, write 0 ms, index 1380 ms: 5 candidates, 82109 repo-hours, 1148 releases; waiting 533 ms; commit 0 ms)
2026-11-08T06:00:28Z [load_day 2024-05-07] 2024-05-07 hour 20: 207528 events in 0 files, snapshot none (task 8308 ms: download 5126 ms overlapping gunzip 1306 ms, parse 5287 ms, sort 0 ms, write 0 ms, index 904 ms: 18 candidates, 84070 repo-hours, 1093 releases; waiting 497 ms; commit 0 ms)
2026-11-08T06:00:28Z [load_day 2024-05-07] 2024-05-07 hour 21: 202139 events in 0 files, snapshot none (task 8331 ms: download 5413 ms overlapping gunzip 1344 ms, parse 5287 ms, sort 0 ms, write 0 ms, index 904 ms: 10 candidates, 79224 repo-hours, 1131 releases; waiting 494 ms; commit 0 ms)
2026-11-08T06:00:35Z [load_day 2024-05-07] 2024-05-07 hour 22: 179481 events in 0 files, snapshot none (task 7105 ms: download 4323 ms overlapping gunzip 1076 ms, parse 4463 ms, sort 0 ms, write 0 ms, index 547 ms: 7 candidates, 65932 repo-hours, 983 releases; waiting 525 ms; commit 0 ms)
2026-11-08T06:00:35Z [load_day 2024-05-07] 2024-05-07 hour 23: 157932 events in 0 files, snapshot none (task 5781 ms: download 3247 ms overlapping gunzip 931 ms, parse 3905 ms, sort 0 ms, write 0 ms, index 489 ms: 7 candidates, 58856 repo-hours, 771 releases; waiting 208 ms; commit 0 ms)
2026-11-08T06:00:45Z [load_day 2024-05-07] 2024-05-07: repo_hour merged from 24 files to 1 (2184216 rows, 9744 ms)
2026-11-08T06:00:47Z [load_day 2024-05-07] 2024-05-07: index committed in 12224 ms (24 + 1 + 24 files)
2026-11-08T06:00:47Z [load_day 2024-05-07] 2024-05-07: 5211884 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T06:00:47Z [load_day 2024-05-07] attempt 1 succeeded