orcaLog in

Runs · run 2445

load_day 2024-05-12, attempt 1 succeeded

Host
73ccef5e07c2:121460
Started
2026-11-08T06:03:28Z
Ended
2026-11-08T06:04:42Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
611 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
103.2 s, up to 2.8 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/2445/load_day/2024-05-12/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T06:03:28Z [load_day 2024-05-12] attempt 1 started
2026-11-08T06:03:29Z [load_day 2024-05-12] 2024-05-12: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T06:03:34Z [load_day 2024-05-12] 2024-05-12 hour 0: 146811 events in 0 files, snapshot none (task 4424 ms: download 1717 ms overlapping gunzip 506 ms, parse 2255 ms, sort 0 ms, write 0 ms, index 888 ms: 7 candidates, 75057 repo-hours, 985 releases; waiting 493 ms; commit 0 ms)
2026-11-08T06:03:34Z [load_day 2024-05-12] 2024-05-12 hour 1: 161376 events in 0 files, snapshot none (task 4872 ms: download 2870 ms overlapping gunzip 550 ms, parse 2622 ms, sort 0 ms, write 0 ms, index 894 ms: 6 candidates, 85742 repo-hours, 731 releases; waiting 592 ms; commit 0 ms)
2026-11-08T06:03:38Z [load_day 2024-05-12] 2024-05-12 hour 2: 121075 events in 0 files, snapshot none (task 3498 ms: download 1910 ms overlapping gunzip 461 ms, parse 1851 ms, sort 0 ms, write 0 ms, index 334 ms: 5 candidates, 44439 repo-hours, 620 releases; waiting 498 ms; commit 0 ms)
2026-11-08T06:03:39Z [load_day 2024-05-12] 2024-05-12 hour 3: 137853 events in 0 files, snapshot none (task 3798 ms: download 1910 ms overlapping gunzip 458 ms, parse 2060 ms, sort 0 ms, write 0 ms, index 449 ms: 5 candidates, 52367 repo-hours, 3041 releases; waiting 465 ms; commit 0 ms)
2026-11-08T06:03:43Z [load_day 2024-05-12] 2024-05-12 hour 4: 125361 events in 0 files, snapshot none (task 3963 ms: download 1854 ms overlapping gunzip 519 ms, parse 2315 ms, sort 0 ms, write 0 ms, index 330 ms: 6 candidates, 45974 repo-hours, 477 releases; waiting 516 ms; commit 0 ms)
2026-11-08T06:03:43Z [load_day 2024-05-12] 2024-05-12 hour 5: 133943 events in 0 files, snapshot none (task 3899 ms: download 2229 ms overlapping gunzip 541 ms, parse 2227 ms, sort 0 ms, write 0 ms, index 393 ms: 2 candidates, 48514 repo-hours, 603 releases; waiting 436 ms; commit 0 ms)
2026-11-08T06:03:48Z [load_day 2024-05-12] 2024-05-12 hour 6: 152150 events in 0 files, snapshot none (task 4455 ms: download 2617 ms overlapping gunzip 586 ms, parse 2746 ms, sort 0 ms, write 0 ms, index 431 ms: 6 candidates, 62845 repo-hours, 632 releases; waiting 477 ms; commit 0 ms)
2026-11-08T06:03:48Z [load_day 2024-05-12] 2024-05-12 hour 7: 136007 events in 0 files, snapshot none (task 4383 ms: download 2434 ms overlapping gunzip 582 ms, parse 2608 ms, sort 0 ms, write 0 ms, index 418 ms: 8 candidates, 52266 repo-hours, 544 releases; waiting 511 ms; commit 0 ms)
2026-11-08T06:03:52Z [load_day 2024-05-12] 2024-05-12 hour 8: 161058 events in 0 files, snapshot none (task 3976 ms: download 2581 ms overlapping gunzip 501 ms, parse 2206 ms, sort 0 ms, write 0 ms, index 395 ms: 7 candidates, 57259 repo-hours, 674 releases; waiting 603 ms; commit 0 ms)
2026-11-08T06:03:52Z [load_day 2024-05-12] 2024-05-12 hour 9: 168865 events in 0 files, snapshot none (task 3996 ms: download 1942 ms overlapping gunzip 516 ms, parse 2249 ms, sort 0 ms, write 0 ms, index 438 ms: 4 candidates, 63354 repo-hours, 705 releases; waiting 526 ms; commit 0 ms)
2026-11-08T06:03:57Z [load_day 2024-05-12] 2024-05-12 hour 10: 187824 events in 0 files, snapshot none (task 3911 ms: download 1910 ms overlapping gunzip 493 ms, parse 2224 ms, sort 0 ms, write 0 ms, index 430 ms: 2 candidates, 59221 repo-hours, 644 releases; waiting 512 ms; commit 0 ms)
2026-11-08T06:03:57Z [load_day 2024-05-12] 2024-05-12 hour 11: 162061 events in 0 files, snapshot none (task 3801 ms: download 1834 ms overlapping gunzip 489 ms, parse 2185 ms, sort 0 ms, write 0 ms, index 414 ms: 9 candidates, 61155 repo-hours, 684 releases; waiting 510 ms; commit 0 ms)
2026-11-08T06:04:03Z [load_day 2024-05-12] 2024-05-12 hour 12: 237093 events in 0 files, snapshot none (task 5415 ms: download 1788 ms overlapping gunzip 685 ms, parse 3374 ms, sort 0 ms, write 0 ms, index 916 ms: 6 candidates, 107842 repo-hours, 970 releases; waiting 176 ms; commit 0 ms)
2026-11-08T06:04:03Z [load_day 2024-05-12] 2024-05-12 hour 13: 191929 events in 0 files, snapshot none (task 5841 ms: download 3620 ms overlapping gunzip 676 ms, parse 3056 ms, sort 0 ms, write 0 ms, index 1102 ms: 7 candidates, 90120 repo-hours, 826 releases; waiting 806 ms; commit 0 ms)
2026-11-08T06:04:09Z [load_day 2024-05-12] 2024-05-12 hour 14: 179176 events in 0 files, snapshot none (task 6114 ms: download 3040 ms overlapping gunzip 805 ms, parse 3572 ms, sort 0 ms, write 0 ms, index 988 ms: 11 candidates, 73987 repo-hours, 897 releases; waiting 513 ms; commit 0 ms)
2026-11-08T06:04:09Z [load_day 2024-05-12] 2024-05-12 hour 15: 187575 events in 0 files, snapshot none (task 5800 ms: download 2601 ms overlapping gunzip 760 ms, parse 3224 ms, sort 0 ms, write 0 ms, index 978 ms: 8 candidates, 79891 repo-hours, 1024 releases; waiting 502 ms; commit 0 ms)
2026-11-08T06:04:16Z [load_day 2024-05-12] 2024-05-12 hour 16: 179264 events in 0 files, snapshot none (task 5691 ms: download 2889 ms overlapping gunzip 767 ms, parse 3332 ms, sort 0 ms, write 0 ms, index 818 ms: 8 candidates, 72424 repo-hours, 818 releases; waiting 498 ms; commit 0 ms)
2026-11-08T06:04:16Z [load_day 2024-05-12] 2024-05-12 hour 17: 171148 events in 0 files, snapshot none (task 5240 ms: download 2520 ms overlapping gunzip 728 ms, parse 3100 ms, sort 0 ms, write 0 ms, index 670 ms: 12 candidates, 68771 repo-hours, 852 releases; waiting 484 ms; commit 0 ms)
2026-11-08T06:04:23Z [load_day 2024-05-12] 2024-05-12 hour 18: 185340 events in 0 files, snapshot none (task 6722 ms: download 3928 ms overlapping gunzip 963 ms, parse 4316 ms, sort 0 ms, write 0 ms, index 660 ms: 9 candidates, 81643 repo-hours, 964 releases; waiting 505 ms; commit 0 ms)
2026-11-08T06:04:23Z [load_day 2024-05-12] 2024-05-12 hour 19: 163497 events in 0 files, snapshot none (task 6083 ms: download 3729 ms overlapping gunzip 888 ms, parse 3900 ms, sort 0 ms, write 0 ms, index 493 ms: 5 candidates, 64969 repo-hours, 850 releases; waiting 542 ms; commit 0 ms)
2026-11-08T06:04:29Z [load_day 2024-05-12] 2024-05-12 hour 20: 178851 events in 0 files, snapshot none (task 5436 ms: download 2515 ms overlapping gunzip 729 ms, parse 3472 ms, sort 0 ms, write 0 ms, index 438 ms: 3 candidates, 59113 repo-hours, 801 releases; waiting 533 ms; commit 0 ms)
2026-11-08T06:04:29Z [load_day 2024-05-12] 2024-05-12 hour 21: 145331 events in 0 files, snapshot none (task 4784 ms: download 2464 ms overlapping gunzip 621 ms, parse 2811 ms, sort 0 ms, write 0 ms, index 541 ms: 19 candidates, 57528 repo-hours, 852 releases; waiting 461 ms; commit 0 ms)
2026-11-08T06:04:33Z [load_day 2024-05-12] 2024-05-12 hour 22: 130797 events in 0 files, snapshot none (task 3975 ms: download 1981 ms overlapping gunzip 542 ms, parse 2190 ms, sort 0 ms, write 0 ms, index 389 ms: 5 candidates, 47544 repo-hours, 749 releases; waiting 469 ms; commit 0 ms)
2026-11-08T06:04:33Z [load_day 2024-05-12] 2024-05-12 hour 23: 129338 events in 0 files, snapshot none (task 4080 ms: download 2835 ms overlapping gunzip 502 ms, parse 2235 ms, sort 0 ms, write 0 ms, index 493 ms: 6 candidates, 46842 repo-hours, 587 releases; waiting 615 ms; commit 0 ms)
2026-11-08T06:04:40Z [load_day 2024-05-12] 2024-05-12: repo_hour merged from 24 files to 1 (1558867 rows, 6929 ms)
2026-11-08T06:04:42Z [load_day 2024-05-12] 2024-05-12: index committed in 9203 ms (24 + 1 + 24 files)
2026-11-08T06:04:42Z [load_day 2024-05-12] 2024-05-12: 3873723 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T06:04:42Z [load_day 2024-05-12] attempt 1 succeeded