orcaLog in

Runs · run 2102

load_day 2024-02-19, attempt 1 succeeded

Host
73ccef5e07c2:88661
Started
2026-11-08T04:43:49Z
Ended
2026-11-08T04:46:02Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
824 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
194.6 s, up to 2.8 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/2102/load_day/2024-02-19/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T04:43:49Z [load_day 2024-02-19] attempt 1 started
2026-11-08T04:43:50Z [load_day 2024-02-19] 2024-02-19: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T04:43:58Z [load_day 2024-02-19] 2024-02-19 hour 0: 222832 events in 0 files, snapshot none (task 6897 ms: download 3926 ms overlapping gunzip 1024 ms, parse 4095 ms, sort 0 ms, write 0 ms, index 1029 ms: 9 candidates, 85499 repo-hours, 1047 releases; waiting 506 ms; commit 0 ms)
2026-11-08T04:43:59Z [load_day 2024-02-19] 2024-02-19 hour 1: 232278 events in 0 files, snapshot none (task 7748 ms: download 4806 ms overlapping gunzip 1282 ms, parse 5212 ms, sort 0 ms, write 0 ms, index 747 ms: 18 candidates, 91674 repo-hours, 767 releases; waiting 234 ms; commit 0 ms)
2026-11-08T04:44:05Z [load_day 2024-02-19] 2024-02-19 hour 2: 199839 events in 0 files, snapshot none (task 6606 ms: download 3880 ms overlapping gunzip 1037 ms, parse 3976 ms, sort 0 ms, write 0 ms, index 785 ms: 19 candidates, 59634 repo-hours, 690 releases; waiting 519 ms; commit 0 ms)
2026-11-08T04:44:06Z [load_day 2024-02-19] 2024-02-19 hour 3: 205694 events in 0 files, snapshot none (task 6911 ms: download 3765 ms overlapping gunzip 1085 ms, parse 4358 ms, sort 0 ms, write 0 ms, index 615 ms: 3 candidates, 60084 repo-hours, 817 releases; waiting 509 ms; commit 0 ms)
2026-11-08T04:44:11Z [load_day 2024-02-19] 2024-02-19 hour 4: 204983 events in 0 files, snapshot none (task 6114 ms: download 3613 ms overlapping gunzip 960 ms, parse 3718 ms, sort 0 ms, write 0 ms, index 485 ms: 5 candidates, 57789 repo-hours, 591 releases; waiting 559 ms; commit 0 ms)
2026-11-08T04:44:13Z [load_day 2024-02-19] 2024-02-19 hour 5: 211272 events in 0 files, snapshot none (task 5874 ms: download 3224 ms overlapping gunzip 903 ms, parse 3402 ms, sort 0 ms, write 0 ms, index 541 ms: 1 candidates, 62594 repo-hours, 719 releases; waiting 521 ms; commit 0 ms)
2026-11-08T04:44:19Z [load_day 2024-02-19] 2024-02-19 hour 6: 241306 events in 0 files, snapshot none (task 7102 ms: download 4676 ms overlapping gunzip 991 ms, parse 3941 ms, sort 0 ms, write 0 ms, index 699 ms: 8 candidates, 76622 repo-hours, 852 releases; waiting 1055 ms; commit 0 ms)
2026-11-08T04:44:21Z [load_day 2024-02-19] 2024-02-19 hour 7: 251407 events in 0 files, snapshot none (task 7473 ms: download 5004 ms overlapping gunzip 1170 ms, parse 4761 ms, sort 0 ms, write 0 ms, index 703 ms: 5 candidates, 77009 repo-hours, 836 releases; waiting 575 ms; commit 0 ms)
2026-11-08T04:44:29Z [load_day 2024-02-19] 2024-02-19 hour 8: 252049 events in 0 files, snapshot none (task 9606 ms: download 6866 ms overlapping gunzip 1510 ms, parse 6332 ms, sort 0 ms, write 0 ms, index 643 ms: 3 candidates, 84374 repo-hours, 957 releases; waiting 847 ms; commit 0 ms)
2026-11-08T04:44:32Z [load_day 2024-02-19] 2024-02-19 hour 9: 279720 events in 0 files, snapshot none (task 10842 ms: download 7391 ms overlapping gunzip 1581 ms, parse 7207 ms, sort 0 ms, write 0 ms, index 1301 ms: 9 candidates, 91694 repo-hours, 1134 releases; waiting 471 ms; commit 0 ms)
2026-11-08T04:44:41Z [load_day 2024-02-19] 2024-02-19 hour 10: 276549 events in 0 files, snapshot none (task 11870 ms: download 7871 ms overlapping gunzip 1791 ms, parse 7765 ms, sort 0 ms, write 0 ms, index 1537 ms: 8 candidates, 89727 repo-hours, 1177 releases; waiting 517 ms; commit 0 ms)
2026-11-08T04:44:45Z [load_day 2024-02-19] 2024-02-19 hour 11: 270513 events in 0 files, snapshot none (task 12244 ms: download 7709 ms overlapping gunzip 2050 ms, parse 8385 ms, sort 0 ms, write 0 ms, index 1105 ms: 7 candidates, 85230 repo-hours, 949 releases; waiting 472 ms; commit 0 ms)
2026-11-08T04:44:54Z [load_day 2024-02-19] 2024-02-19 hour 12: 310262 events in 0 files, snapshot none (task 12191 ms: download 7694 ms overlapping gunzip 1966 ms, parse 8341 ms, sort 0 ms, write 0 ms, index 1106 ms: 9 candidates, 115394 repo-hours, 1246 releases; waiting 444 ms; commit 0 ms)
2026-11-08T04:44:57Z [load_day 2024-02-19] 2024-02-19 hour 13: 295139 events in 0 files, snapshot none (task 11981 ms: download 8736 ms overlapping gunzip 2040 ms, parse 8167 ms, sort 0 ms, write 0 ms, index 946 ms: 5 candidates, 107656 repo-hours, 1080 releases; waiting 502 ms; commit 0 ms)
2026-11-08T04:45:05Z [load_day 2024-02-19] 2024-02-19 hour 14: 291149 events in 0 files, snapshot none (task 11098 ms: download 7649 ms overlapping gunzip 1875 ms, parse 7634 ms, sort 0 ms, write 0 ms, index 978 ms: 13 candidates, 98548 repo-hours, 1203 releases; waiting 358 ms; commit 0 ms)
2026-11-08T04:45:09Z [load_day 2024-02-19] 2024-02-19 hour 15: 293107 events in 0 files, snapshot none (task 11061 ms: download 7628 ms overlapping gunzip 1723 ms, parse 7054 ms, sort 0 ms, write 0 ms, index 1293 ms: 7 candidates, 101639 repo-hours, 1294 releases; waiting 495 ms; commit 0 ms)
2026-11-08T04:45:18Z [load_day 2024-02-19] 2024-02-19 hour 16: 295475 events in 0 files, snapshot none (task 12409 ms: download 8420 ms overlapping gunzip 1978 ms, parse 8504 ms, sort 0 ms, write 0 ms, index 1185 ms: 13 candidates, 120441 repo-hours, 1086 releases; waiting 516 ms; commit 0 ms)
2026-11-08T04:45:20Z [load_day 2024-02-19] 2024-02-19 hour 17: 281028 events in 0 files, snapshot none (task 10736 ms: download 8029 ms overlapping gunzip 1785 ms, parse 7441 ms, sort 0 ms, write 0 ms, index 782 ms: 10 candidates, 90195 repo-hours, 1173 releases; waiting 493 ms; commit 0 ms)
2026-11-08T04:45:29Z [load_day 2024-02-19] 2024-02-19 hour 18: 280766 events in 0 files, snapshot none (task 10273 ms: download 7275 ms overlapping gunzip 1689 ms, parse 7244 ms, sort 0 ms, write 0 ms, index 871 ms: 7 candidates, 93801 repo-hours, 1104 releases; waiting 181 ms; commit 0 ms)
2026-11-08T04:45:30Z [load_day 2024-02-19] 2024-02-19 hour 19: 268099 events in 0 files, snapshot none (task 9517 ms: download 6753 ms overlapping gunzip 1495 ms, parse 6441 ms, sort 0 ms, write 0 ms, index 739 ms: 2 candidates, 82808 repo-hours, 887 releases; waiting 461 ms; commit 0 ms)
2026-11-08T04:45:40Z [load_day 2024-02-19] 2024-02-19 hour 20: 254969 events in 0 files, snapshot none (task 10223 ms: download 6758 ms overlapping gunzip 1648 ms, parse 6876 ms, sort 0 ms, write 0 ms, index 977 ms: 10 candidates, 78479 repo-hours, 936 releases; waiting 511 ms; commit 0 ms)
2026-11-08T04:45:40Z [load_day 2024-02-19] 2024-02-19 hour 21: 249842 events in 0 files, snapshot none (task 9129 ms: download 6240 ms overlapping gunzip 1511 ms, parse 6153 ms, sort 0 ms, write 0 ms, index 708 ms: 10 candidates, 72979 repo-hours, 966 releases; waiting 509 ms; commit 0 ms)
2026-11-08T04:45:49Z [load_day 2024-02-19] 2024-02-19 hour 22: 239797 events in 0 files, snapshot none (task 8352 ms: download 5001 ms overlapping gunzip 1414 ms, parse 5433 ms, sort 0 ms, write 0 ms, index 720 ms: 7 candidates, 68256 repo-hours, 949 releases; waiting 433 ms; commit 0 ms)
2026-11-08T04:45:49Z [load_day 2024-02-19] 2024-02-19 hour 23: 222627 events in 0 files, snapshot none (task 8280 ms: download 4902 ms overlapping gunzip 1361 ms, parse 5550 ms, sort 0 ms, write 0 ms, index 653 ms: 5 candidates, 62000 repo-hours, 852 releases; waiting 310 ms; commit 0 ms)
2026-11-08T04:45:59Z [load_day 2024-02-19] 2024-02-19: repo_hour merged from 24 files to 1 (2014126 rows, 9912 ms)
2026-11-08T04:46:02Z [load_day 2024-02-19] 2024-02-19: index committed in 13340 ms (24 + 1 + 24 files)
2026-11-08T04:46:02Z [load_day 2024-02-19] 2024-02-19: 6130702 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T04:46:02Z [load_day 2024-02-19] attempt 1 succeeded