orcaLog in

Runs · run 2328

load_day 2024-04-15, attempt 1 succeeded

Host
73ccef5e07c2:110009
Started
2026-11-08T05:37:04Z
Ended
2026-11-08T05:39:11Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
947 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
203.6 s, up to 3.2 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/2328/load_day/2024-04-15/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T05:37:04Z [load_day 2024-04-15] attempt 1 started
2026-11-08T05:37:05Z [load_day 2024-04-15] 2024-04-15: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T05:37:12Z [load_day 2024-04-15] 2024-04-15 hour 0: 146562 events in 0 files, snapshot none (task 6717 ms: download 3748 ms overlapping gunzip 1147 ms, parse 4415 ms, sort 0 ms, write 0 ms, index 450 ms: 4 candidates, 49710 repo-hours, 747 releases; waiting 482 ms; commit 0 ms)
2026-11-08T05:37:13Z [load_day 2024-04-15] 2024-04-15 hour 1: 154936 events in 0 files, snapshot none (task 7206 ms: download 4465 ms overlapping gunzip 1313 ms, parse 4724 ms, sort 0 ms, write 0 ms, index 433 ms: 13 candidates, 52039 repo-hours, 625 releases; waiting 279 ms; commit 0 ms)
2026-11-08T05:37:20Z [load_day 2024-04-15] 2024-04-15 hour 2: 179719 events in 0 files, snapshot none (task 7383 ms: download 4547 ms overlapping gunzip 1248 ms, parse 4806 ms, sort 0 ms, write 0 ms, index 507 ms: 6 candidates, 72159 repo-hours, 931 releases; waiting 522 ms; commit 0 ms)
2026-11-08T05:37:22Z [load_day 2024-04-15] 2024-04-15 hour 3: 225873 events in 0 files, snapshot none (task 8543 ms: download 5849 ms overlapping gunzip 1379 ms, parse 5425 ms, sort 0 ms, write 0 ms, index 914 ms: 9 candidates, 114396 repo-hours, 1130 releases; waiting 529 ms; commit 0 ms)
2026-11-08T05:37:28Z [load_day 2024-04-15] 2024-04-15 hour 4: 183731 events in 0 files, snapshot none (task 6916 ms: download 4734 ms overlapping gunzip 1169 ms, parse 4581 ms, sort 0 ms, write 0 ms, index 430 ms: 10 candidates, 64355 repo-hours, 989 releases; waiting 502 ms; commit 0 ms)
2026-11-08T05:37:29Z [load_day 2024-04-15] 2024-04-15 hour 5: 193484 events in 0 files, snapshot none (task 6724 ms: download 4344 ms overlapping gunzip 1131 ms, parse 4165 ms, sort 0 ms, write 0 ms, index 594 ms: 8 candidates, 70312 repo-hours, 931 releases; waiting 525 ms; commit 0 ms)
2026-11-08T05:37:36Z [load_day 2024-04-15] 2024-04-15 hour 6: 221337 events in 0 files, snapshot none (task 7737 ms: download 5126 ms overlapping gunzip 1285 ms, parse 5045 ms, sort 0 ms, write 0 ms, index 623 ms: 6 candidates, 86540 repo-hours, 1136 releases; waiting 517 ms; commit 0 ms)
2026-11-08T05:37:38Z [load_day 2024-04-15] 2024-04-15 hour 7: 228368 events in 0 files, snapshot none (task 7731 ms: download 5423 ms overlapping gunzip 1273 ms, parse 5078 ms, sort 0 ms, write 0 ms, index 589 ms: 5 candidates, 86186 repo-hours, 1111 releases; waiting 543 ms; commit 0 ms)
2026-11-08T05:37:46Z [load_day 2024-04-15] 2024-04-15 hour 8: 246880 events in 0 files, snapshot none (task 9910 ms: download 6679 ms overlapping gunzip 1619 ms, parse 6689 ms, sort 0 ms, write 0 ms, index 772 ms: 10 candidates, 94943 repo-hours, 1267 releases; waiting 520 ms; commit 0 ms)
2026-11-08T05:37:48Z [load_day 2024-04-15] 2024-04-15 hour 9: 245845 events in 0 files, snapshot none (task 10376 ms: download 7761 ms overlapping gunzip 1615 ms, parse 7091 ms, sort 0 ms, write 0 ms, index 819 ms: 7 candidates, 94923 repo-hours, 1340 releases; waiting 540 ms; commit 0 ms)
2026-11-08T05:37:55Z [load_day 2024-04-15] 2024-04-15 hour 10: 243195 events in 0 files, snapshot none (task 8806 ms: download 6350 ms overlapping gunzip 1595 ms, parse 6360 ms, sort 0 ms, write 0 ms, index 644 ms: 7 candidates, 93979 repo-hours, 1078 releases; waiting 15 ms; commit 0 ms)
2026-11-08T05:37:58Z [load_day 2024-04-15] 2024-04-15 hour 11: 244245 events in 0 files, snapshot none (task 9365 ms: download 6146 ms overlapping gunzip 1497 ms, parse 6061 ms, sort 0 ms, write 0 ms, index 1071 ms: 10 candidates, 91908 repo-hours, 1108 releases; waiting 471 ms; commit 0 ms)
2026-11-08T05:38:06Z [load_day 2024-04-15] 2024-04-15 hour 12: 297288 events in 0 files, snapshot none (task 10161 ms: download 6511 ms overlapping gunzip 1619 ms, parse 7066 ms, sort 0 ms, write 0 ms, index 1257 ms: 11 candidates, 123917 repo-hours, 1262 releases; waiting 17 ms; commit 0 ms)
2026-11-08T05:38:08Z [load_day 2024-04-15] 2024-04-15 hour 13: 274126 events in 0 files, snapshot none (task 9752 ms: download 6529 ms overlapping gunzip 1628 ms, parse 6873 ms, sort 0 ms, write 0 ms, index 1037 ms: 11 candidates, 117116 repo-hours, 1361 releases; waiting 1 ms; commit 0 ms)
2026-11-08T05:38:19Z [load_day 2024-04-15] 2024-04-15 hour 14: 269904 events in 0 files, snapshot none (task 12769 ms: download 9700 ms overlapping gunzip 2190 ms, parse 9008 ms, sort 0 ms, write 0 ms, index 838 ms: 14 candidates, 106695 repo-hours, 1316 releases; waiting 515 ms; commit 0 ms)
2026-11-08T05:38:19Z [load_day 2024-04-15] 2024-04-15 hour 15: 270479 events in 0 files, snapshot none (task 10242 ms: download 7468 ms overlapping gunzip 1786 ms, parse 7385 ms, sort 0 ms, write 0 ms, index 850 ms: 7 candidates, 105259 repo-hours, 1573 releases; waiting 22 ms; commit 0 ms)
2026-11-08T05:38:31Z [load_day 2024-04-15] 2024-04-15 hour 16: 256808 events in 0 files, snapshot none (task 10612 ms: download 7689 ms overlapping gunzip 1730 ms, parse 7144 ms, sort 0 ms, write 0 ms, index 766 ms: 17 candidates, 99206 repo-hours, 1304 releases; waiting 517 ms; commit 0 ms)
2026-11-08T05:38:31Z [load_day 2024-04-15] 2024-04-15 hour 17: 241047 events in 0 files, snapshot none (task 9151 ms: download 5741 ms overlapping gunzip 1626 ms, parse 6368 ms, sort 0 ms, write 0 ms, index 910 ms: 13 candidates, 91313 repo-hours, 1156 releases; waiting 14 ms; commit 0 ms)
2026-11-08T05:38:41Z [load_day 2024-04-15] 2024-04-15 hour 18: 252394 events in 0 files, snapshot none (task 9496 ms: download 6692 ms overlapping gunzip 1732 ms, parse 6824 ms, sort 0 ms, write 0 ms, index 741 ms: 21 candidates, 100148 repo-hours, 1242 releases; waiting 16 ms; commit 0 ms)
2026-11-08T05:38:41Z [load_day 2024-04-15] 2024-04-15 hour 19: 231253 events in 0 files, snapshot none (task 8879 ms: download 6124 ms overlapping gunzip 1639 ms, parse 6312 ms, sort 0 ms, write 0 ms, index 725 ms: 14 candidates, 86095 repo-hours, 1158 releases; waiting 12 ms; commit 0 ms)
2026-11-08T05:38:50Z [load_day 2024-04-15] 2024-04-15 hour 20: 232042 events in 0 files, snapshot none (task 9460 ms: download 6785 ms overlapping gunzip 1669 ms, parse 6919 ms, sort 0 ms, write 0 ms, index 661 ms: 14 candidates, 85869 repo-hours, 1069 releases; waiting 9 ms; commit 0 ms)
2026-11-08T05:38:50Z [load_day 2024-04-15] 2024-04-15 hour 21: 208582 events in 0 files, snapshot none (task 8749 ms: download 6013 ms overlapping gunzip 1547 ms, parse 6282 ms, sort 0 ms, write 0 ms, index 725 ms: 5 candidates, 73630 repo-hours, 1156 releases; waiting 2 ms; commit 0 ms)
2026-11-08T05:38:59Z [load_day 2024-04-15] 2024-04-15 hour 22: 198740 events in 0 files, snapshot none (task 8412 ms: download 5591 ms overlapping gunzip 1500 ms, parse 6103 ms, sort 0 ms, write 0 ms, index 608 ms: 5 candidates, 68548 repo-hours, 993 releases; waiting 16 ms; commit 0 ms)
2026-11-08T05:38:59Z [load_day 2024-04-15] 2024-04-15 hour 23: 203411 events in 0 files, snapshot none (task 8217 ms: download 4946 ms overlapping gunzip 1537 ms, parse 5867 ms, sort 0 ms, write 0 ms, index 611 ms: 8 candidates, 66151 repo-hours, 807 releases; waiting 19 ms; commit 0 ms)
2026-11-08T05:39:08Z [load_day 2024-04-15] 2024-04-15: repo_hour merged from 24 files to 1 (2095397 rows, 8823 ms)
2026-11-08T05:39:11Z [load_day 2024-04-15] 2024-04-15: index committed in 11396 ms (24 + 1 + 24 files)
2026-11-08T05:39:11Z [load_day 2024-04-15] 2024-04-15: 5450249 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T05:39:11Z [load_day 2024-04-15] attempt 1 succeeded