orcaLog in

Runs · run 2091

load_day 2024-02-16, attempt 1 succeeded

Host
73ccef5e07c2:87307
Started
2026-11-08T04:40:35Z
Ended
2026-11-08T04:42:33Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
669 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
173.2 s, up to 2.9 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/2091/load_day/2024-02-16/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T04:40:35Z [load_day 2024-02-16] attempt 1 started
2026-11-08T04:40:36Z [load_day 2024-02-16] 2024-02-16: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T04:40:46Z [load_day 2024-02-16] 2024-02-16 hour 0: 246120 events in 0 files, snapshot none (task 9412 ms: download 5846 ms overlapping gunzip 1448 ms, parse 6449 ms, sort 0 ms, write 0 ms, index 1006 ms: 6 candidates, 90966 repo-hours, 1169 releases; waiting 244 ms; commit 0 ms)
2026-11-08T04:40:46Z [load_day 2024-02-16] 2024-02-16 hour 1: 232272 events in 0 files, snapshot none (task 8746 ms: download 5200 ms overlapping gunzip 1364 ms, parse 5814 ms, sort 0 ms, write 0 ms, index 863 ms: 5 candidates, 86938 repo-hours, 731 releases; waiting 475 ms; commit 0 ms)
2026-11-08T04:40:53Z [load_day 2024-02-16] 2024-02-16 hour 2: 205196 events in 0 files, snapshot none (task 7061 ms: download 4433 ms overlapping gunzip 1032 ms, parse 4597 ms, sort 0 ms, write 0 ms, index 691 ms: 6 candidates, 55637 repo-hours, 746 releases; waiting 474 ms; commit 0 ms)
2026-11-08T04:40:53Z [load_day 2024-02-16] 2024-02-16 hour 3: 184537 events in 0 files, snapshot none (task 6630 ms: download 3451 ms overlapping gunzip 1062 ms, parse 4405 ms, sort 0 ms, write 0 ms, index 438 ms: 5 candidates, 55544 repo-hours, 753 releases; waiting 484 ms; commit 0 ms)
2026-11-08T04:41:01Z [load_day 2024-02-16] 2024-02-16 hour 4: 177594 events in 0 files, snapshot none (task 6605 ms: download 3784 ms overlapping gunzip 1041 ms, parse 4285 ms, sort 0 ms, write 0 ms, index 523 ms: 7 candidates, 55792 repo-hours, 668 releases; waiting 489 ms; commit 0 ms)
2026-11-08T04:41:01Z [load_day 2024-02-16] 2024-02-16 hour 5: 198833 events in 0 files, snapshot none (task 6274 ms: download 3383 ms overlapping gunzip 900 ms, parse 4086 ms, sort 0 ms, write 0 ms, index 540 ms: 7 candidates, 57768 repo-hours, 694 releases; waiting 480 ms; commit 0 ms)
2026-11-08T04:41:09Z [load_day 2024-02-16] 2024-02-16 hour 6: 223651 events in 0 files, snapshot none (task 8123 ms: download 5165 ms overlapping gunzip 1247 ms, parse 5403 ms, sort 0 ms, write 0 ms, index 607 ms: 6 candidates, 67591 repo-hours, 782 releases; waiting 525 ms; commit 0 ms)
2026-11-08T04:41:09Z [load_day 2024-02-16] 2024-02-16 hour 7: 223790 events in 0 files, snapshot none (task 7492 ms: download 4526 ms overlapping gunzip 1167 ms, parse 4805 ms, sort 0 ms, write 0 ms, index 735 ms: 8 candidates, 64204 repo-hours, 690 releases; waiting 481 ms; commit 0 ms)
2026-11-08T04:41:18Z [load_day 2024-02-16] 2024-02-16 hour 8: 234575 events in 0 files, snapshot none (task 8210 ms: download 5226 ms overlapping gunzip 1277 ms, parse 5500 ms, sort 0 ms, write 0 ms, index 797 ms: 8 candidates, 73469 repo-hours, 886 releases; waiting 390 ms; commit 0 ms)
2026-11-08T04:41:19Z [load_day 2024-02-16] 2024-02-16 hour 9: 250672 events in 0 files, snapshot none (task 9662 ms: download 6773 ms overlapping gunzip 1469 ms, parse 6643 ms, sort 0 ms, write 0 ms, index 757 ms: 6 candidates, 79355 repo-hours, 1133 releases; waiting 468 ms; commit 0 ms)
2026-11-08T04:41:28Z [load_day 2024-02-16] 2024-02-16 hour 10: 253131 events in 0 files, snapshot none (task 9550 ms: download 6684 ms overlapping gunzip 1521 ms, parse 6515 ms, sort 0 ms, write 0 ms, index 752 ms: 5 candidates, 81071 repo-hours, 999 releases; waiting 504 ms; commit 0 ms)
2026-11-08T04:41:28Z [load_day 2024-02-16] 2024-02-16 hour 11: 248273 events in 0 files, snapshot none (task 8270 ms: download 5604 ms overlapping gunzip 1242 ms, parse 5590 ms, sort 0 ms, write 0 ms, index 609 ms: 6 candidates, 75520 repo-hours, 956 releases; waiting 507 ms; commit 0 ms)
2026-11-08T04:41:36Z [load_day 2024-02-16] 2024-02-16 hour 12: 301373 events in 0 files, snapshot none (task 7693 ms: download 4851 ms overlapping gunzip 1098 ms, parse 5102 ms, sort 0 ms, write 0 ms, index 733 ms: 8 candidates, 107623 repo-hours, 972 releases; waiting 518 ms; commit 0 ms)
2026-11-08T04:41:36Z [load_day 2024-02-16] 2024-02-16 hour 13: 277671 events in 0 files, snapshot none (task 7620 ms: download 5003 ms overlapping gunzip 1124 ms, parse 5240 ms, sort 0 ms, write 0 ms, index 743 ms: 6 candidates, 101005 repo-hours, 1110 releases; waiting 270 ms; commit 0 ms)
2026-11-08T04:41:45Z [load_day 2024-02-16] 2024-02-16 hour 14: 274980 events in 0 files, snapshot none (task 8580 ms: download 5685 ms overlapping gunzip 1220 ms, parse 5344 ms, sort 0 ms, write 0 ms, index 859 ms: 8 candidates, 90976 repo-hours, 1204 releases; waiting 745 ms; commit 0 ms)
2026-11-08T04:41:45Z [load_day 2024-02-16] 2024-02-16 hour 15: 277030 events in 0 files, snapshot none (task 8020 ms: download 5363 ms overlapping gunzip 1240 ms, parse 5327 ms, sort 0 ms, write 0 ms, index 688 ms: 7 candidates, 92530 repo-hours, 1266 releases; waiting 534 ms; commit 0 ms)
2026-11-08T04:41:57Z [load_day 2024-02-16] 2024-02-16 hour 16: 273033 events in 0 files, snapshot none (task 11258 ms: download 7920 ms overlapping gunzip 1852 ms, parse 7662 ms, sort 0 ms, write 0 ms, index 993 ms: 10 candidates, 90012 repo-hours, 1004 releases; waiting 481 ms; commit 0 ms)
2026-11-08T04:41:57Z [load_day 2024-02-16] 2024-02-16 hour 17: 262166 events in 0 files, snapshot none (task 10048 ms: download 6777 ms overlapping gunzip 1513 ms, parse 6572 ms, sort 0 ms, write 0 ms, index 1184 ms: 2 candidates, 84287 repo-hours, 1069 releases; waiting 446 ms; commit 0 ms)
2026-11-08T04:42:07Z [load_day 2024-02-16] 2024-02-16 hour 18: 267537 events in 0 files, snapshot none (task 9826 ms: download 7402 ms overlapping gunzip 1649 ms, parse 6727 ms, sort 0 ms, write 0 ms, index 668 ms: 8 candidates, 91014 repo-hours, 1121 releases; waiting 531 ms; commit 0 ms)
2026-11-08T04:42:07Z [load_day 2024-02-16] 2024-02-16 hour 19: 242474 events in 0 files, snapshot none (task 8768 ms: download 5970 ms overlapping gunzip 1386 ms, parse 6037 ms, sort 0 ms, write 0 ms, index 543 ms: 12 candidates, 74177 repo-hours, 1015 releases; waiting 531 ms; commit 0 ms)
2026-11-08T04:42:15Z [load_day 2024-02-16] 2024-02-16 hour 20: 229362 events in 0 files, snapshot none (task 7624 ms: download 4421 ms overlapping gunzip 1153 ms, parse 5109 ms, sort 0 ms, write 0 ms, index 622 ms: 9 candidates, 71461 repo-hours, 941 releases; waiting 497 ms; commit 0 ms)
2026-11-08T04:42:15Z [load_day 2024-02-16] 2024-02-16 hour 21: 230201 events in 0 files, snapshot none (task 7515 ms: download 4342 ms overlapping gunzip 1283 ms, parse 5170 ms, sort 0 ms, write 0 ms, index 659 ms: 12 candidates, 68097 repo-hours, 918 releases; waiting 198 ms; commit 0 ms)
2026-11-08T04:42:23Z [load_day 2024-02-16] 2024-02-16 hour 22: 218748 events in 0 files, snapshot none (task 6918 ms: download 4151 ms overlapping gunzip 1117 ms, parse 4593 ms, sort 0 ms, write 0 ms, index 440 ms: 4 candidates, 60695 repo-hours, 974 releases; waiting 506 ms; commit 0 ms)
2026-11-08T04:42:23Z [load_day 2024-02-16] 2024-02-16 hour 23: 199126 events in 0 files, snapshot none (task 6431 ms: download 3615 ms overlapping gunzip 969 ms, parse 4199 ms, sort 0 ms, write 0 ms, index 525 ms: 7 candidates, 53852 repo-hours, 776 releases; waiting 468 ms; commit 0 ms)
2026-11-08T04:42:31Z [load_day 2024-02-16] 2024-02-16: repo_hour merged from 24 files to 1 (1829584 rows, 8114 ms)
2026-11-08T04:42:33Z [load_day 2024-02-16] 2024-02-16: index committed in 10450 ms (24 + 1 + 24 files)
2026-11-08T04:42:33Z [load_day 2024-02-16] 2024-02-16: 5732345 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T04:42:33Z [load_day 2024-02-16] attempt 1 succeeded