orcaLog in

Runs · run 3192

load_day 2024-11-11, attempt 1 succeeded

Host
73ccef5e07c2:205853
Started
2026-11-08T08:45:50Z
Ended
2026-11-08T08:48:13Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
749 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
232.7 s, up to 2.8 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/3192/load_day/2024-11-11/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T08:45:50Z [load_day 2024-11-11] attempt 1 started
2026-11-08T08:45:51Z [load_day 2024-11-11] 2024-11-11: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T08:46:00Z [load_day 2024-11-11] 2024-11-11 hour 0: 186467 events in 0 files, snapshot none (task 8055 ms: download 5258 ms overlapping gunzip 1273 ms, parse 5045 ms, sort 0 ms, write 0 ms, index 652 ms: 6 candidates, 90335 repo-hours, 1078 releases; waiting 758 ms; commit 0 ms)
2026-11-08T08:46:00Z [load_day 2024-11-11] 2024-11-11 hour 1: 203211 events in 0 files, snapshot none (task 8158 ms: download 5545 ms overlapping gunzip 1207 ms, parse 4886 ms, sort 0 ms, write 0 ms, index 744 ms: 8 candidates, 107255 repo-hours, 903 releases; waiting 975 ms; commit 0 ms)
2026-11-08T08:46:09Z [load_day 2024-11-11] 2024-11-11 hour 2: 191769 events in 0 files, snapshot none (task 8622 ms: download 6050 ms overlapping gunzip 1462 ms, parse 5670 ms, sort 0 ms, write 0 ms, index 735 ms: 5 candidates, 78317 repo-hours, 853 releases; waiting 524 ms; commit 0 ms)
2026-11-08T08:46:10Z [load_day 2024-11-11] 2024-11-11 hour 3: 211077 events in 0 files, snapshot none (task 9240 ms: download 6788 ms overlapping gunzip 1574 ms, parse 6070 ms, sort 0 ms, write 0 ms, index 803 ms: 2 candidates, 78670 repo-hours, 3897 releases; waiting 528 ms; commit 0 ms)
2026-11-08T08:46:18Z [load_day 2024-11-11] 2024-11-11 hour 4: 196603 events in 0 files, snapshot none (task 8484 ms: download 5379 ms overlapping gunzip 1396 ms, parse 5562 ms, sort 0 ms, write 0 ms, index 761 ms: 5 candidates, 66902 repo-hours, 752 releases; waiting 489 ms; commit 0 ms)
2026-11-08T08:46:19Z [load_day 2024-11-11] 2024-11-11 hour 5: 202524 events in 0 files, snapshot none (task 8962 ms: download 6278 ms overlapping gunzip 1599 ms, parse 5908 ms, sort 0 ms, write 0 ms, index 596 ms: 7 candidates, 69557 repo-hours, 727 releases; waiting 480 ms; commit 0 ms)
2026-11-08T08:46:28Z [load_day 2024-11-11] 2024-11-11 hour 6: 224911 events in 0 files, snapshot none (task 9877 ms: download 6518 ms overlapping gunzip 1653 ms, parse 6387 ms, sort 0 ms, write 0 ms, index 973 ms: 7 candidates, 90304 repo-hours, 916 releases; waiting 545 ms; commit 0 ms)
2026-11-08T08:46:29Z [load_day 2024-11-11] 2024-11-11 hour 7: 219343 events in 0 files, snapshot none (task 9698 ms: download 7195 ms overlapping gunzip 1634 ms, parse 6617 ms, sort 0 ms, write 0 ms, index 683 ms: 6 candidates, 80351 repo-hours, 766 releases; waiting 517 ms; commit 0 ms)
2026-11-08T08:46:39Z [load_day 2024-11-11] 2024-11-11 hour 8: 232864 events in 0 files, snapshot none (task 10704 ms: download 7889 ms overlapping gunzip 1884 ms, parse 7234 ms, sort 0 ms, write 0 ms, index 787 ms: 3 candidates, 90483 repo-hours, 1122 releases; waiting 524 ms; commit 0 ms)
2026-11-08T08:46:41Z [load_day 2024-11-11] 2024-11-11 hour 9: 245574 events in 0 files, snapshot none (task 11077 ms: download 8537 ms overlapping gunzip 1897 ms, parse 7565 ms, sort 0 ms, write 0 ms, index 772 ms: 6 candidates, 98404 repo-hours, 1199 releases; waiting 520 ms; commit 0 ms)
2026-11-08T08:46:51Z [load_day 2024-11-11] 2024-11-11 hour 10: 240379 events in 0 files, snapshot none (task 10881 ms: download 8462 ms overlapping gunzip 1824 ms, parse 7542 ms, sort 0 ms, write 0 ms, index 728 ms: 8 candidates, 92757 repo-hours, 1076 releases; waiting 521 ms; commit 0 ms)
2026-11-08T08:46:53Z [load_day 2024-11-11] 2024-11-11 hour 11: 240897 events in 0 files, snapshot none (task 11334 ms: download 8239 ms overlapping gunzip 1926 ms, parse 7476 ms, sort 0 ms, write 0 ms, index 1107 ms: 7 candidates, 87859 repo-hours, 1064 releases; waiting 509 ms; commit 0 ms)
2026-11-08T08:47:01Z [load_day 2024-11-11] 2024-11-11 hour 12: 275276 events in 0 files, snapshot none (task 10001 ms: download 5850 ms overlapping gunzip 1508 ms, parse 6215 ms, sort 0 ms, write 0 ms, index 1445 ms: 8 candidates, 135354 repo-hours, 1287 releases; waiting 456 ms; commit 0 ms)
2026-11-08T08:47:04Z [load_day 2024-11-11] 2024-11-11 hour 13: 273071 events in 0 files, snapshot none (task 10780 ms: download 8111 ms overlapping gunzip 1806 ms, parse 7270 ms, sort 0 ms, write 0 ms, index 835 ms: 9 candidates, 116683 repo-hours, 1157 releases; waiting 514 ms; commit 0 ms)
2026-11-08T08:47:12Z [load_day 2024-11-11] 2024-11-11 hour 14: 263415 events in 0 files, snapshot none (task 9801 ms: download 7242 ms overlapping gunzip 1703 ms, parse 6686 ms, sort 0 ms, write 0 ms, index 752 ms: 9 candidates, 102967 repo-hours, 1262 releases; waiting 407 ms; commit 0 ms)
2026-11-08T08:47:15Z [load_day 2024-11-11] 2024-11-11 hour 15: 267545 events in 0 files, snapshot none (task 9844 ms: download 7406 ms overlapping gunzip 1709 ms, parse 6483 ms, sort 0 ms, write 0 ms, index 784 ms: 11 candidates, 109642 repo-hours, 1384 releases; waiting 591 ms; commit 0 ms)
2026-11-08T08:47:26Z [load_day 2024-11-11] 2024-11-11 hour 16: 260435 events in 0 files, snapshot none (task 13716 ms: download 10946 ms overlapping gunzip 2088 ms, parse 8257 ms, sort 0 ms, write 0 ms, index 786 ms: 8 candidates, 104750 repo-hours, 1228 releases; waiting 2342 ms; commit 0 ms)
2026-11-08T08:47:27Z [load_day 2024-11-11] 2024-11-11 hour 17: 254369 events in 0 files, snapshot none (task 11656 ms: download 9159 ms overlapping gunzip 1965 ms, parse 8041 ms, sort 0 ms, write 0 ms, index 882 ms: 5 candidates, 96320 repo-hours, 1176 releases; waiting 504 ms; commit 0 ms)
2026-11-08T08:47:38Z [load_day 2024-11-11] 2024-11-11 hour 18: 256621 events in 0 files, snapshot none (task 11662 ms: download 8357 ms overlapping gunzip 1990 ms, parse 7749 ms, sort 0 ms, write 0 ms, index 1114 ms: 7 candidates, 108022 repo-hours, 1289 releases; waiting 404 ms; commit 0 ms)
2026-11-08T08:47:39Z [load_day 2024-11-11] 2024-11-11 hour 19: 236446 events in 0 files, snapshot none (task 11523 ms: download 7907 ms overlapping gunzip 1994 ms, parse 7628 ms, sort 0 ms, write 0 ms, index 911 ms: 12 candidates, 85373 repo-hours, 1145 releases; waiting 522 ms; commit 0 ms)
2026-11-08T08:47:50Z [load_day 2024-11-11] 2024-11-11 hour 20: 230332 events in 0 files, snapshot none (task 10577 ms: download 7460 ms overlapping gunzip 1826 ms, parse 7183 ms, sort 0 ms, write 0 ms, index 819 ms: 11 candidates, 83174 repo-hours, 1052 releases; waiting 503 ms; commit 0 ms)
2026-11-08T08:47:50Z [load_day 2024-11-11] 2024-11-11 hour 21: 227417 events in 0 files, snapshot none (task 10674 ms: download 8038 ms overlapping gunzip 1812 ms, parse 7315 ms, sort 0 ms, write 0 ms, index 683 ms: 7 candidates, 82832 repo-hours, 1062 releases; waiting 501 ms; commit 0 ms)
2026-11-08T08:48:00Z [load_day 2024-11-11] 2024-11-11 hour 22: 215655 events in 0 files, snapshot none (task 9391 ms: download 6470 ms overlapping gunzip 1662 ms, parse 6619 ms, sort 0 ms, write 0 ms, index 711 ms: 10 candidates, 72489 repo-hours, 1093 releases; waiting 185 ms; commit 0 ms)
2026-11-08T08:48:01Z [load_day 2024-11-11] 2024-11-11 hour 23: 202579 events in 0 files, snapshot none (task 10124 ms: download 7662 ms overlapping gunzip 1694 ms, parse 6246 ms, sort 0 ms, write 0 ms, index 548 ms: 7 candidates, 68344 repo-hours, 795 releases; waiting 1258 ms; commit 0 ms)
2026-11-08T08:48:11Z [load_day 2024-11-11] 2024-11-11: repo_hour merged from 24 files to 1 (2197144 rows, 10286 ms)
2026-11-08T08:48:13Z [load_day 2024-11-11] 2024-11-11: index committed in 12722 ms (24 + 1 + 24 files)
2026-11-08T08:48:13Z [load_day 2024-11-11] 2024-11-11: 5558780 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T08:48:13Z [load_day 2024-11-11] attempt 1 succeeded