orcaLog in

Runs · run 3895

load_day 2025-05-13, attempt 1 succeeded

Host
73ccef5e07c2:303847
Started
2026-11-08T11:55:03Z
Ended
2026-11-08T11:57:27Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
887 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
217.5 s, up to 2.9 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/3895/load_day/2025-05-13/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T11:55:03Z [load_day 2025-05-13] attempt 1 started
2026-11-08T11:55:04Z [load_day 2025-05-13] 2025-05-13: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T11:55:14Z [load_day 2025-05-13] 2025-05-13 hour 0: 205596 events in 0 files, snapshot none (task 9384 ms: download 6411 ms overlapping gunzip 1532 ms, parse 6543 ms, sort 0 ms, write 0 ms, index 915 ms: 20 candidates, 95320 repo-hours, 1273 releases; waiting 151 ms; commit 0 ms)
2026-11-08T11:55:14Z [load_day 2025-05-13] 2025-05-13 hour 1: 231775 events in 0 files, snapshot none (task 8975 ms: download 5829 ms overlapping gunzip 1315 ms, parse 5891 ms, sort 0 ms, write 0 ms, index 941 ms: 11 candidates, 126210 repo-hours, 940 releases; waiting 472 ms; commit 0 ms)
2026-11-08T11:55:23Z [load_day 2025-05-13] 2025-05-13 hour 2: 200838 events in 0 files, snapshot none (task 8141 ms: download 5424 ms overlapping gunzip 1174 ms, parse 5199 ms, sort 0 ms, write 0 ms, index 746 ms: 8 candidates, 91626 repo-hours, 936 releases; waiting 612 ms; commit 0 ms)
2026-11-08T11:55:23Z [load_day 2025-05-13] 2025-05-13 hour 3: 205357 events in 0 files, snapshot none (task 8499 ms: download 5578 ms overlapping gunzip 1291 ms, parse 5427 ms, sort 0 ms, write 0 ms, index 720 ms: 8 candidates, 86941 repo-hours, 2808 releases; waiting 554 ms; commit 0 ms)
2026-11-08T11:55:32Z [load_day 2025-05-13] 2025-05-13 hour 4: 194835 events in 0 files, snapshot none (task 8478 ms: download 4885 ms overlapping gunzip 1271 ms, parse 5672 ms, sort 0 ms, write 0 ms, index 802 ms: 4 candidates, 75494 repo-hours, 806 releases; waiting 518 ms; commit 0 ms)
2026-11-08T11:55:33Z [load_day 2025-05-13] 2025-05-13 hour 5: 205421 events in 0 files, snapshot none (task 9469 ms: download 6460 ms overlapping gunzip 1547 ms, parse 6451 ms, sort 0 ms, write 0 ms, index 640 ms: 4 candidates, 83553 repo-hours, 907 releases; waiting 490 ms; commit 0 ms)
2026-11-08T11:55:42Z [load_day 2025-05-13] 2025-05-13 hour 6: 234411 events in 0 files, snapshot none (task 10019 ms: download 5922 ms overlapping gunzip 1510 ms, parse 6467 ms, sort 0 ms, write 0 ms, index 1260 ms: 11 candidates, 107736 repo-hours, 1179 releases; waiting 490 ms; commit 0 ms)
2026-11-08T11:55:46Z [load_day 2025-05-13] 2025-05-13 hour 7: 247949 events in 0 files, snapshot none (task 12509 ms: download 8363 ms overlapping gunzip 1897 ms, parse 8001 ms, sort 0 ms, write 0 ms, index 1723 ms: 14 candidates, 105472 repo-hours, 1170 releases; waiting 494 ms; commit 0 ms)
2026-11-08T11:55:52Z [load_day 2025-05-13] 2025-05-13 hour 8: 256967 events in 0 files, snapshot none (task 8885 ms: download 6187 ms overlapping gunzip 1495 ms, parse 5998 ms, sort 0 ms, write 0 ms, index 855 ms: 7 candidates, 112581 repo-hours, 1370 releases; waiting 281 ms; commit 0 ms)
2026-11-08T11:55:56Z [load_day 2025-05-13] 2025-05-13 hour 9: 261684 events in 0 files, snapshot none (task 8732 ms: download 5851 ms overlapping gunzip 1335 ms, parse 5709 ms, sort 0 ms, write 0 ms, index 927 ms: 7 candidates, 114095 repo-hours, 1394 releases; waiting 514 ms; commit 0 ms)
2026-11-08T11:56:01Z [load_day 2025-05-13] 2025-05-13 hour 10: 254402 events in 0 files, snapshot none (task 8476 ms: download 5580 ms overlapping gunzip 1295 ms, parse 5343 ms, sort 0 ms, write 0 ms, index 1005 ms: 3 candidates, 111999 repo-hours, 1223 releases; waiting 506 ms; commit 0 ms)
2026-11-08T11:56:05Z [load_day 2025-05-13] 2025-05-13 hour 11: 255328 events in 0 files, snapshot none (task 8037 ms: download 5181 ms overlapping gunzip 1265 ms, parse 5286 ms, sort 0 ms, write 0 ms, index 869 ms: 1 candidates, 106447 repo-hours, 1233 releases; waiting 342 ms; commit 0 ms)
2026-11-08T11:56:12Z [load_day 2025-05-13] 2025-05-13 hour 12: 282981 events in 0 files, snapshot none (task 11307 ms: download 7358 ms overlapping gunzip 1688 ms, parse 7322 ms, sort 0 ms, write 0 ms, index 1232 ms: 8 candidates, 148379 repo-hours, 1443 releases; waiting 677 ms; commit 0 ms)
2026-11-08T11:56:18Z [load_day 2025-05-13] 2025-05-13 hour 13: 283529 events in 0 files, snapshot none (task 12720 ms: download 8411 ms overlapping gunzip 1939 ms, parse 8437 ms, sort 0 ms, write 0 ms, index 1593 ms: 4 candidates, 139394 repo-hours, 1375 releases; waiting 496 ms; commit 0 ms)
2026-11-08T11:56:23Z [load_day 2025-05-13] 2025-05-13 hour 14: 274259 events in 0 files, snapshot none (task 10451 ms: download 7465 ms overlapping gunzip 1638 ms, parse 7054 ms, sort 0 ms, write 0 ms, index 989 ms: 8 candidates, 120879 repo-hours, 1482 releases; waiting 480 ms; commit 0 ms)
2026-11-08T11:56:30Z [load_day 2025-05-13] 2025-05-13 hour 15: 272225 events in 0 files, snapshot none (task 10917 ms: download 7031 ms overlapping gunzip 1754 ms, parse 7436 ms, sort 0 ms, write 0 ms, index 1233 ms: 7 candidates, 123148 repo-hours, 1475 releases; waiting 185 ms; commit 0 ms)
2026-11-08T11:56:36Z [load_day 2025-05-13] 2025-05-13 hour 16: 260931 events in 0 files, snapshot none (task 11842 ms: download 7576 ms overlapping gunzip 1897 ms, parse 7850 ms, sort 0 ms, write 0 ms, index 1309 ms: 8 candidates, 114512 repo-hours, 1190 releases; waiting 485 ms; commit 0 ms)
2026-11-08T11:56:41Z [load_day 2025-05-13] 2025-05-13 hour 17: 254644 events in 0 files, snapshot none (task 10844 ms: download 7652 ms overlapping gunzip 1699 ms, parse 7352 ms, sort 0 ms, write 0 ms, index 1141 ms: 11 candidates, 106223 repo-hours, 1082 releases; waiting 363 ms; commit 0 ms)
2026-11-08T11:56:48Z [load_day 2025-05-13] 2025-05-13 hour 18: 257028 events in 0 files, snapshot none (task 11827 ms: download 6964 ms overlapping gunzip 1850 ms, parse 7762 ms, sort 0 ms, write 0 ms, index 1415 ms: 7 candidates, 115419 repo-hours, 1316 releases; waiting 488 ms; commit 0 ms)
2026-11-08T11:56:54Z [load_day 2025-05-13] 2025-05-13 hour 19: 241115 events in 0 files, snapshot none (task 12691 ms: download 8645 ms overlapping gunzip 2021 ms, parse 8862 ms, sort 0 ms, write 0 ms, index 1055 ms: 6 candidates, 97260 repo-hours, 1189 releases; waiting 473 ms; commit 0 ms)
2026-11-08T11:57:00Z [load_day 2025-05-13] 2025-05-13 hour 20: 236602 events in 0 files, snapshot none (task 10755 ms: download 6664 ms overlapping gunzip 1645 ms, parse 6615 ms, sort 0 ms, write 0 ms, index 1470 ms: 9 candidates, 98825 repo-hours, 1245 releases; waiting 606 ms; commit 0 ms)
2026-11-08T11:57:05Z [load_day 2025-05-13] 2025-05-13 hour 21: 218037 events in 0 files, snapshot none (task 9949 ms: download 6391 ms overlapping gunzip 1616 ms, parse 6726 ms, sort 0 ms, write 0 ms, index 737 ms: 10 candidates, 88063 repo-hours, 1225 releases; waiting 530 ms; commit 0 ms)
2026-11-08T11:57:08Z [load_day 2025-05-13] 2025-05-13 hour 22: 201468 events in 0 files, snapshot none (task 7687 ms: download 4808 ms overlapping gunzip 1129 ms, parse 5088 ms, sort 0 ms, write 0 ms, index 933 ms: 12 candidates, 77012 repo-hours, 1221 releases; waiting 233 ms; commit 0 ms)
2026-11-08T11:57:13Z [load_day 2025-05-13] 2025-05-13 hour 23: 194427 events in 0 files, snapshot none (task 7505 ms: download 4813 ms overlapping gunzip 1075 ms, parse 4813 ms, sort 0 ms, write 0 ms, index 630 ms: 9 candidates, 75582 repo-hours, 1072 releases; waiting 618 ms; commit 0 ms)
2026-11-08T11:57:24Z [load_day 2025-05-13] 2025-05-13: repo_hour merged from 24 files to 1 (2522170 rows, 11070 ms)
2026-11-08T11:57:27Z [load_day 2025-05-13] 2025-05-13: index committed in 14003 ms (24 + 1 + 24 files)
2026-11-08T11:57:27Z [load_day 2025-05-13] 2025-05-13: 5731809 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T11:57:27Z [load_day 2025-05-13] attempt 1 succeeded