orcaLog in

Runs · run 2611

load_day 2024-06-19, attempt 1 succeeded

Host
73ccef5e07c2:138417
Started
2026-11-08T06:36:15Z
Ended
2026-11-08T06:38:14Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
727 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
181.6 s, up to 2.9 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/2611/load_day/2024-06-19/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T06:36:15Z [load_day 2024-06-19] attempt 1 started
2026-11-08T06:36:16Z [load_day 2024-06-19] 2024-06-19: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T06:36:25Z [load_day 2024-06-19] 2024-06-19 hour 0: 184777 events in 0 files, snapshot none (task 8444 ms: download 5394 ms overlapping gunzip 1304 ms, parse 5591 ms, sort 0 ms, write 0 ms, index 736 ms: 10 candidates, 94405 repo-hours, 1387 releases; waiting 528 ms; commit 0 ms)
2026-11-08T06:36:25Z [load_day 2024-06-19] 2024-06-19 hour 1: 198664 events in 0 files, snapshot none (task 8493 ms: download 5028 ms overlapping gunzip 1220 ms, parse 5470 ms, sort 0 ms, write 0 ms, index 1075 ms: 13 candidates, 106216 repo-hours, 1138 releases; waiting 505 ms; commit 0 ms)
2026-11-08T06:36:33Z [load_day 2024-06-19] 2024-06-19 hour 2: 171971 events in 0 files, snapshot none (task 8007 ms: download 4249 ms overlapping gunzip 1326 ms, parse 4955 ms, sort 0 ms, write 0 ms, index 939 ms: 23 candidates, 70780 repo-hours, 1214 releases; waiting 489 ms; commit 0 ms)
2026-11-08T06:36:33Z [load_day 2024-06-19] 2024-06-19 hour 3: 186734 events in 0 files, snapshot none (task 8280 ms: download 4398 ms overlapping gunzip 1301 ms, parse 5266 ms, sort 0 ms, write 0 ms, index 885 ms: 6 candidates, 78055 repo-hours, 5453 releases; waiting 469 ms; commit 0 ms)
2026-11-08T06:36:40Z [load_day 2024-06-19] 2024-06-19 hour 4: 159810 events in 0 files, snapshot none (task 6561 ms: download 3944 ms overlapping gunzip 1044 ms, parse 4210 ms, sort 0 ms, write 0 ms, index 495 ms: 2 candidates, 62280 repo-hours, 933 releases; waiting 494 ms; commit 0 ms)
2026-11-08T06:36:41Z [load_day 2024-06-19] 2024-06-19 hour 5: 171126 events in 0 files, snapshot none (task 6685 ms: download 4046 ms overlapping gunzip 1052 ms, parse 4247 ms, sort 0 ms, write 0 ms, index 498 ms: 8 candidates, 68432 repo-hours, 1258 releases; waiting 474 ms; commit 0 ms)
2026-11-08T06:36:50Z [load_day 2024-06-19] 2024-06-19 hour 6: 209095 events in 0 files, snapshot none (task 9312 ms: download 5618 ms overlapping gunzip 1445 ms, parse 6086 ms, sort 0 ms, write 0 ms, index 956 ms: 1 candidates, 95949 repo-hours, 1403 releases; waiting 524 ms; commit 0 ms)
2026-11-08T06:36:51Z [load_day 2024-06-19] 2024-06-19 hour 7: 208621 events in 0 files, snapshot none (task 9847 ms: download 6770 ms overlapping gunzip 1649 ms, parse 6648 ms, sort 0 ms, write 0 ms, index 727 ms: 5 candidates, 85679 repo-hours, 1585 releases; waiting 510 ms; commit 0 ms)
2026-11-08T06:37:00Z [load_day 2024-06-19] 2024-06-19 hour 8: 231519 events in 0 files, snapshot none (task 9395 ms: download 6303 ms overlapping gunzip 1517 ms, parse 6405 ms, sort 0 ms, write 0 ms, index 700 ms: 8 candidates, 95827 repo-hours, 1883 releases; waiting 483 ms; commit 0 ms)
2026-11-08T06:37:01Z [load_day 2024-06-19] 2024-06-19 hour 9: 231899 events in 0 files, snapshot none (task 9515 ms: download 6683 ms overlapping gunzip 1464 ms, parse 6444 ms, sort 0 ms, write 0 ms, index 700 ms: 9 candidates, 101190 repo-hours, 2298 releases; waiting 552 ms; commit 0 ms)
2026-11-08T06:37:09Z [load_day 2024-06-19] 2024-06-19 hour 10: 217989 events in 0 files, snapshot none (task 8618 ms: download 5557 ms overlapping gunzip 1349 ms, parse 5675 ms, sort 0 ms, write 0 ms, index 833 ms: 9 candidates, 89995 repo-hours, 1853 releases; waiting 497 ms; commit 0 ms)
2026-11-08T06:37:11Z [load_day 2024-06-19] 2024-06-19 hour 11: 213628 events in 0 files, snapshot none (task 9248 ms: download 6050 ms overlapping gunzip 1447 ms, parse 6346 ms, sort 0 ms, write 0 ms, index 816 ms: 8 candidates, 85629 repo-hours, 1869 releases; waiting 351 ms; commit 0 ms)
2026-11-08T06:37:19Z [load_day 2024-06-19] 2024-06-19 hour 12: 266501 events in 0 files, snapshot none (task 9397 ms: download 5931 ms overlapping gunzip 1356 ms, parse 6221 ms, sort 0 ms, write 0 ms, index 1040 ms: 9 candidates, 129338 repo-hours, 1837 releases; waiting 462 ms; commit 0 ms)
2026-11-08T06:37:22Z [load_day 2024-06-19] 2024-06-19 hour 13: 251818 events in 0 files, snapshot none (task 10582 ms: download 7742 ms overlapping gunzip 1549 ms, parse 7324 ms, sort 0 ms, write 0 ms, index 912 ms: 14 candidates, 116439 repo-hours, 2020 releases; waiting 500 ms; commit 0 ms)
2026-11-08T06:37:28Z [load_day 2024-06-19] 2024-06-19 hour 14: 237858 events in 0 files, snapshot none (task 8147 ms: download 5400 ms overlapping gunzip 1246 ms, parse 5321 ms, sort 0 ms, write 0 ms, index 788 ms: 15 candidates, 100662 repo-hours, 1820 releases; waiting 533 ms; commit 0 ms)
2026-11-08T06:37:30Z [load_day 2024-06-19] 2024-06-19 hour 15: 240733 events in 0 files, snapshot none (task 8152 ms: download 5486 ms overlapping gunzip 1264 ms, parse 5231 ms, sort 0 ms, write 0 ms, index 831 ms: 15 candidates, 106728 repo-hours, 1914 releases; waiting 545 ms; commit 0 ms)
2026-11-08T06:37:35Z [load_day 2024-06-19] 2024-06-19 hour 16: 220322 events in 0 files, snapshot none (task 7190 ms: download 4604 ms overlapping gunzip 1126 ms, parse 4567 ms, sort 0 ms, write 0 ms, index 724 ms: 13 candidates, 92768 repo-hours, 1622 releases; waiting 517 ms; commit 0 ms)
2026-11-08T06:37:38Z [load_day 2024-06-19] 2024-06-19 hour 17: 207346 events in 0 files, snapshot none (task 7643 ms: download 4688 ms overlapping gunzip 1042 ms, parse 4322 ms, sort 0 ms, write 0 ms, index 1015 ms: 6 candidates, 84050 repo-hours, 1638 releases; waiting 986 ms; commit 0 ms)
2026-11-08T06:37:44Z [load_day 2024-06-19] 2024-06-19 hour 18: 219507 events in 0 files, snapshot none (task 8106 ms: download 5276 ms overlapping gunzip 1246 ms, parse 5069 ms, sort 0 ms, write 0 ms, index 969 ms: 7 candidates, 99279 repo-hours, 1716 releases; waiting 536 ms; commit 0 ms)
2026-11-08T06:37:47Z [load_day 2024-06-19] 2024-06-19 hour 19: 199113 events in 0 files, snapshot none (task 8413 ms: download 5044 ms overlapping gunzip 1358 ms, parse 5342 ms, sort 0 ms, write 0 ms, index 934 ms: 2 candidates, 76966 repo-hours, 1563 releases; waiting 509 ms; commit 0 ms)
2026-11-08T06:37:52Z [load_day 2024-06-19] 2024-06-19 hour 20: 187186 events in 0 files, snapshot none (task 7308 ms: download 4111 ms overlapping gunzip 1083 ms, parse 4288 ms, sort 0 ms, write 0 ms, index 1201 ms: 5 candidates, 74750 repo-hours, 1558 releases; waiting 454 ms; commit 0 ms)
2026-11-08T06:37:55Z [load_day 2024-06-19] 2024-06-19 hour 21: 180289 events in 0 files, snapshot none (task 7240 ms: download 4746 ms overlapping gunzip 1041 ms, parse 4162 ms, sort 0 ms, write 0 ms, index 707 ms: 10 candidates, 73506 repo-hours, 1485 releases; waiting 866 ms; commit 0 ms)
2026-11-08T06:37:58Z [load_day 2024-06-19] 2024-06-19 hour 22: 157982 events in 0 files, snapshot none (task 5644 ms: download 3373 ms overlapping gunzip 781 ms, parse 3178 ms, sort 0 ms, write 0 ms, index 560 ms: 6 candidates, 59555 repo-hours, 1371 releases; waiting 801 ms; commit 0 ms)
2026-11-08T06:38:01Z [load_day 2024-06-19] 2024-06-19 hour 23: 148844 events in 0 files, snapshot none (task 5964 ms: download 4773 ms overlapping gunzip 706 ms, parse 2964 ms, sort 0 ms, write 0 ms, index 458 ms: 12 candidates, 55898 repo-hours, 1124 releases; waiting 1525 ms; commit 0 ms)
2026-11-08T06:38:11Z [load_day 2024-06-19] 2024-06-19: repo_hour merged from 24 files to 1 (2104376 rows, 9342 ms)
2026-11-08T06:38:14Z [load_day 2024-06-19] 2024-06-19: index committed in 12031 ms (24 + 1 + 24 files)
2026-11-08T06:38:14Z [load_day 2024-06-19] 2024-06-19: 4903332 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T06:38:14Z [load_day 2024-06-19] attempt 1 succeeded