orcaLog in

Runs · run 773

load_day 2023-01-29, attempt 1 succeeded

Host
a5fae32f1699:51
Started
2026-11-07T14:40:28Z
Ended
2026-11-07T14:42:36Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/773/load_day/2023-01-29/1.log
Code
pipelines/gharchive.mojo:116

Log

2026-11-07T14:40:28Z [load_day 2023-01-29] attempt 1 started
2026-11-07T14:40:32Z [load_day 2023-01-29] 2023-01-29: 2 hours in flight, about 1200 MB
2026-11-07T14:40:44Z [load_day 2023-01-29] 2023-01-29 hour 0: 115144 events in 3 files, snapshot 847376477406582083 (task 7517 ms: download 2012 ms overlapping gunzip 443 ms, parse 2082 ms, sort 63 ms, write 3712 ms, index 399 ms: 4 candidates, 59234 repo-hours, 942 releases; waiting 493 ms; commit 1251 ms)
2026-11-07T14:40:45Z [load_day 2023-01-29] 2023-01-29 hour 1: 118875 events in 3 files, snapshot 2471018924536726275 (task 7636 ms: download 2073 ms overlapping gunzip 423 ms, parse 1973 ms, sort 54 ms, write 3895 ms, index 429 ms: 6 candidates, 64693 repo-hours, 807 releases; waiting 513 ms; commit 1141 ms)
2026-11-07T14:40:53Z [load_day 2023-01-29] 2023-01-29 hour 2: 107979 events in 3 files, snapshot 4132824246709197790 (task 8705 ms: download 3039 ms overlapping gunzip 456 ms, parse 1960 ms, sort 55 ms, write 3601 ms, index 357 ms: 6 candidates, 51784 repo-hours, 738 releases; waiting 1897 ms; commit 1148 ms)
2026-11-07T14:40:54Z [load_day 2023-01-29] 2023-01-29 hour 3: 105581 events in 3 files, snapshot 2774572925800207671 (task 6848 ms: download 1898 ms overlapping gunzip 403 ms, parse 1782 ms, sort 53 ms, write 3509 ms, index 274 ms: 0 candidates, 42842 repo-hours, 796 releases; waiting 498 ms; commit 1212 ms)
2026-11-07T14:41:00Z [load_day 2023-01-29] 2023-01-29 hour 4: 95630 events in 2 files, snapshot 1374147108371648983 (task 6098 ms: download 2561 ms overlapping gunzip 340 ms, parse 1501 ms, sort 72 ms, write 3005 ms, index 269 ms: 1 candidates, 38498 repo-hours, 568 releases; waiting 520 ms; commit 1255 ms)
2026-11-07T14:41:01Z [load_day 2023-01-29] 2023-01-29 hour 5: 102322 events in 3 files, snapshot 5782391286946766123 (task 6548 ms: download 2085 ms overlapping gunzip 369 ms, parse 1704 ms, sort 50 ms, write 3209 ms, index 374 ms: 2 candidates, 42926 repo-hours, 732 releases; waiting 542 ms; commit 1352 ms)
2026-11-07T14:41:09Z [load_day 2023-01-29] 2023-01-29 hour 6: 115738 events in 3 files, snapshot 4587122963894560240 (task 8097 ms: download 3023 ms overlapping gunzip 387 ms, parse 1739 ms, sort 69 ms, write 3824 ms, index 372 ms: 3 candidates, 52169 repo-hours, 873 releases; waiting 1226 ms; commit 1264 ms)
2026-11-07T14:41:10Z [load_day 2023-01-29] 2023-01-29 hour 7: 111674 events in 3 files, snapshot 2654622858874408582 (task 6798 ms: download 1761 ms overlapping gunzip 389 ms, parse 1732 ms, sort 72 ms, write 3786 ms, index 311 ms: 3 candidates, 48113 repo-hours, 653 releases; waiting 183 ms; commit 1258 ms)
2026-11-07T14:41:18Z [load_day 2023-01-29] 2023-01-29 hour 8: 119260 events in 3 files, snapshot 2652184364763369088 (task 7908 ms: download 2108 ms overlapping gunzip 459 ms, parse 1992 ms, sort 77 ms, write 4074 ms, index 328 ms: 3 candidates, 52514 repo-hours, 681 releases; waiting 652 ms; commit 1285 ms)
2026-11-07T14:41:19Z [load_day 2023-01-29] 2023-01-29 hour 9: 125515 events in 3 files, snapshot 3633439243472059569 (task 7885 ms: download 2102 ms overlapping gunzip 465 ms, parse 1997 ms, sort 74 ms, write 4231 ms, index 331 ms: 0 candidates, 55241 repo-hours, 807 releases; waiting 515 ms; commit 1193 ms)
2026-11-07T14:41:27Z [load_day 2023-01-29] 2023-01-29 hour 10: 126092 events in 3 files, snapshot 7587414643052889057 (task 8503 ms: download 2959 ms overlapping gunzip 449 ms, parse 1963 ms, sort 74 ms, write 4278 ms, index 346 ms: 1 candidates, 55866 repo-hours, 793 releases; waiting 854 ms; commit 1287 ms)
2026-11-07T14:41:28Z [load_day 2023-01-29] 2023-01-29 hour 11: 126634 events in 3 files, snapshot 5215432723330674967 (task 8033 ms: download 2234 ms overlapping gunzip 435 ms, parse 1950 ms, sort 75 ms, write 4122 ms, index 341 ms: 2 candidates, 53454 repo-hours, 628 releases; waiting 840 ms; commit 1162 ms)
2026-11-07T14:41:37Z [load_day 2023-01-29] 2023-01-29 hour 12: 177279 events in 4 files, snapshot 8047700031028546102 (task 9431 ms: download 3074 ms overlapping gunzip 529 ms, parse 2434 ms, sort 103 ms, write 5035 ms, index 517 ms: 1 candidates, 80808 repo-hours, 790 releases; waiting 469 ms; commit 1294 ms)
2026-11-07T14:41:38Z [load_day 2023-01-29] 2023-01-29 hour 13: 156275 events in 4 files, snapshot 690052480725462510 (task 9326 ms: download 3341 ms overlapping gunzip 503 ms, parse 2329 ms, sort 88 ms, write 4763 ms, index 534 ms: 2 candidates, 78289 repo-hours, 888 releases; waiting 718 ms; commit 1307 ms)
2026-11-07T14:41:49Z [load_day 2023-01-29] 2023-01-29 hour 14: 150323 events in 4 files, snapshot 801377832542135178 (task 10811 ms: download 3737 ms overlapping gunzip 551 ms, parse 2432 ms, sort 86 ms, write 6351 ms, index 453 ms: 7 candidates, 64230 repo-hours, 841 releases; waiting 563 ms; commit 1425 ms)
2026-11-07T14:41:50Z [load_day 2023-01-29] 2023-01-29 hour 15: 153340 events in 4 files, snapshot 5705044985044638583 (task 9366 ms: download 3609 ms overlapping gunzip 546 ms, parse 2427 ms, sort 94 ms, write 5068 ms, index 444 ms: 2 candidates, 68212 repo-hours, 978 releases; waiting 521 ms; commit 1149 ms)
2026-11-07T14:42:00Z [load_day 2023-01-29] 2023-01-29 hour 16: 150078 events in 4 files, snapshot 7567555899323227604 (task 10210 ms: download 4350 ms overlapping gunzip 550 ms, parse 2395 ms, sort 98 ms, write 5134 ms, index 508 ms: 6 candidates, 68224 repo-hours, 956 releases; waiting 1213 ms; commit 1283 ms)
2026-11-07T14:42:01Z [load_day 2023-01-29] 2023-01-29 hour 17: 147499 events in 3 files, snapshot 2098164543888709373 (task 9094 ms: download 3405 ms overlapping gunzip 543 ms, parse 2458 ms, sort 99 ms, write 4906 ms, index 419 ms: 0 candidates, 64936 repo-hours, 788 releases; waiting 386 ms; commit 1378 ms)
2026-11-07T14:42:09Z [load_day 2023-01-29] 2023-01-29 hour 18: 148899 events in 3 files, snapshot 2620763492016725484 (task 8861 ms: download 3114 ms overlapping gunzip 555 ms, parse 2363 ms, sort 106 ms, write 4962 ms, index 420 ms: 3 candidates, 65498 repo-hours, 867 releases; waiting 185 ms; commit 1471 ms)
2026-11-07T14:42:11Z [load_day 2023-01-29] 2023-01-29 hour 19: 135577 events in 3 files, snapshot 8960941511104730096 (task 8695 ms: download 2758 ms overlapping gunzip 503 ms, parse 2203 ms, sort 87 ms, write 4576 ms, index 418 ms: 5 candidates, 58201 repo-hours, 844 releases; waiting 564 ms; commit 1278 ms)
2026-11-07T14:42:19Z [load_day 2023-01-29] 2023-01-29 hour 20: 134246 events in 3 files, snapshot 1421382692033425403 (task 8538 ms: download 2116 ms overlapping gunzip 498 ms, parse 2264 ms, sort 103 ms, write 4501 ms, index 369 ms: 2 candidates, 58836 repo-hours, 819 releases; waiting 504 ms; commit 1440 ms)
2026-11-07T14:42:20Z [load_day 2023-01-29] 2023-01-29 hour 21: 127479 events in 3 files, snapshot 1411311519822999446 (task 8576 ms: download 2583 ms overlapping gunzip 494 ms, parse 2220 ms, sort 93 ms, write 4539 ms, index 369 ms: 4 candidates, 52383 repo-hours, 949 releases; waiting 524 ms; commit 1231 ms)
2026-11-07T14:42:27Z [load_day 2023-01-29] 2023-01-29 hour 22: 122998 events in 3 files, snapshot 7826097381039623210 (task 8095 ms: download 2232 ms overlapping gunzip 437 ms, parse 1919 ms, sort 75 ms, write 3919 ms, index 390 ms: 3 candidates, 53974 repo-hours, 842 releases; waiting 559 ms; commit 1296 ms)
2026-11-07T14:42:29Z [load_day 2023-01-29] 2023-01-29 hour 23: 113353 events in 3 files, snapshot 1657524249948309385 (task 7737 ms: download 2820 ms overlapping gunzip 462 ms, parse 1991 ms, sort 73 ms, write 3838 ms, index 331 ms: 4 candidates, 49863 repo-hours, 640 releases; waiting 701 ms; commit 1450 ms)
2026-11-07T14:42:34Z [load_day 2023-01-29] 2023-01-29: repo_hour merged from 24 files to 1 (1380788 rows, 5485 ms)
2026-11-07T14:42:36Z [load_day 2023-01-29] 2023-01-29: index committed in 7286 ms (21 + 1 + 24 files)
2026-11-07T14:42:36Z [load_day 2023-01-29] 2023-01-29: 3087790 events in 24 hours
2026-11-07T14:42:36Z [load_day 2023-01-29] attempt 1 succeeded