orcaLog in

Runs · run 1259

load_day 2023-07-02, attempt 1 succeeded

Host
3c2b29713ce8:82155
Started
2026-11-07T22:35:17Z
Ended
2026-11-07T22:38:51Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/1259/load_day/2023-07-02/1.log
Code
pipelines/gharchive.mojo:116

Log

2026-11-07T22:35:17Z [load_day 2023-07-02] attempt 1 started
2026-11-07T22:35:18Z [load_day 2023-07-02] 2023-07-02: 1 hours in flight, about 750 MB
2026-11-07T22:35:28Z [load_day 2023-07-02] 2023-07-02 hour 0: 96309 events in 2 files, snapshot 3178026939576066954 (task 5869 ms: download 1922 ms overlapping gunzip 349 ms, parse 1633 ms, sort 53 ms, write 2651 ms, index 303 ms: 5 candidates, 51098 repo-hours, 739 releases; waiting 510 ms; commit 1953 ms)
2026-11-07T22:35:37Z [load_day 2023-07-02] 2023-07-02 hour 1: 102552 events in 3 files, snapshot 8298788629209658225 (task 7114 ms: download 1814 ms overlapping gunzip 348 ms, parse 1582 ms, sort 63 ms, write 2779 ms, index 1609 ms: 2 candidates, 60869 repo-hours, 731 releases; waiting 354 ms; commit 3413 ms)
2026-11-07T22:35:43Z [load_day 2023-07-02] 2023-07-02 hour 2: 88597 events in 2 files, snapshot 3248633444698256960 (task 5147 ms: download 1593 ms overlapping gunzip 312 ms, parse 1424 ms, sort 63 ms, write 2228 ms, index 301 ms: 2 candidates, 47657 repo-hours, 575 releases; waiting 495 ms; commit 1728 ms)
2026-11-07T22:35:49Z [load_day 2023-07-02] 2023-07-02 hour 3: 86076 events in 2 files, snapshot 5595991451779517563 (task 4902 ms: download 1486 ms overlapping gunzip 295 ms, parse 1356 ms, sort 40 ms, write 2177 ms, index 236 ms: 0 candidates, 38038 repo-hours, 701 releases; waiting 497 ms; commit 2173 ms)
2026-11-07T22:35:54Z [load_day 2023-07-02] 2023-07-02 hour 4: 86934 events in 2 files, snapshot 8982166579907904543 (task 4854 ms: download 1548 ms overlapping gunzip 311 ms, parse 1334 ms, sort 50 ms, write 2128 ms, index 238 ms: 1 candidates, 36843 repo-hours, 479 releases; waiting 526 ms; commit 1768 ms)
2026-11-07T22:36:00Z [load_day 2023-07-02] 2023-07-02 hour 5: 88916 events in 2 files, snapshot 7618607394319059213 (task 5179 ms: download 1533 ms overlapping gunzip 307 ms, parse 1411 ms, sort 45 ms, write 2343 ms, index 268 ms: 1 candidates, 40102 repo-hours, 603 releases; waiting 508 ms; commit 1883 ms)
2026-11-07T22:36:06Z [load_day 2023-07-02] 2023-07-02 hour 6: 103544 events in 3 files, snapshot 771311779385858993 (task 5271 ms: download 1237 ms overlapping gunzip 332 ms, parse 1536 ms, sort 67 ms, write 2486 ms, index 294 ms: 1 candidates, 48116 repo-hours, 670 releases; waiting 297 ms; commit 1868 ms)
2026-11-07T22:36:13Z [load_day 2023-07-02] 2023-07-02 hour 7: 101950 events in 3 files, snapshot 8943662094053401433 (task 6006 ms: download 2108 ms overlapping gunzip 365 ms, parse 1622 ms, sort 54 ms, write 2864 ms, index 285 ms: 0 candidates, 45103 repo-hours, 460 releases; waiting 515 ms; commit 1934 ms)
2026-11-07T22:36:21Z [load_day 2023-07-02] 2023-07-02 hour 8: 109529 events in 3 files, snapshot 2337976394275955406 (task 6556 ms: download 1837 ms overlapping gunzip 394 ms, parse 1796 ms, sort 69 ms, write 3036 ms, index 310 ms: 4 candidates, 49298 repo-hours, 668 releases; waiting 500 ms; commit 2174 ms)
2026-11-07T22:36:29Z [load_day 2023-07-02] 2023-07-02 hour 9: 112907 events in 3 files, snapshot 3436388611626626129 (task 7176 ms: download 2844 ms overlapping gunzip 425 ms, parse 1885 ms, sort 74 ms, write 3418 ms, index 330 ms: 3 candidates, 49144 repo-hours, 759 releases; waiting 715 ms; commit 2021 ms)
2026-11-07T22:36:38Z [load_day 2023-07-02] 2023-07-02 hour 10: 113854 events in 3 files, snapshot 1456724614112537544 (task 8083 ms: download 2088 ms overlapping gunzip 434 ms, parse 2054 ms, sort 59 ms, write 4328 ms, index 357 ms: 2 candidates, 51479 repo-hours, 648 releases; waiting 495 ms; commit 2246 ms)
2026-11-07T22:36:46Z [load_day 2023-07-02] 2023-07-02 hour 11: 112894 events in 3 files, snapshot 6509947136537021512 (task 7848 ms: download 1888 ms overlapping gunzip 415 ms, parse 1834 ms, sort 73 ms, write 4217 ms, index 477 ms: 7 candidates, 49281 repo-hours, 601 releases; waiting 520 ms; commit 1990 ms)
2026-11-07T22:36:58Z [load_day 2023-07-02] 2023-07-02 hour 12: 172016 events in 4 files, snapshot 3442719603470376460 (task 9648 ms: download 3241 ms overlapping gunzip 561 ms, parse 2613 ms, sort 96 ms, write 5007 ms, index 586 ms: 6 candidates, 83407 repo-hours, 706 releases; waiting 504 ms; commit 3220 ms)
2026-11-07T22:37:08Z [load_day 2023-07-02] 2023-07-02 hour 13: 148711 events in 3 files, snapshot 623940128590550881 (task 9408 ms: download 3361 ms overlapping gunzip 508 ms, parse 2398 ms, sort 91 ms, write 5067 ms, index 539 ms: 3 candidates, 78209 repo-hours, 651 releases; waiting 489 ms; commit 3186 ms)
2026-11-07T22:37:18Z [load_day 2023-07-02] 2023-07-02 hour 14: 136454 events in 3 files, snapshot 3105328548275768900 (task 9514 ms: download 3708 ms overlapping gunzip 595 ms, parse 2598 ms, sort 80 ms, write 4976 ms, index 433 ms: 3 candidates, 61964 repo-hours, 750 releases; waiting 514 ms; commit 2033 ms)
2026-11-07T22:37:29Z [load_day 2023-07-02] 2023-07-02 hour 15: 138234 events in 3 files, snapshot 1761625828456549446 (task 9823 ms: download 3962 ms overlapping gunzip 512 ms, parse 2272 ms, sort 84 ms, write 5719 ms, index 434 ms: 0 candidates, 63322 repo-hours, 901 releases; waiting 507 ms; commit 2422 ms)
2026-11-07T22:37:38Z [load_day 2023-07-02] 2023-07-02 hour 16: 133878 events in 3 files, snapshot 2641306977339401864 (task 9506 ms: download 2722 ms overlapping gunzip 564 ms, parse 2530 ms, sort 68 ms, write 5128 ms, index 389 ms: 4 candidates, 60920 repo-hours, 812 releases; waiting 523 ms; commit 1789 ms)
2026-11-07T22:37:48Z [load_day 2023-07-02] 2023-07-02 hour 17: 125601 events in 3 files, snapshot 26187728394328436 (task 8263 ms: download 1843 ms overlapping gunzip 464 ms, parse 2077 ms, sort 100 ms, write 4400 ms, index 421 ms: 2 candidates, 55809 repo-hours, 718 releases; waiting 518 ms; commit 2407 ms)
2026-11-07T22:37:58Z [load_day 2023-07-02] 2023-07-02 hour 18: 132889 events in 3 files, snapshot 6487462110325574872 (task 9004 ms: download 2012 ms overlapping gunzip 567 ms, parse 2474 ms, sort 95 ms, write 4727 ms, index 376 ms: 5 candidates, 61810 repo-hours, 752 releases; waiting 505 ms; commit 2097 ms)
2026-11-07T22:38:08Z [load_day 2023-07-02] 2023-07-02 hour 19: 116749 events in 3 files, snapshot 6099953733716894705 (task 8059 ms: download 1931 ms overlapping gunzip 447 ms, parse 2011 ms, sort 68 ms, write 4374 ms, index 322 ms: 3 candidates, 50812 repo-hours, 709 releases; waiting 540 ms; commit 2970 ms)
2026-11-07T22:38:16Z [load_day 2023-07-02] 2023-07-02 hour 20: 111703 events in 3 files, snapshot 7140190438137046987 (task 7525 ms: download 1424 ms overlapping gunzip 436 ms, parse 2088 ms, sort 86 ms, write 4127 ms, index 326 ms: 4 candidates, 49538 repo-hours, 743 releases; waiting 186 ms; commit 2142 ms)
2026-11-07T22:38:24Z [load_day 2023-07-02] 2023-07-02 hour 21: 105834 events in 3 files, snapshot 6899869768516210382 (task 7519 ms: download 1775 ms overlapping gunzip 444 ms, parse 2001 ms, sort 70 ms, write 3839 ms, index 366 ms: 3 candidates, 46555 repo-hours, 817 releases; waiting 517 ms; commit 1962 ms)
2026-11-07T22:38:32Z [load_day 2023-07-02] 2023-07-02 hour 22: 94091 events in 2 files, snapshot 5846197308062955786 (task 6831 ms: download 1637 ms overlapping gunzip 382 ms, parse 1743 ms, sort 84 ms, write 3481 ms, index 348 ms: 1 candidates, 42018 repo-hours, 649 releases; waiting 497 ms; commit 2270 ms)
2026-11-07T22:38:43Z [load_day 2023-07-02] 2023-07-02 hour 23: 89319 events in 2 files, snapshot 2121122988274516990 (task 6462 ms: download 1702 ms overlapping gunzip 401 ms, parse 1796 ms, sort 52 ms, write 3142 ms, index 270 ms: 0 candidates, 39964 repo-hours, 550 releases; waiting 500 ms; commit 5998 ms)
2026-11-07T22:38:49Z [load_day 2023-07-02] 2023-07-02: repo_hour merged from 24 files to 1 (1261356 rows, 5813 ms)
2026-11-07T22:38:51Z [load_day 2023-07-02] 2023-07-02: index committed in 7812 ms (20 + 1 + 24 files)
2026-11-07T22:38:51Z [load_day 2023-07-02] 2023-07-02: 2709541 events in 24 hours
2026-11-07T22:38:51Z [load_day 2023-07-02] attempt 1 succeeded