orcaLog in

Runs · run 1044

load_day 2023-04-30, attempt 1 succeeded

Host
caf251265124:320543
Started
2026-11-07T19:25:40Z
Ended
2026-11-07T19:27:44Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/1044/load_day/2023-04-30/1.log
Code
pipelines/gharchive.mojo:116

Log

2026-11-07T19:25:40Z [load_day 2023-04-30] attempt 1 started
2026-11-07T19:25:42Z [load_day 2023-04-30] 2023-04-30: 2 hours in flight, about 1200 MB
2026-11-07T19:25:52Z [load_day 2023-04-30] 2023-04-30 hour 0: 113389 events in 3 files, snapshot 7526353170905544879 (task 7556 ms: download 2142 ms overlapping gunzip 445 ms, parse 2005 ms, sort 64 ms, write 3868 ms, index 393 ms: 6 candidates, 59030 repo-hours, 846 releases; waiting 497 ms; commit 1622 ms)
2026-11-07T19:25:54Z [load_day 2023-04-30] 2023-04-30 hour 1: 118113 events in 3 files, snapshot 7609163118292633336 (task 7738 ms: download 2159 ms overlapping gunzip 406 ms, parse 1946 ms, sort 60 ms, write 3852 ms, index 461 ms: 4 candidates, 69010 repo-hours, 767 releases; waiting 498 ms; commit 1647 ms)
2026-11-07T19:25:59Z [load_day 2023-04-30] 2023-04-30 hour 2: 89773 events in 2 files, snapshot 6275821876288690571 (task 6597 ms: download 2465 ms overlapping gunzip 359 ms, parse 1554 ms, sort 58 ms, write 3008 ms, index 272 ms: 4 candidates, 40442 repo-hours, 604 releases; waiting 1039 ms; commit 1481 ms)
2026-11-07T19:26:01Z [load_day 2023-04-30] 2023-04-30 hour 3: 89414 events in 2 files, snapshot 8756766954801770678 (task 5977 ms: download 1658 ms overlapping gunzip 359 ms, parse 1574 ms, sort 47 ms, write 2934 ms, index 256 ms: 6 candidates, 37032 repo-hours, 675 releases; waiting 522 ms; commit 1551 ms)
2026-11-07T19:26:07Z [load_day 2023-04-30] 2023-04-30 hour 4: 90337 events in 2 files, snapshot 7153274296338525073 (task 6248 ms: download 2111 ms overlapping gunzip 343 ms, parse 1488 ms, sort 47 ms, write 2971 ms, index 266 ms: 2 candidates, 37565 repo-hours, 500 releases; waiting 806 ms; commit 1928 ms)
2026-11-07T19:26:09Z [load_day 2023-04-30] 2023-04-30 hour 5: 96929 events in 2 files, snapshot 8612401513157885901 (task 6374 ms: download 1854 ms overlapping gunzip 358 ms, parse 1626 ms, sort 62 ms, write 3139 ms, index 261 ms: 2 candidates, 40499 repo-hours, 590 releases; waiting 528 ms; commit 1735 ms)
2026-11-07T19:26:15Z [load_day 2023-04-30] 2023-04-30 hour 6: 106623 events in 3 files, snapshot 4957298019273189229 (task 7005 ms: download 1842 ms overlapping gunzip 393 ms, parse 1743 ms, sort 65 ms, write 3575 ms, index 319 ms: 1 candidates, 48082 repo-hours, 625 releases; waiting 578 ms; commit 1639 ms)
2026-11-07T19:26:16Z [load_day 2023-04-30] 2023-04-30 hour 7: 106291 events in 3 files, snapshot 7282337083968054242 (task 7027 ms: download 1936 ms overlapping gunzip 403 ms, parse 1729 ms, sort 68 ms, write 3685 ms, index 334 ms: 3 candidates, 44889 repo-hours, 558 releases; waiting 503 ms; commit 1455 ms)
2026-11-07T19:26:23Z [load_day 2023-04-30] 2023-04-30 hour 8: 115043 events in 3 files, snapshot 8961365390349817522 (task 7690 ms: download 2107 ms overlapping gunzip 476 ms, parse 2055 ms, sort 69 ms, write 3896 ms, index 365 ms: 4 candidates, 49736 repo-hours, 641 releases; waiting 497 ms; commit 1562 ms)
2026-11-07T19:26:26Z [load_day 2023-04-30] 2023-04-30 hour 9: 118126 events in 3 files, snapshot 5336542730026897172 (task 8480 ms: download 2650 ms overlapping gunzip 463 ms, parse 2058 ms, sort 70 ms, write 3956 ms, index 321 ms: 3 candidates, 49262 repo-hours, 749 releases; waiting 1290 ms; commit 1600 ms)
2026-11-07T19:26:32Z [load_day 2023-04-30] 2023-04-30 hour 10: 123871 events in 3 files, snapshot 2615656574443237940 (task 8068 ms: download 2250 ms overlapping gunzip 460 ms, parse 2029 ms, sort 74 ms, write 4268 ms, index 350 ms: 2 candidates, 52659 repo-hours, 639 releases; waiting 560 ms; commit 1613 ms)
2026-11-07T19:26:34Z [load_day 2023-04-30] 2023-04-30 hour 11: 119441 events in 3 files, snapshot 1801147890952759708 (task 7709 ms: download 2136 ms overlapping gunzip 442 ms, parse 1973 ms, sort 80 ms, write 4058 ms, index 349 ms: 4 candidates, 49761 repo-hours, 638 releases; waiting 511 ms; commit 1387 ms)
2026-11-07T19:26:44Z [load_day 2023-04-30] 2023-04-30 hour 12: 191490 events in 4 files, snapshot 2700244674866995233 (task 10599 ms: download 3687 ms overlapping gunzip 562 ms, parse 2669 ms, sort 107 ms, write 5850 ms, index 598 ms: 2 candidates, 82484 repo-hours, 809 releases; waiting 513 ms; commit 1522 ms)
2026-11-07T19:26:45Z [load_day 2023-04-30] 2023-04-30 hour 13: 154364 events in 4 files, snapshot 3731025131168844183 (task 9293 ms: download 2981 ms overlapping gunzip 536 ms, parse 2369 ms, sort 81 ms, write 5292 ms, index 474 ms: 3 candidates, 76427 repo-hours, 735 releases; waiting 241 ms; commit 1606 ms)
2026-11-07T19:26:54Z [load_day 2023-04-30] 2023-04-30 hour 14: 142567 events in 3 files, snapshot 6513846562527752888 (task 9085 ms: download 3468 ms overlapping gunzip 523 ms, parse 2296 ms, sort 82 ms, write 4944 ms, index 391 ms: 2 candidates, 62532 repo-hours, 828 releases; waiting 538 ms; commit 1552 ms)
2026-11-07T19:26:56Z [load_day 2023-04-30] 2023-04-30 hour 15: 145264 events in 3 files, snapshot 4043724583957746814 (task 9713 ms: download 3775 ms overlapping gunzip 560 ms, parse 2440 ms, sort 100 ms, write 5050 ms, index 485 ms: 1 candidates, 63118 repo-hours, 916 releases; waiting 688 ms; commit 1640 ms)
2026-11-07T19:27:07Z [load_day 2023-04-30] 2023-04-30 hour 16: 143598 events in 3 files, snapshot 4534201144618566057 (task 9884 ms: download 3990 ms overlapping gunzip 575 ms, parse 2517 ms, sort 97 ms, write 5358 ms, index 469 ms: 2 candidates, 62057 repo-hours, 997 releases; waiting 524 ms; commit 4774 ms)
2026-11-07T19:27:09Z [load_day 2023-04-30] 2023-04-30 hour 17: 140110 events in 3 files, snapshot 181172768971750358 (task 11017 ms: download 3471 ms overlapping gunzip 513 ms, parse 2251 ms, sort 95 ms, write 5683 ms, index 1668 ms: 2 candidates, 58574 repo-hours, 711 releases; waiting 538 ms; commit 1525 ms)
2026-11-07T19:27:18Z [load_day 2023-04-30] 2023-04-30 hour 18: 143989 events in 3 files, snapshot 2265351919385049721 (task 9462 ms: download 3592 ms overlapping gunzip 514 ms, parse 2409 ms, sort 96 ms, write 5054 ms, index 586 ms: 2 candidates, 64602 repo-hours, 819 releases; waiting 502 ms; commit 1541 ms)
2026-11-07T19:27:19Z [load_day 2023-04-30] 2023-04-30 hour 19: 127802 events in 3 files, snapshot 7229666783029721879 (task 8476 ms: download 2264 ms overlapping gunzip 474 ms, parse 2168 ms, sort 82 ms, write 4527 ms, index 361 ms: 5 candidates, 54231 repo-hours, 704 releases; waiting 518 ms; commit 1492 ms)
2026-11-07T19:27:27Z [load_day 2023-04-30] 2023-04-30 hour 20: 127796 events in 3 files, snapshot 883220186228451258 (task 8428 ms: download 2477 ms overlapping gunzip 487 ms, parse 2174 ms, sort 64 ms, write 4548 ms, index 364 ms: 5 candidates, 54535 repo-hours, 715 releases; waiting 522 ms; commit 1609 ms)
2026-11-07T19:27:29Z [load_day 2023-04-30] 2023-04-30 hour 21: 116087 events in 3 files, snapshot 1565255815572850430 (task 7795 ms: download 2489 ms overlapping gunzip 444 ms, parse 2012 ms, sort 72 ms, write 4070 ms, index 318 ms: 6 candidates, 47698 repo-hours, 814 releases; waiting 549 ms; commit 1734 ms)
2026-11-07T19:27:35Z [load_day 2023-04-30] 2023-04-30 hour 22: 110637 events in 3 files, snapshot 3153985556545733569 (task 7547 ms: download 2108 ms overlapping gunzip 425 ms, parse 1841 ms, sort 65 ms, write 4100 ms, index 324 ms: 4 candidates, 45458 repo-hours, 625 releases; waiting 520 ms; commit 1542 ms)
2026-11-07T19:27:37Z [load_day 2023-04-30] 2023-04-30 hour 23: 106099 events in 3 files, snapshot 2750253460708658095 (task 7456 ms: download 1973 ms overlapping gunzip 435 ms, parse 1941 ms, sort 68 ms, write 3873 ms, index 307 ms: 3 candidates, 44087 repo-hours, 577 releases; waiting 525 ms; commit 1739 ms)
2026-11-07T19:27:43Z [load_day 2023-04-30] 2023-04-30: repo_hour merged from 24 files to 1 (1293770 rows, 5486 ms)
2026-11-07T19:27:44Z [load_day 2023-04-30] 2023-04-30: index committed in 7007 ms (24 + 1 + 24 files)
2026-11-07T19:27:44Z [load_day 2023-04-30] 2023-04-30: 2937153 events in 24 hours
2026-11-07T19:27:44Z [load_day 2023-04-30] attempt 1 succeeded