orcaLog in

Runs · run 751

load_day 2023-01-22, attempt 1 succeeded

Host
d3d1748bf284:31807
Started
2026-11-07T14:04:13Z
Ended
2026-11-07T14:06:07Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/751/load_day/2023-01-22/1.log
Code
pipelines/gharchive.mojo:116

Log

2026-11-07T14:04:13Z [load_day 2023-01-22] attempt 1 started
2026-11-07T14:04:14Z [load_day 2023-01-22] 2023-01-22: 2 hours in flight, about 1200 MB
2026-11-07T14:04:24Z [load_day 2023-01-22] 2023-01-22 hour 0: 117834 events in 3 files, snapshot 8262658440962532184 (task 7153 ms: download 1714 ms overlapping gunzip 409 ms, parse 1931 ms, sort 58 ms, write 3609 ms, index 343 ms: 3 candidates, 54693 repo-hours, 794 releases; waiting 506 ms; commit 1239 ms)
2026-11-07T14:04:25Z [load_day 2023-01-22] 2023-01-22 hour 1: 126824 events in 3 files, snapshot 5844837401869371574 (task 8466 ms: download 2671 ms overlapping gunzip 503 ms, parse 2281 ms, sort 82 ms, write 4436 ms, index 366 ms: 14 candidates, 57278 repo-hours, 733 releases; waiting 500 ms; commit 1263 ms)
2026-11-07T14:04:31Z [load_day 2023-01-22] 2023-01-22 hour 2: 91761 events in 2 files, snapshot 1129680106087310309 (task 6012 ms: download 1790 ms overlapping gunzip 331 ms, parse 1522 ms, sort 60 ms, write 2980 ms, index 289 ms: 7 candidates, 42445 repo-hours, 529 releases; waiting 515 ms; commit 1291 ms)
2026-11-07T14:04:34Z [load_day 2023-01-22] 2023-01-22 hour 3: 94610 events in 2 files, snapshot 2720690091943215607 (task 8419 ms: download 5308 ms overlapping gunzip 331 ms, parse 1563 ms, sort 55 ms, write 2647 ms, index 226 ms: 0 candidates, 32539 repo-hours, 623 releases; waiting 3094 ms; commit 1200 ms)
2026-11-07T14:04:37Z [load_day 2023-01-22] 2023-01-22 hour 4: 93307 events in 2 files, snapshot 7228734422802601275 (task 5254 ms: download 2176 ms overlapping gunzip 289 ms, parse 1335 ms, sort 48 ms, write 2495 ms, index 249 ms: 1 candidates, 33096 repo-hours, 412 releases; waiting 562 ms; commit 1338 ms)
2026-11-07T14:04:40Z [load_day 2023-01-22] 2023-01-22 hour 5: 97053 events in 2 files, snapshot 6113735772055700808 (task 5258 ms: download 1508 ms overlapping gunzip 276 ms, parse 1321 ms, sort 41 ms, write 2574 ms, index 247 ms: 1 candidates, 34919 repo-hours, 574 releases; waiting 499 ms; commit 1248 ms)
2026-11-07T14:04:42Z [load_day 2023-01-22] 2023-01-22 hour 6: 101724 events in 3 files, snapshot 723100159943262818 (task 5488 ms: download 1891 ms overlapping gunzip 303 ms, parse 1421 ms, sort 56 ms, write 2616 ms, index 262 ms: 2 candidates, 39810 repo-hours, 545 releases; waiting 548 ms; commit 1127 ms)
2026-11-07T14:04:46Z [load_day 2023-01-22] 2023-01-22 hour 7: 102383 events in 3 files, snapshot 2022106367192725356 (task 5578 ms: download 1638 ms overlapping gunzip 306 ms, parse 1433 ms, sort 46 ms, write 2824 ms, index 252 ms: 3 candidates, 36582 repo-hours, 455 releases; waiting 505 ms; commit 1235 ms)
2026-11-07T14:04:50Z [load_day 2023-01-22] 2023-01-22 hour 8: 108360 events in 3 files, snapshot 5180410459278008346 (task 6102 ms: download 1687 ms overlapping gunzip 342 ms, parse 1572 ms, sort 64 ms, write 3078 ms, index 286 ms: 3 candidates, 40877 repo-hours, 520 releases; waiting 469 ms; commit 1278 ms)
2026-11-07T14:04:54Z [load_day 2023-01-22] 2023-01-22 hour 9: 115571 events in 3 files, snapshot 2600149512478493451 (task 6737 ms: download 3080 ms overlapping gunzip 386 ms, parse 1735 ms, sort 65 ms, write 3432 ms, index 274 ms: 0 candidates, 42595 repo-hours, 684 releases; waiting 500 ms; commit 1528 ms)
2026-11-07T14:04:57Z [load_day 2023-01-22] 2023-01-22 hour 10: 121342 events in 3 files, snapshot 3937035891435538970 (task 7215 ms: download 2086 ms overlapping gunzip 391 ms, parse 1817 ms, sort 65 ms, write 3706 ms, index 343 ms: 1 candidates, 46905 repo-hours, 627 releases; waiting 615 ms; commit 1226 ms)
2026-11-07T14:05:02Z [load_day 2023-01-22] 2023-01-22 hour 11: 122983 events in 3 files, snapshot 4392863098659083412 (task 7201 ms: download 2206 ms overlapping gunzip 398 ms, parse 1826 ms, sort 67 ms, write 3774 ms, index 330 ms: 3 candidates, 48156 repo-hours, 635 releases; waiting 511 ms; commit 1343 ms)
2026-11-07T14:05:07Z [load_day 2023-01-22] 2023-01-22 hour 12: 174645 events in 4 files, snapshot 982996879118741342 (task 8637 ms: download 2809 ms overlapping gunzip 501 ms, parse 2372 ms, sort 92 ms, write 4738 ms, index 466 ms: 2 candidates, 77998 repo-hours, 777 releases; waiting 192 ms; commit 1362 ms)
2026-11-07T14:05:13Z [load_day 2023-01-22] 2023-01-22 hour 13: 159252 events in 4 files, snapshot 6057780190729021732 (task 9331 ms: download 3181 ms overlapping gunzip 496 ms, parse 2288 ms, sort 90 ms, write 4639 ms, index 738 ms: 3 candidates, 73886 repo-hours, 698 releases; waiting 755 ms; commit 2200 ms)
2026-11-07T14:05:17Z [load_day 2023-01-22] 2023-01-22 hour 14: 152797 events in 4 files, snapshot 3434513794186542779 (task 9327 ms: download 4297 ms overlapping gunzip 529 ms, parse 2398 ms, sort 89 ms, write 4818 ms, index 384 ms: 3 candidates, 58290 repo-hours, 794 releases; waiting 796 ms; commit 1478 ms)
2026-11-07T14:05:23Z [load_day 2023-01-22] 2023-01-22 hour 15: 157134 events in 4 files, snapshot 4789478623053155416 (task 9542 ms: download 3730 ms overlapping gunzip 542 ms, parse 2461 ms, sort 86 ms, write 5090 ms, index 421 ms: 2 candidates, 61848 repo-hours, 972 releases; waiting 638 ms; commit 1644 ms)
2026-11-07T14:05:26Z [load_day 2023-01-22] 2023-01-22 hour 16: 148683 events in 3 files, snapshot 8703921422432512804 (task 8915 ms: download 3365 ms overlapping gunzip 515 ms, parse 2292 ms, sort 85 ms, write 4694 ms, index 414 ms: 1 candidates, 61014 repo-hours, 774 releases; waiting 585 ms; commit 1323 ms)
2026-11-07T14:05:33Z [load_day 2023-01-22] 2023-01-22 hour 17: 148696 events in 3 files, snapshot 8740479492688681589 (task 9722 ms: download 3729 ms overlapping gunzip 545 ms, parse 2453 ms, sort 109 ms, write 4990 ms, index 404 ms: 2 candidates, 59665 repo-hours, 755 releases; waiting 736 ms; commit 1225 ms)
2026-11-07T14:05:36Z [load_day 2023-01-22] 2023-01-22 hour 18: 149175 events in 3 files, snapshot 2975493507563065128 (task 8859 ms: download 3398 ms overlapping gunzip 483 ms, parse 2248 ms, sort 92 ms, write 4800 ms, index 424 ms: 6 candidates, 63504 repo-hours, 877 releases; waiting 528 ms; commit 1145 ms)
2026-11-07T14:05:42Z [load_day 2023-01-22] 2023-01-22 hour 19: 146476 events in 3 files, snapshot 2180005487334902599 (task 8712 ms: download 2404 ms overlapping gunzip 481 ms, parse 2236 ms, sort 75 ms, write 4547 ms, index 369 ms: 1 candidates, 56307 repo-hours, 749 releases; waiting 717 ms; commit 1216 ms)
2026-11-07T14:05:45Z [load_day 2023-01-22] 2023-01-22 hour 20: 144065 events in 3 files, snapshot 5258040944891265193 (task 8532 ms: download 3303 ms overlapping gunzip 488 ms, parse 2261 ms, sort 72 ms, write 4451 ms, index 346 ms: 0 candidates, 56805 repo-hours, 829 releases; waiting 594 ms; commit 1272 ms)
2026-11-07T14:05:52Z [load_day 2023-01-22] 2023-01-22 hour 21: 135592 events in 3 files, snapshot 7612611091061503721 (task 8524 ms: download 3259 ms overlapping gunzip 478 ms, parse 2155 ms, sort 75 ms, write 4379 ms, index 334 ms: 3 candidates, 51472 repo-hours, 885 releases; waiting 753 ms; commit 1290 ms)
2026-11-07T14:05:54Z [load_day 2023-01-22] 2023-01-22 hour 22: 120262 events in 3 files, snapshot 9137302685691077904 (task 7605 ms: download 2049 ms overlapping gunzip 417 ms, parse 1899 ms, sort 70 ms, write 3898 ms, index 409 ms: 3 candidates, 47373 repo-hours, 842 releases; waiting 562 ms; commit 1168 ms)
2026-11-07T14:06:00Z [load_day 2023-01-22] 2023-01-22 hour 23: 111881 events in 3 files, snapshot 6572145949005512873 (task 7334 ms: download 1697 ms overlapping gunzip 420 ms, parse 2004 ms, sort 64 ms, write 3802 ms, index 293 ms: 4 candidates, 44566 repo-hours, 653 releases; waiting 441 ms; commit 1857 ms)
2026-11-07T14:06:06Z [load_day 2023-01-22] 2023-01-22: repo_hour merged from 24 files to 1 (1222623 rows, 5322 ms)
2026-11-07T14:06:07Z [load_day 2023-01-22] 2023-01-22: index committed in 6799 ms (21 + 1 + 24 files)
2026-11-07T14:06:07Z [load_day 2023-01-22] 2023-01-22: 3042410 events in 24 hours
2026-11-07T14:06:07Z [load_day 2023-01-22] attempt 1 succeeded