orcaLog in

Runs · run 726

load_day 2023-01-14, attempt 1 succeeded

Host
d3d1748bf284:4305
Started
2026-11-07T13:40:53Z
Ended
2026-11-07T13:42:50Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/726/load_day/2023-01-14/1.log
Code
pipelines/gharchive.mojo:116

Log

2026-11-07T13:40:53Z [load_day 2023-01-14] attempt 1 started
2026-11-07T13:40:54Z [load_day 2023-01-14] 2023-01-14: 2 hours in flight, about 1200 MB
2026-11-07T13:41:07Z [load_day 2023-01-14] 2023-01-14 hour 0: 134828 events in 3 files, snapshot 33363031776907381 (task 10539 ms: download 4708 ms overlapping gunzip 613 ms, parse 2761 ms, sort 73 ms, write 5851 ms, index 419 ms: 2 candidates, 68020 repo-hours, 865 releases; waiting 518 ms; commit 1185 ms)
2026-11-07T13:41:08Z [load_day 2023-01-14] 2023-01-14 hour 1: 120322 events in 3 files, snapshot 6519647493728007845 (task 8620 ms: download 2986 ms overlapping gunzip 479 ms, parse 2249 ms, sort 89 ms, write 4408 ms, index 384 ms: 3 candidates, 65373 repo-hours, 721 releases; waiting 696 ms; commit 1239 ms)
2026-11-07T13:41:14Z [load_day 2023-01-14] 2023-01-14 hour 2: 103897 events in 3 files, snapshot 8284390846946139804 (task 7212 ms: download 1796 ms overlapping gunzip 410 ms, parse 1735 ms, sort 41 ms, write 3817 ms, index 303 ms: 2 candidates, 45518 repo-hours, 604 releases; waiting 568 ms; commit 1153 ms)
2026-11-07T13:41:16Z [load_day 2023-01-14] 2023-01-14 hour 3: 102451 events in 3 files, snapshot 8653667983483747548 (task 6707 ms: download 1609 ms overlapping gunzip 391 ms, parse 1797 ms, sort 50 ms, write 3383 ms, index 251 ms: 0 candidates, 38826 repo-hours, 753 releases; waiting 528 ms; commit 1302 ms)
2026-11-07T13:41:23Z [load_day 2023-01-14] 2023-01-14 hour 4: 99474 events in 2 files, snapshot 5534872163820420161 (task 7470 ms: download 2468 ms overlapping gunzip 378 ms, parse 1659 ms, sort 48 ms, write 3121 ms, index 301 ms: 4 candidates, 38680 repo-hours, 628 releases; waiting 1628 ms; commit 1402 ms)
2026-11-07T13:41:24Z [load_day 2023-01-14] 2023-01-14 hour 5: 108277 events in 3 files, snapshot 4330734151483342537 (task 6818 ms: download 2061 ms overlapping gunzip 380 ms, parse 1720 ms, sort 47 ms, write 3555 ms, index 282 ms: 2 candidates, 44239 repo-hours, 675 releases; waiting 516 ms; commit 1290 ms)
2026-11-07T13:41:30Z [load_day 2023-01-14] 2023-01-14 hour 6: 115591 events in 3 files, snapshot 8733538596688569991 (task 6610 ms: download 1673 ms overlapping gunzip 378 ms, parse 1701 ms, sort 48 ms, write 3433 ms, index 435 ms: 3 candidates, 45174 repo-hours, 577 releases; waiting 273 ms; commit 1463 ms)
2026-11-07T13:41:32Z [load_day 2023-01-14] 2023-01-14 hour 7: 109236 events in 3 files, snapshot 8604521052567286004 (task 6673 ms: download 2462 ms overlapping gunzip 375 ms, parse 1648 ms, sort 47 ms, write 3370 ms, index 268 ms: 0 candidates, 41608 repo-hours, 524 releases; waiting 652 ms; commit 1325 ms)
2026-11-07T13:41:38Z [load_day 2023-01-14] 2023-01-14 hour 8: 115842 events in 3 files, snapshot 1142642597510121971 (task 7273 ms: download 2231 ms overlapping gunzip 403 ms, parse 1812 ms, sort 48 ms, write 3641 ms, index 309 ms: 7 candidates, 45370 repo-hours, 556 releases; waiting 713 ms; commit 1335 ms)
2026-11-07T13:41:40Z [load_day 2023-01-14] 2023-01-14 hour 9: 120014 events in 3 files, snapshot 1091903956153297331 (task 7350 ms: download 2780 ms overlapping gunzip 414 ms, parse 1820 ms, sort 52 ms, write 3781 ms, index 309 ms: 3 candidates, 46546 repo-hours, 644 releases; waiting 677 ms; commit 1403 ms)
2026-11-07T13:41:47Z [load_day 2023-01-14] 2023-01-14 hour 10: 119891 events in 3 files, snapshot 3203942137713908820 (task 7578 ms: download 2042 ms overlapping gunzip 445 ms, parse 1958 ms, sort 63 ms, write 3985 ms, index 311 ms: 2 candidates, 49869 repo-hours, 603 releases; waiting 505 ms; commit 1298 ms)
2026-11-07T13:41:48Z [load_day 2023-01-14] 2023-01-14 hour 11: 122657 events in 3 files, snapshot 1706237341615686231 (task 7661 ms: download 2109 ms overlapping gunzip 429 ms, parse 1923 ms, sort 56 ms, write 4019 ms, index 312 ms: 4 candidates, 49298 repo-hours, 615 releases; waiting 531 ms; commit 1160 ms)
2026-11-07T13:41:56Z [load_day 2023-01-14] 2023-01-14 hour 12: 169977 events in 4 files, snapshot 8668830335716951006 (task 9069 ms: download 3228 ms overlapping gunzip 498 ms, parse 2312 ms, sort 79 ms, write 4882 ms, index 467 ms: 4 candidates, 76822 repo-hours, 752 releases; waiting 517 ms; commit 1406 ms)
2026-11-07T13:41:58Z [load_day 2023-01-14] 2023-01-14 hour 13: 156273 events in 4 files, snapshot 2974873478745176229 (task 8870 ms: download 3090 ms overlapping gunzip 513 ms, parse 2318 ms, sort 77 ms, write 4735 ms, index 440 ms: 2 candidates, 73506 repo-hours, 724 releases; waiting 510 ms; commit 1277 ms)
2026-11-07T13:42:05Z [load_day 2023-01-14] 2023-01-14 hour 14: 150638 events in 4 files, snapshot 3395550149036414425 (task 8433 ms: download 2926 ms overlapping gunzip 492 ms, parse 2187 ms, sort 75 ms, write 4801 ms, index 381 ms: 4 candidates, 60315 repo-hours, 711 releases; waiting 184 ms; commit 1444 ms)
2026-11-07T13:42:08Z [load_day 2023-01-14] 2023-01-14 hour 15: 150328 events in 4 files, snapshot 1788401779294270173 (task 9096 ms: download 3489 ms overlapping gunzip 534 ms, parse 2423 ms, sort 78 ms, write 4632 ms, index 431 ms: 2 candidates, 61980 repo-hours, 919 releases; waiting 535 ms; commit 1393 ms)
2026-11-07T13:42:15Z [load_day 2023-01-14] 2023-01-14 hour 16: 148446 events in 3 files, snapshot 6322321763145318680 (task 8688 ms: download 3259 ms overlapping gunzip 499 ms, parse 2249 ms, sort 74 ms, write 4735 ms, index 407 ms: 3 candidates, 62771 repo-hours, 706 releases; waiting 512 ms; commit 1318 ms)
2026-11-07T13:42:16Z [load_day 2023-01-14] 2023-01-14 hour 17: 145738 events in 3 files, snapshot 8089243603431302524 (task 8290 ms: download 2110 ms overlapping gunzip 493 ms, parse 2243 ms, sort 83 ms, write 4383 ms, index 385 ms: 2 candidates, 58309 repo-hours, 794 releases; waiting 393 ms; commit 1271 ms)
2026-11-07T13:42:24Z [load_day 2023-01-14] 2023-01-14 hour 18: 146755 events in 3 files, snapshot 1221589500913763515 (task 8580 ms: download 2565 ms overlapping gunzip 510 ms, parse 2290 ms, sort 98 ms, write 4436 ms, index 411 ms: 1 candidates, 60823 repo-hours, 827 releases; waiting 508 ms; commit 1202 ms)
2026-11-07T13:42:25Z [load_day 2023-01-14] 2023-01-14 hour 19: 147009 events in 3 files, snapshot 6308801181624366279 (task 8248 ms: download 3127 ms overlapping gunzip 468 ms, parse 2130 ms, sort 67 ms, write 4395 ms, index 315 ms: 1 candidates, 52143 repo-hours, 820 releases; waiting 522 ms; commit 1195 ms)
2026-11-07T13:42:32Z [load_day 2023-01-14] 2023-01-14 hour 20: 145443 events in 3 files, snapshot 52863703663163714 (task 7978 ms: download 2089 ms overlapping gunzip 461 ms, parse 2119 ms, sort 71 ms, write 4101 ms, index 348 ms: 2 candidates, 52250 repo-hours, 760 releases; waiting 498 ms; commit 1249 ms)
2026-11-07T13:42:34Z [load_day 2023-01-14] 2023-01-14 hour 21: 133849 events in 3 files, snapshot 2128786130170244070 (task 7181 ms: download 1846 ms overlapping gunzip 416 ms, parse 1926 ms, sort 61 ms, write 3807 ms, index 328 ms: 1 candidates, 47845 repo-hours, 831 releases; waiting 351 ms; commit 1226 ms)
2026-11-07T13:42:40Z [load_day 2023-01-14] 2023-01-14 hour 22: 122877 events in 3 files, snapshot 3651597900759684631 (task 7306 ms: download 2360 ms overlapping gunzip 406 ms, parse 1834 ms, sort 53 ms, write 3782 ms, index 312 ms: 0 candidates, 44325 repo-hours, 680 releases; waiting 632 ms; commit 1230 ms)
2026-11-07T13:42:42Z [load_day 2023-01-14] 2023-01-14 hour 23: 111160 events in 3 files, snapshot 4268467433725786175 (task 6366 ms: download 1473 ms overlapping gunzip 388 ms, parse 1786 ms, sort 61 ms, write 3316 ms, index 267 ms: 2 candidates, 42121 repo-hours, 616 releases; waiting 252 ms; commit 1406 ms)
2026-11-07T13:42:47Z [load_day 2023-01-14] 2023-01-14: repo_hour merged from 24 files to 1 (1271731 rows, 5507 ms)
2026-11-07T13:42:50Z [load_day 2023-01-14] 2023-01-14: index committed in 7810 ms (21 + 1 + 24 files)
2026-11-07T13:42:50Z [load_day 2023-01-14] 2023-01-14: 3100973 events in 24 hours
2026-11-07T13:42:50Z [load_day 2023-01-14] attempt 1 succeeded