orcaLog in

Runs · run 747

load_day 2023-01-21, attempt 1 succeeded

Host
d3d1748bf284:29897
Started
2026-11-07T14:02:20Z
Ended
2026-11-07T14:04:12Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/747/load_day/2023-01-21/1.log
Code
pipelines/gharchive.mojo:116

Log

2026-11-07T14:02:20Z [load_day 2023-01-21] attempt 1 started
2026-11-07T14:02:21Z [load_day 2023-01-21] 2023-01-21: 2 hours in flight, about 1200 MB
2026-11-07T14:02:33Z [load_day 2023-01-21] 2023-01-21 hour 0: 132457 events in 3 files, snapshot 4511259344070218232 (task 9586 ms: download 2853 ms overlapping gunzip 575 ms, parse 2611 ms, sort 70 ms, write 4995 ms, index 398 ms: 7 candidates, 62427 repo-hours, 903 releases; waiting 606 ms; commit 1260 ms)
2026-11-07T14:02:34Z [load_day 2023-01-21] 2023-01-21 hour 1: 118431 events in 3 files, snapshot 6389857304973200377 (task 8191 ms: download 1952 ms overlapping gunzip 482 ms, parse 2220 ms, sort 67 ms, write 4176 ms, index 385 ms: 4 candidates, 61440 repo-hours, 711 releases; waiting 504 ms; commit 1338 ms)
2026-11-07T14:02:41Z [load_day 2023-01-21] 2023-01-21 hour 2: 104257 events in 3 files, snapshot 1165203212163184510 (task 7531 ms: download 2094 ms overlapping gunzip 446 ms, parse 1913 ms, sort 54 ms, write 3833 ms, index 301 ms: 6 candidates, 45537 repo-hours, 539 releases; waiting 638 ms; commit 1285 ms)
2026-11-07T14:02:43Z [load_day 2023-01-21] 2023-01-21 hour 3: 106848 events in 3 files, snapshot 5303644695001217477 (task 7945 ms: download 2517 ms overlapping gunzip 441 ms, parse 1966 ms, sort 53 ms, write 3523 ms, index 255 ms: 2 candidates, 37296 repo-hours, 665 releases; waiting 1432 ms; commit 1309 ms)
2026-11-07T14:02:48Z [load_day 2023-01-21] 2023-01-21 hour 4: 100327 events in 3 files, snapshot 8239149404477601507 (task 6255 ms: download 2550 ms overlapping gunzip 350 ms, parse 1626 ms, sort 49 ms, write 3116 ms, index 244 ms: 3 candidates, 35769 repo-hours, 441 releases; waiting 547 ms; commit 1164 ms)
2026-11-07T14:02:50Z [load_day 2023-01-21] 2023-01-21 hour 5: 103308 events in 3 files, snapshot 4513735884508983697 (task 6142 ms: download 1569 ms overlapping gunzip 364 ms, parse 1652 ms, sort 48 ms, write 3047 ms, index 253 ms: 2 candidates, 37585 repo-hours, 557 releases; waiting 522 ms; commit 1561 ms)
2026-11-07T14:02:55Z [load_day 2023-01-21] 2023-01-21 hour 6: 108181 events in 3 files, snapshot 4181744834490120255 (task 6167 ms: download 1889 ms overlapping gunzip 336 ms, parse 1576 ms, sort 51 ms, write 3044 ms, index 299 ms: 1 candidates, 41678 repo-hours, 570 releases; waiting 532 ms; commit 1356 ms)
2026-11-07T14:02:57Z [load_day 2023-01-21] 2023-01-21 hour 7: 108630 events in 3 files, snapshot 3509316709312661604 (task 5862 ms: download 1595 ms overlapping gunzip 335 ms, parse 1532 ms, sort 43 ms, write 3004 ms, index 269 ms: 6 candidates, 38171 repo-hours, 540 releases; waiting 369 ms; commit 1343 ms)
2026-11-07T14:03:03Z [load_day 2023-01-21] 2023-01-21 hour 8: 113072 events in 3 files, snapshot 4696896376043070884 (task 6434 ms: download 2344 ms overlapping gunzip 357 ms, parse 1646 ms, sort 63 ms, write 3474 ms, index 280 ms: 4 candidates, 41495 repo-hours, 621 releases; waiting 269 ms; commit 1405 ms)
2026-11-07T14:03:05Z [load_day 2023-01-21] 2023-01-21 hour 9: 121249 events in 3 files, snapshot 2304996833519831679 (task 6831 ms: download 1851 ms overlapping gunzip 382 ms, parse 1723 ms, sort 58 ms, write 3503 ms, index 310 ms: 4 candidates, 44479 repo-hours, 648 releases; waiting 533 ms; commit 1755 ms)
2026-11-07T14:03:11Z [load_day 2023-01-21] 2023-01-21 hour 10: 115714 events in 3 files, snapshot 8623450044260027294 (task 7327 ms: download 2129 ms overlapping gunzip 380 ms, parse 1728 ms, sort 57 ms, write 3943 ms, index 351 ms: 3 candidates, 45905 repo-hours, 576 releases; waiting 559 ms; commit 1552 ms)
2026-11-07T14:03:12Z [load_day 2023-01-21] 2023-01-21 hour 11: 120458 events in 3 files, snapshot 8554377360797836668 (task 6858 ms: download 1515 ms overlapping gunzip 412 ms, parse 1858 ms, sort 61 ms, write 3755 ms, index 298 ms: 1 candidates, 46972 repo-hours, 598 releases; waiting 182 ms; commit 1417 ms)
2026-11-07T14:03:20Z [load_day 2023-01-21] 2023-01-21 hour 12: 167566 events in 4 files, snapshot 7687140879168898705 (task 8594 ms: download 3143 ms overlapping gunzip 474 ms, parse 2290 ms, sort 74 ms, write 4451 ms, index 454 ms: 4 candidates, 74317 repo-hours, 693 releases; waiting 510 ms; commit 1407 ms)
2026-11-07T14:03:21Z [load_day 2023-01-21] 2023-01-21 hour 13: 152525 events in 4 files, snapshot 1679515573444846939 (task 7898 ms: download 2538 ms overlapping gunzip 474 ms, parse 2170 ms, sort 70 ms, write 4151 ms, index 436 ms: 2 candidates, 70093 repo-hours, 604 releases; waiting 260 ms; commit 1352 ms)
2026-11-07T14:03:29Z [load_day 2023-01-21] 2023-01-21 hour 14: 140127 events in 3 files, snapshot 3973978606632805822 (task 8494 ms: download 2842 ms overlapping gunzip 484 ms, parse 2180 ms, sort 99 ms, write 4416 ms, index 396 ms: 1 candidates, 55556 repo-hours, 721 releases; waiting 623 ms; commit 1275 ms)
2026-11-07T14:03:31Z [load_day 2023-01-21] 2023-01-21 hour 15: 146733 events in 3 files, snapshot 1902918730372820350 (task 8918 ms: download 3338 ms overlapping gunzip 510 ms, parse 2299 ms, sort 87 ms, write 4753 ms, index 388 ms: 3 candidates, 59154 repo-hours, 842 releases; waiting 541 ms; commit 1323 ms)
2026-11-07T14:03:38Z [load_day 2023-01-21] 2023-01-21 hour 16: 142091 events in 3 files, snapshot 7933236561381530623 (task 8436 ms: download 3160 ms overlapping gunzip 479 ms, parse 2177 ms, sort 87 ms, write 4455 ms, index 398 ms: 3 candidates, 59041 repo-hours, 679 releases; waiting 504 ms; commit 1458 ms)
2026-11-07T14:03:40Z [load_day 2023-01-21] 2023-01-21 hour 17: 141276 events in 3 files, snapshot 7482234706530497942 (task 8662 ms: download 1962 ms overlapping gunzip 499 ms, parse 2233 ms, sort 73 ms, write 4605 ms, index 367 ms: 5 candidates, 57257 repo-hours, 713 releases; waiting 564 ms; commit 1258 ms)
2026-11-07T14:03:47Z [load_day 2023-01-21] 2023-01-21 hour 18: 144215 events in 3 files, snapshot 3204527466257710879 (task 8530 ms: download 2511 ms overlapping gunzip 489 ms, parse 2262 ms, sort 78 ms, write 4444 ms, index 380 ms: 4 candidates, 60569 repo-hours, 820 releases; waiting 553 ms; commit 1359 ms)
2026-11-07T14:03:49Z [load_day 2023-01-21] 2023-01-21 hour 19: 134495 events in 3 files, snapshot 9088227811263628059 (task 7986 ms: download 2206 ms overlapping gunzip 469 ms, parse 2138 ms, sort 63 ms, write 4141 ms, index 338 ms: 0 candidates, 50894 repo-hours, 681 releases; waiting 520 ms; commit 1354 ms)
2026-11-07T14:03:55Z [load_day 2023-01-21] 2023-01-21 hour 20: 131115 events in 3 files, snapshot 3791862158615329004 (task 7466 ms: download 1996 ms overlapping gunzip 436 ms, parse 1968 ms, sort 72 ms, write 4029 ms, index 322 ms: 2 candidates, 49716 repo-hours, 809 releases; waiting 353 ms; commit 1454 ms)
2026-11-07T14:03:57Z [load_day 2023-01-21] 2023-01-21 hour 21: 124860 events in 3 files, snapshot 3581106942024419827 (task 7935 ms: download 2448 ms overlapping gunzip 421 ms, parse 1923 ms, sort 63 ms, write 3828 ms, index 306 ms: 1 candidates, 45010 repo-hours, 711 releases; waiting 1006 ms; commit 1329 ms)
2026-11-07T14:04:04Z [load_day 2023-01-21] 2023-01-21 hour 22: 119522 events in 3 files, snapshot 1959271991573783147 (task 7293 ms: download 1940 ms overlapping gunzip 396 ms, parse 1830 ms, sort 61 ms, write 3862 ms, index 281 ms: 1 candidates, 42259 repo-hours, 702 releases; waiting 527 ms; commit 1448 ms)
2026-11-07T14:04:05Z [load_day 2023-01-21] 2023-01-21 hour 23: 106825 events in 3 files, snapshot 1387143497005972997 (task 6577 ms: download 2059 ms overlapping gunzip 388 ms, parse 1731 ms, sort 57 ms, write 3286 ms, index 282 ms: 2 candidates, 41028 repo-hours, 592 releases; waiting 505 ms; commit 1214 ms)
2026-11-07T14:04:10Z [load_day 2023-01-21] 2023-01-21: repo_hour merged from 24 files to 1 (1203648 rows, 5290 ms)
2026-11-07T14:04:12Z [load_day 2023-01-21] 2023-01-21: index committed in 7230 ms (23 + 1 + 24 files)
2026-11-07T14:04:12Z [load_day 2023-01-21] 2023-01-21: 3004282 events in 24 hours
2026-11-07T14:04:12Z [load_day 2023-01-21] attempt 1 succeeded