orcaLog in

Runs · run 831

load_day 2023-02-18, attempt 1 succeeded

Host
caf251265124:70178
Started
2026-11-07T15:46:54Z
Ended
2026-11-07T15:48:58Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/831/load_day/2023-02-18/1.log
Code
pipelines/gharchive.mojo:116

Log

2026-11-07T15:46:54Z [load_day 2023-02-18] attempt 1 started
2026-11-07T15:46:55Z [load_day 2023-02-18] 2023-02-18: 2 hours in flight, about 1200 MB
2026-11-07T15:47:09Z [load_day 2023-02-18] 2023-02-18 hour 0: 136459 events in 3 files, snapshot 1294101734344625479 (task 10473 ms: download 4815 ms overlapping gunzip 610 ms, parse 2733 ms, sort 79 ms, write 5591 ms, index 475 ms: 8 candidates, 65707 repo-hours, 941 releases; waiting 639 ms; commit 1454 ms)
2026-11-07T15:47:10Z [load_day 2023-02-18] 2023-02-18 hour 1: 135799 events in 3 files, snapshot 1388182645042368923 (task 8666 ms: download 3282 ms overlapping gunzip 467 ms, parse 2191 ms, sort 71 ms, write 4791 ms, index 440 ms: 5 candidates, 75274 repo-hours, 828 releases; waiting 371 ms; commit 1423 ms)
2026-11-07T15:47:18Z [load_day 2023-02-18] 2023-02-18 hour 2: 128563 events in 3 files, snapshot 7439933333453381845 (task 8499 ms: download 3038 ms overlapping gunzip 460 ms, parse 1994 ms, sort 71 ms, write 4346 ms, index 422 ms: 4 candidates, 69969 repo-hours, 668 releases; waiting 641 ms; commit 1346 ms)
2026-11-07T15:47:19Z [load_day 2023-02-18] 2023-02-18 hour 3: 83906 events in 2 files, snapshot 777634583800742281 (task 6217 ms: download 1901 ms overlapping gunzip 365 ms, parse 1573 ms, sort 44 ms, write 3082 ms, index 276 ms: 3 candidates, 40173 repo-hours, 616 releases; waiting 567 ms; commit 1386 ms)
2026-11-07T15:47:23Z [load_day 2023-02-18] 2023-02-18 hour 4: 58336 events in 2 files, snapshot 7531807483174061271 (task 5000 ms: download 1733 ms overlapping gunzip 263 ms, parse 1129 ms, sort 28 ms, write 2407 ms, index 212 ms: 1 candidates, 29530 repo-hours, 355 releases; waiting 593 ms; commit 1570 ms)
2026-11-07T15:47:27Z [load_day 2023-02-18] 2023-02-18 hour 5: 99146 events in 2 files, snapshot 3495647061923928475 (task 7217 ms: download 2660 ms overlapping gunzip 401 ms, parse 1755 ms, sort 60 ms, write 3503 ms, index 314 ms: 2 candidates, 42851 repo-hours, 645 releases; waiting 714 ms; commit 1330 ms)
2026-11-07T15:47:33Z [load_day 2023-02-18] 2023-02-18 hour 6: 110391 events in 3 files, snapshot 4485560406728835776 (task 8463 ms: download 2984 ms overlapping gunzip 420 ms, parse 1832 ms, sort 52 ms, write 3734 ms, index 342 ms: 4 candidates, 50361 repo-hours, 623 releases; waiting 1777 ms; commit 1489 ms)
2026-11-07T15:47:35Z [load_day 2023-02-18] 2023-02-18 hour 7: 109249 events in 3 files, snapshot 9041009313528554762 (task 7221 ms: download 2138 ms overlapping gunzip 394 ms, parse 1797 ms, sort 61 ms, write 3819 ms, index 298 ms: 4 candidates, 47330 repo-hours, 553 releases; waiting 552 ms; commit 1413 ms)
2026-11-07T15:47:41Z [load_day 2023-02-18] 2023-02-18 hour 8: 115409 events in 3 files, snapshot 7104713380894058493 (task 7570 ms: download 2054 ms overlapping gunzip 422 ms, parse 1877 ms, sort 66 ms, write 4081 ms, index 325 ms: 5 candidates, 51202 repo-hours, 580 releases; waiting 513 ms; commit 1425 ms)
2026-11-07T15:47:43Z [load_day 2023-02-18] 2023-02-18 hour 9: 119537 events in 3 files, snapshot 5716609520446229709 (task 7839 ms: download 1995 ms overlapping gunzip 439 ms, parse 1960 ms, sort 76 ms, write 4211 ms, index 339 ms: 7 candidates, 52697 repo-hours, 657 releases; waiting 511 ms; commit 1434 ms)
2026-11-07T15:47:50Z [load_day 2023-02-18] 2023-02-18 hour 10: 123269 events in 3 files, snapshot 4753402107750496131 (task 8127 ms: download 2401 ms overlapping gunzip 482 ms, parse 2073 ms, sort 67 ms, write 4299 ms, index 354 ms: 4 candidates, 55831 repo-hours, 653 releases; waiting 513 ms; commit 1545 ms)
2026-11-07T15:47:53Z [load_day 2023-02-18] 2023-02-18 hour 11: 121717 events in 3 files, snapshot 4148789112912310244 (task 8697 ms: download 2615 ms overlapping gunzip 480 ms, parse 2126 ms, sort 68 ms, write 4517 ms, index 358 ms: 4 candidates, 52663 repo-hours, 639 releases; waiting 852 ms; commit 1405 ms)
2026-11-07T15:48:00Z [load_day 2023-02-18] 2023-02-18 hour 12: 176209 events in 4 files, snapshot 1887848731892597502 (task 9539 ms: download 3090 ms overlapping gunzip 535 ms, parse 2473 ms, sort 88 ms, write 5217 ms, index 519 ms: 5 candidates, 87280 repo-hours, 809 releases; waiting 368 ms; commit 1568 ms)
2026-11-07T15:48:03Z [load_day 2023-02-18] 2023-02-18 hour 13: 153357 events in 4 files, snapshot 7385312875283231201 (task 9438 ms: download 3257 ms overlapping gunzip 505 ms, parse 2342 ms, sort 87 ms, write 5098 ms, index 536 ms: 4 candidates, 77421 repo-hours, 706 releases; waiting 517 ms; commit 1336 ms)
2026-11-07T15:48:11Z [load_day 2023-02-18] 2023-02-18 hour 14: 143083 events in 3 files, snapshot 4196164818368556094 (task 9516 ms: download 3514 ms overlapping gunzip 524 ms, parse 2346 ms, sort 95 ms, write 5226 ms, index 430 ms: 4 candidates, 63508 repo-hours, 722 releases; waiting 532 ms; commit 1508 ms)
2026-11-07T15:48:14Z [load_day 2023-02-18] 2023-02-18 hour 15: 152455 events in 4 files, snapshot 9070275393533376807 (task 10123 ms: download 3979 ms overlapping gunzip 572 ms, parse 2548 ms, sort 91 ms, write 5668 ms, index 451 ms: 4 candidates, 65627 repo-hours, 962 releases; waiting 493 ms; commit 1434 ms)
2026-11-07T15:48:21Z [load_day 2023-02-18] 2023-02-18 hour 16: 142864 events in 3 files, snapshot 7454859068741038880 (task 9753 ms: download 3746 ms overlapping gunzip 560 ms, parse 2450 ms, sort 94 ms, write 5356 ms, index 421 ms: 7 candidates, 64879 repo-hours, 728 releases; waiting 580 ms; commit 1405 ms)
2026-11-07T15:48:24Z [load_day 2023-02-18] 2023-02-18 hour 17: 140878 events in 3 files, snapshot 440378110682837455 (task 9246 ms: download 3497 ms overlapping gunzip 530 ms, parse 2341 ms, sort 75 ms, write 5020 ms, index 417 ms: 7 candidates, 60065 repo-hours, 706 releases; waiting 476 ms; commit 1498 ms)
2026-11-07T15:48:32Z [load_day 2023-02-18] 2023-02-18 hour 18: 142466 events in 3 files, snapshot 566126545049619729 (task 9528 ms: download 3566 ms overlapping gunzip 502 ms, parse 2249 ms, sort 90 ms, write 5245 ms, index 425 ms: 5 candidates, 63818 repo-hours, 861 releases; waiting 545 ms; commit 1663 ms)
2026-11-07T15:48:33Z [load_day 2023-02-18] 2023-02-18 hour 19: 128892 events in 3 files, snapshot 6586410563644745573 (task 8296 ms: download 2099 ms overlapping gunzip 459 ms, parse 2064 ms, sort 98 ms, write 4422 ms, index 386 ms: 13 candidates, 54362 repo-hours, 787 releases; waiting 527 ms; commit 1298 ms)
2026-11-07T15:48:40Z [load_day 2023-02-18] 2023-02-18 hour 20: 125824 events in 3 files, snapshot 5643488407466160110 (task 8216 ms: download 2171 ms overlapping gunzip 450 ms, parse 2045 ms, sort 71 ms, write 4469 ms, index 351 ms: 2 candidates, 53715 repo-hours, 734 releases; waiting 509 ms; commit 1426 ms)
2026-11-07T15:48:42Z [load_day 2023-02-18] 2023-02-18 hour 21: 122052 events in 3 files, snapshot 4022485911927360668 (task 7712 ms: download 2024 ms overlapping gunzip 433 ms, parse 1959 ms, sort 74 ms, write 4107 ms, index 335 ms: 2 candidates, 53068 repo-hours, 741 releases; waiting 504 ms; commit 1236 ms)
2026-11-07T15:48:49Z [load_day 2023-02-18] 2023-02-18 hour 22: 107399 events in 3 files, snapshot 8548586115437256868 (task 8270 ms: download 3384 ms overlapping gunzip 419 ms, parse 1873 ms, sort 74 ms, write 3962 ms, index 295 ms: 1 candidates, 44240 repo-hours, 637 releases; waiting 1067 ms; commit 1307 ms)
2026-11-07T15:48:51Z [load_day 2023-02-18] 2023-02-18 hour 23: 98806 events in 2 files, snapshot 5942544595355421178 (task 6991 ms: download 1986 ms overlapping gunzip 384 ms, parse 1743 ms, sort 69 ms, write 3600 ms, index 310 ms: 5 candidates, 42600 repo-hours, 574 releases; waiting 592 ms; commit 1396 ms)
2026-11-07T15:48:57Z [load_day 2023-02-18] 2023-02-18: repo_hour merged from 24 files to 1 (1364171 rows, 5900 ms)
2026-11-07T15:48:58Z [load_day 2023-02-18] 2023-02-18: index committed in 7587 ms (24 + 1 + 24 files)
2026-11-07T15:48:58Z [load_day 2023-02-18] 2023-02-18: 2976066 events in 24 hours
2026-11-07T15:48:58Z [load_day 2023-02-18] attempt 1 succeeded