orcaLog in

Runs · run 1128

load_day 2023-05-28, attempt 1 succeeded

Host
caf251265124:410460
Started
2026-11-07T20:45:13Z
Ended
2026-11-07T20:47:15Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/1128/load_day/2023-05-28/1.log
Code
pipelines/gharchive.mojo:116

Log

2026-11-07T20:45:13Z [load_day 2023-05-28] attempt 1 started
2026-11-07T20:45:14Z [load_day 2023-05-28] 2023-05-28: 2 hours in flight, about 1200 MB
2026-11-07T20:45:24Z [load_day 2023-05-28] 2023-05-28 hour 0: 102174 events in 3 files, snapshot 912927130154157919 (task 6620 ms: download 1565 ms overlapping gunzip 357 ms, parse 1728 ms, sort 63 ms, write 3432 ms, index 351 ms: 3 candidates, 56000 repo-hours, 782 releases; waiting 477 ms; commit 1671 ms)
2026-11-07T20:45:26Z [load_day 2023-05-28] 2023-05-28 hour 1: 104950 events in 3 files, snapshot 2451724355583657202 (task 6879 ms: download 2315 ms overlapping gunzip 349 ms, parse 1717 ms, sort 59 ms, write 3520 ms, index 388 ms: 3 candidates, 61389 repo-hours, 722 releases; waiting 495 ms; commit 1643 ms)
2026-11-07T20:45:31Z [load_day 2023-05-28] 2023-05-28 hour 2: 92040 events in 2 files, snapshot 3435289008277886551 (task 5973 ms: download 1711 ms overlapping gunzip 304 ms, parse 1386 ms, sort 62 ms, write 3053 ms, index 316 ms: 1 candidates, 47537 repo-hours, 591 releases; waiting 530 ms; commit 1712 ms)
2026-11-07T20:45:33Z [load_day 2023-05-28] 2023-05-28 hour 3: 105714 events in 3 files, snapshot 4564150742721990852 (task 5738 ms: download 1906 ms overlapping gunzip 298 ms, parse 1459 ms, sort 59 ms, write 2881 ms, index 261 ms: 3 candidates, 37223 repo-hours, 610 releases; waiting 461 ms; commit 1812 ms)
2026-11-07T20:45:37Z [load_day 2023-05-28] 2023-05-28 hour 4: 86200 events in 2 files, snapshot 4500400941493721676 (task 5604 ms: download 1898 ms overlapping gunzip 299 ms, parse 1360 ms, sort 43 ms, write 2723 ms, index 279 ms: 2 candidates, 37501 repo-hours, 467 releases; waiting 535 ms; commit 1808 ms)
2026-11-07T20:45:39Z [load_day 2023-05-28] 2023-05-28 hour 5: 93099 events in 2 files, snapshot 9056313252221676115 (task 6024 ms: download 1560 ms overlapping gunzip 321 ms, parse 1486 ms, sort 49 ms, write 3004 ms, index 322 ms: 5 candidates, 40628 repo-hours, 638 releases; waiting 508 ms; commit 1614 ms)
2026-11-07T20:45:45Z [load_day 2023-05-28] 2023-05-28 hour 6: 106291 events in 3 files, snapshot 1580966758686369360 (task 6914 ms: download 2807 ms overlapping gunzip 368 ms, parse 1710 ms, sort 62 ms, write 3410 ms, index 358 ms: 2 candidates, 49718 repo-hours, 676 releases; waiting 587 ms; commit 1726 ms)
2026-11-07T20:45:48Z [load_day 2023-05-28] 2023-05-28 hour 7: 108080 events in 3 files, snapshot 7074466429550897732 (task 7070 ms: download 2026 ms overlapping gunzip 386 ms, parse 1722 ms, sort 70 ms, write 3659 ms, index 352 ms: 3 candidates, 47713 repo-hours, 550 releases; waiting 522 ms; commit 1827 ms)
2026-11-07T20:45:54Z [load_day 2023-05-28] 2023-05-28 hour 8: 119197 events in 3 files, snapshot 2321302309761244813 (task 7737 ms: download 1756 ms overlapping gunzip 422 ms, parse 1874 ms, sort 68 ms, write 4364 ms, index 375 ms: 4 candidates, 53169 repo-hours, 718 releases; waiting 363 ms; commit 1722 ms)
2026-11-07T20:45:58Z [load_day 2023-05-28] 2023-05-28 hour 9: 135593 events in 3 files, snapshot 3946390230756335946 (task 9536 ms: download 3906 ms overlapping gunzip 562 ms, parse 2322 ms, sort 88 ms, write 5437 ms, index 390 ms: 16 candidates, 58869 repo-hours, 860 releases; waiting 496 ms; commit 1689 ms)
2026-11-07T20:46:05Z [load_day 2023-05-28] 2023-05-28 hour 10: 136721 events in 3 files, snapshot 4606425656789226219 (task 10668 ms: download 4793 ms overlapping gunzip 582 ms, parse 2417 ms, sort 79 ms, write 5541 ms, index 406 ms: 8 candidates, 59300 repo-hours, 752 releases; waiting 1326 ms; commit 1665 ms)
2026-11-07T20:46:09Z [load_day 2023-05-28] 2023-05-28 hour 11: 135486 events in 3 files, snapshot 7772963348954425578 (task 9931 ms: download 4151 ms overlapping gunzip 599 ms, parse 2443 ms, sort 88 ms, write 5621 ms, index 438 ms: 12 candidates, 56870 repo-hours, 713 releases; waiting 497 ms; commit 1959 ms)
2026-11-07T20:46:18Z [load_day 2023-05-28] 2023-05-28 hour 12: 203965 events in 5 files, snapshot 82317622862571913 (task 11965 ms: download 4496 ms overlapping gunzip 664 ms, parse 2974 ms, sort 115 ms, write 6566 ms, index 541 ms: 10 candidates, 90114 repo-hours, 864 releases; waiting 796 ms; commit 1776 ms)
2026-11-07T20:46:20Z [load_day 2023-05-28] 2023-05-28 hour 13: 158695 events in 4 files, snapshot 2541895626762173887 (task 10139 ms: download 3731 ms overlapping gunzip 513 ms, parse 2363 ms, sort 97 ms, write 5270 ms, index 545 ms: 9 candidates, 83282 repo-hours, 819 releases; waiting 1063 ms; commit 2209 ms)
2026-11-07T20:46:28Z [load_day 2023-05-28] 2023-05-28 hour 14: 143630 events in 3 files, snapshot 656730682394101130 (task 9229 ms: download 3414 ms overlapping gunzip 545 ms, parse 2470 ms, sort 89 ms, write 5092 ms, index 439 ms: 3 candidates, 65920 repo-hours, 841 releases; waiting 301 ms; commit 1754 ms)
2026-11-07T20:46:30Z [load_day 2023-05-28] 2023-05-28 hour 15: 145969 events in 3 files, snapshot 5559265736536537342 (task 9505 ms: download 3607 ms overlapping gunzip 551 ms, parse 2416 ms, sort 90 ms, write 5125 ms, index 508 ms: 3 candidates, 66758 repo-hours, 928 releases; waiting 496 ms; commit 1792 ms)
2026-11-07T20:46:38Z [load_day 2023-05-28] 2023-05-28 hour 16: 139519 events in 3 files, snapshot 8640808280541740490 (task 9000 ms: download 2327 ms overlapping gunzip 500 ms, parse 2279 ms, sort 85 ms, write 4829 ms, index 413 ms: 4 candidates, 64564 repo-hours, 739 releases; waiting 517 ms; commit 1834 ms)
2026-11-07T20:46:40Z [load_day 2023-05-28] 2023-05-28 hour 17: 134455 events in 3 files, snapshot 6927346889095709141 (task 8863 ms: download 3543 ms overlapping gunzip 520 ms, parse 2312 ms, sort 86 ms, write 4726 ms, index 389 ms: 4 candidates, 58593 repo-hours, 643 releases; waiting 507 ms; commit 1781 ms)
2026-11-07T20:46:47Z [load_day 2023-05-28] 2023-05-28 hour 18: 139228 events in 3 files, snapshot 6001783592950185047 (task 8602 ms: download 2370 ms overlapping gunzip 505 ms, parse 2253 ms, sort 88 ms, write 4544 ms, index 435 ms: 4 candidates, 62707 repo-hours, 872 releases; waiting 492 ms; commit 1830 ms)
2026-11-07T20:46:49Z [load_day 2023-05-28] 2023-05-28 hour 19: 124563 events in 3 files, snapshot 1565290939220374486 (task 7653 ms: download 1751 ms overlapping gunzip 429 ms, parse 1957 ms, sort 72 ms, write 4320 ms, index 354 ms: 6 candidates, 52869 repo-hours, 768 releases; waiting 244 ms; commit 1820 ms)
2026-11-07T20:46:58Z [load_day 2023-05-28] 2023-05-28 hour 20: 123563 events in 3 files, snapshot 2375973162572833966 (task 9750 ms: download 2173 ms overlapping gunzip 472 ms, parse 2210 ms, sort 69 ms, write 4783 ms, index 1412 ms: 7 candidates, 53990 repo-hours, 831 releases; waiting 503 ms; commit 1697 ms)
2026-11-07T20:47:00Z [load_day 2023-05-28] 2023-05-28 hour 21: 112719 events in 3 files, snapshot 6044135904109762647 (task 8425 ms: download 1627 ms overlapping gunzip 412 ms, parse 1913 ms, sort 75 ms, write 4948 ms, index 318 ms: 0 candidates, 48691 repo-hours, 1133 releases; waiting 498 ms; commit 1725 ms)
2026-11-07T20:47:06Z [load_day 2023-05-28] 2023-05-28 hour 22: 101276 events in 3 files, snapshot 178386677238108255 (task 6942 ms: download 1936 ms overlapping gunzip 382 ms, parse 1724 ms, sort 85 ms, write 3657 ms, index 298 ms: 5 candidates, 42811 repo-hours, 676 releases; waiting 504 ms; commit 1616 ms)
2026-11-07T20:47:07Z [load_day 2023-05-28] 2023-05-28 hour 23: 97474 events in 2 files, snapshot 3735521306929231639 (task 7057 ms: download 2432 ms overlapping gunzip 371 ms, parse 1738 ms, sort 71 ms, write 3576 ms, index 297 ms: 3 candidates, 43148 repo-hours, 640 releases; waiting 609 ms; commit 1690 ms)
2026-11-07T20:47:13Z [load_day 2023-05-28] 2023-05-28: repo_hour merged from 24 files to 1 (1339364 rows, 5765 ms)
2026-11-07T20:47:15Z [load_day 2023-05-28] 2023-05-28: index committed in 7649 ms (23 + 1 + 24 files)
2026-11-07T20:47:15Z [load_day 2023-05-28] 2023-05-28: 2950601 events in 24 hours
2026-11-07T20:47:15Z [load_day 2023-05-28] attempt 1 succeeded