orcaLog in

Runs · run 855

load_day 2023-02-26, attempt 1 succeeded

Host
caf251265124:97354
Started
2026-11-07T16:10:22Z
Ended
2026-11-07T16:12:24Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/855/load_day/2023-02-26/1.log
Code
pipelines/gharchive.mojo:116

Log

2026-11-07T16:10:22Z [load_day 2023-02-26] attempt 1 started
2026-11-07T16:10:23Z [load_day 2023-02-26] 2023-02-26: 2 hours in flight, about 1200 MB
2026-11-07T16:10:33Z [load_day 2023-02-26] 2023-02-26 hour 0: 109361 events in 3 files, snapshot 1406906713152259251 (task 7206 ms: download 1897 ms overlapping gunzip 411 ms, parse 1956 ms, sort 67 ms, write 3821 ms, index 347 ms: 2 candidates, 54937 repo-hours, 843 releases; waiting 284 ms; commit 1361 ms)
2026-11-07T16:10:34Z [load_day 2023-02-26] 2023-02-26 hour 1: 117576 events in 3 files, snapshot 1826902269743352218 (task 7347 ms: download 2242 ms overlapping gunzip 384 ms, parse 1852 ms, sort 90 ms, write 3765 ms, index 417 ms: 5 candidates, 65001 repo-hours, 802 releases; waiting 519 ms; commit 1404 ms)
2026-11-07T16:10:41Z [load_day 2023-02-26] 2023-02-26 hour 2: 101993 events in 3 files, snapshot 6003565381377738435 (task 7263 ms: download 1761 ms overlapping gunzip 433 ms, parse 1860 ms, sort 71 ms, write 3705 ms, index 316 ms: 6 candidates, 49280 repo-hours, 597 releases; waiting 525 ms; commit 1523 ms)
2026-11-07T16:10:43Z [load_day 2023-02-26] 2023-02-26 hour 3: 96349 events in 2 files, snapshot 2186952592707448572 (task 6863 ms: download 1788 ms overlapping gunzip 359 ms, parse 1649 ms, sort 74 ms, write 3243 ms, index 286 ms: 2 candidates, 41206 repo-hours, 730 releases; waiting 512 ms; commit 1490 ms)
2026-11-07T16:10:48Z [load_day 2023-02-26] 2023-02-26 hour 4: 93883 events in 2 files, snapshot 1138042508508637400 (task 6131 ms: download 1729 ms overlapping gunzip 327 ms, parse 1474 ms, sort 41 ms, write 2938 ms, index 267 ms: 0 candidates, 39994 repo-hours, 522 releases; waiting 778 ms; commit 1467 ms)
2026-11-07T16:10:50Z [load_day 2023-02-26] 2023-02-26 hour 5: 97087 events in 2 files, snapshot 7207151998193854158 (task 6268 ms: download 2268 ms overlapping gunzip 331 ms, parse 1518 ms, sort 53 ms, write 3008 ms, index 300 ms: 1 candidates, 41412 repo-hours, 649 releases; waiting 676 ms; commit 1466 ms)
2026-11-07T16:10:55Z [load_day 2023-02-26] 2023-02-26 hour 6: 105068 events in 3 files, snapshot 7631821551079869909 (task 6154 ms: download 1485 ms overlapping gunzip 360 ms, parse 1577 ms, sort 56 ms, write 3299 ms, index 331 ms: 2 candidates, 47979 repo-hours, 637 releases; waiting 242 ms; commit 1315 ms)
2026-11-07T16:10:57Z [load_day 2023-02-26] 2023-02-26 hour 7: 104380 events in 3 files, snapshot 7769358891216476865 (task 6621 ms: download 1847 ms overlapping gunzip 362 ms, parse 1641 ms, sort 70 ms, write 3419 ms, index 306 ms: 1 candidates, 45283 repo-hours, 520 releases; waiting 519 ms; commit 1260 ms)
2026-11-07T16:11:03Z [load_day 2023-02-26] 2023-02-26 hour 8: 108813 events in 3 files, snapshot 469697446322727399 (task 6797 ms: download 1875 ms overlapping gunzip 378 ms, parse 1709 ms, sort 61 ms, write 3497 ms, index 328 ms: 6 candidates, 48192 repo-hours, 584 releases; waiting 463 ms; commit 1360 ms)
2026-11-07T16:11:07Z [load_day 2023-02-26] 2023-02-26 hour 9: 115889 events in 3 files, snapshot 8071757756371882219 (task 8882 ms: download 3789 ms overlapping gunzip 448 ms, parse 1954 ms, sort 59 ms, write 4037 ms, index 342 ms: 3 candidates, 51060 repo-hours, 726 releases; waiting 1216 ms; commit 1460 ms)
2026-11-07T16:11:13Z [load_day 2023-02-26] 2023-02-26 hour 10: 124968 events in 3 files, snapshot 5850251583843938844 (task 8841 ms: download 3030 ms overlapping gunzip 519 ms, parse 2196 ms, sort 71 ms, write 4581 ms, index 360 ms: 5 candidates, 55460 repo-hours, 667 releases; waiting 767 ms; commit 1626 ms)
2026-11-07T16:11:16Z [load_day 2023-02-26] 2023-02-26 hour 11: 129326 events in 3 files, snapshot 2300755455347922545 (task 8513 ms: download 2223 ms overlapping gunzip 495 ms, parse 2129 ms, sort 69 ms, write 4527 ms, index 359 ms: 0 candidates, 58785 repo-hours, 784 releases; waiting 651 ms; commit 1437 ms)
2026-11-07T16:11:23Z [load_day 2023-02-26] 2023-02-26 hour 12: 179932 events in 4 files, snapshot 8654970912040392 (task 9904 ms: download 3358 ms overlapping gunzip 583 ms, parse 2590 ms, sort 98 ms, write 5661 ms, index 516 ms: 3 candidates, 87383 repo-hours, 766 releases; waiting 203 ms; commit 1468 ms)
2026-11-07T16:11:27Z [load_day 2023-02-26] 2023-02-26 hour 13: 160811 events in 4 files, snapshot 8420738936411673265 (task 10396 ms: download 3857 ms overlapping gunzip 560 ms, parse 2500 ms, sort 90 ms, write 5696 ms, index 570 ms: 2 candidates, 82184 repo-hours, 674 releases; waiting 673 ms; commit 1530 ms)
2026-11-07T16:11:34Z [load_day 2023-02-26] 2023-02-26 hour 14: 151068 events in 4 files, snapshot 6968310325588112143 (task 9888 ms: download 3809 ms overlapping gunzip 582 ms, parse 2539 ms, sort 93 ms, write 5352 ms, index 458 ms: 2 candidates, 68074 repo-hours, 1062 releases; waiting 507 ms; commit 1578 ms)
2026-11-07T16:11:38Z [load_day 2023-02-26] 2023-02-26 hour 15: 153889 events in 4 files, snapshot 5499533550245871938 (task 10261 ms: download 3892 ms overlapping gunzip 570 ms, parse 2513 ms, sort 81 ms, write 5397 ms, index 636 ms: 2 candidates, 69468 repo-hours, 1339 releases; waiting 704 ms; commit 1385 ms)
2026-11-07T16:11:45Z [load_day 2023-02-26] 2023-02-26 hour 16: 150980 events in 4 files, snapshot 382058460729272435 (task 10110 ms: download 3725 ms overlapping gunzip 551 ms, parse 2449 ms, sort 88 ms, write 5650 ms, index 479 ms: 2 candidates, 67016 repo-hours, 1055 releases; waiting 552 ms; commit 1423 ms)
2026-11-07T16:11:48Z [load_day 2023-02-26] 2023-02-26 hour 17: 146783 events in 3 files, snapshot 733272059807309406 (task 9273 ms: download 3532 ms overlapping gunzip 523 ms, parse 2374 ms, sort 94 ms, write 5078 ms, index 408 ms: 1 candidates, 62595 repo-hours, 979 releases; waiting 525 ms; commit 1457 ms)
2026-11-07T16:11:55Z [load_day 2023-02-26] 2023-02-26 hour 18: 151518 events in 4 files, snapshot 8688449243804885681 (task 9612 ms: download 3580 ms overlapping gunzip 542 ms, parse 2424 ms, sort 92 ms, write 5245 ms, index 463 ms: 6 candidates, 68875 repo-hours, 1111 releases; waiting 527 ms; commit 1376 ms)
2026-11-07T16:11:58Z [load_day 2023-02-26] 2023-02-26 hour 19: 140199 events in 3 files, snapshot 7921073018506941038 (task 9176 ms: download 3697 ms overlapping gunzip 530 ms, parse 2349 ms, sort 86 ms, write 4796 ms, index 423 ms: 1 candidates, 59189 repo-hours, 846 releases; waiting 651 ms; commit 1435 ms)
2026-11-07T16:12:06Z [load_day 2023-02-26] 2023-02-26 hour 20: 139017 events in 3 files, snapshot 7727404593439960359 (task 10154 ms: download 3536 ms overlapping gunzip 518 ms, parse 2303 ms, sort 84 ms, write 5067 ms, index 1272 ms: 2 candidates, 60391 repo-hours, 843 releases; waiting 568 ms; commit 1549 ms)
2026-11-07T16:12:08Z [load_day 2023-02-26] 2023-02-26 hour 21: 130670 events in 3 files, snapshot 5554765892425570131 (task 8643 ms: download 3429 ms overlapping gunzip 492 ms, parse 2219 ms, sort 76 ms, write 4591 ms, index 389 ms: 1 candidates, 54609 repo-hours, 797 releases; waiting 542 ms; commit 1565 ms)
2026-11-07T16:12:15Z [load_day 2023-02-26] 2023-02-26 hour 22: 124369 events in 3 files, snapshot 5895132084610331707 (task 8196 ms: download 2296 ms overlapping gunzip 471 ms, parse 2069 ms, sort 71 ms, write 4373 ms, index 344 ms: 2 candidates, 51875 repo-hours, 1333 releases; waiting 524 ms; commit 1468 ms)
2026-11-07T16:12:16Z [load_day 2023-02-26] 2023-02-26 hour 23: 118034 events in 3 files, snapshot 3550006912588112147 (task 8092 ms: download 2424 ms overlapping gunzip 446 ms, parse 1967 ms, sort 66 ms, write 4191 ms, index 336 ms: 2 candidates, 52873 repo-hours, 910 releases; waiting 787 ms; commit 1404 ms)
2026-11-07T16:12:22Z [load_day 2023-02-26] 2023-02-26: repo_hour merged from 24 files to 1 (1383121 rows, 5966 ms)
2026-11-07T16:12:24Z [load_day 2023-02-26] 2023-02-26: index committed in 8037 ms (22 + 1 + 24 files)
2026-11-07T16:12:24Z [load_day 2023-02-26] 2023-02-26: 3051963 events in 24 hours
2026-11-07T16:12:24Z [load_day 2023-02-26] attempt 1 succeeded