orcaLog in

Runs · run 2172

load_day 2024-03-08, attempt 1 succeeded

Host
73ccef5e07c2:95594
Started
2026-11-08T05:01:18Z
Ended
2026-11-08T05:03:08Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
659 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
173.6 s, up to 3.1 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/2172/load_day/2024-03-08/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T05:01:18Z [load_day 2024-03-08] attempt 1 started
2026-11-08T05:01:19Z [load_day 2024-03-08] 2024-03-08: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T05:01:27Z [load_day 2024-03-08] 2024-03-08 hour 0: 262297 events in 0 files, snapshot none (task 7586 ms: download 4805 ms overlapping gunzip 1096 ms, parse 4977 ms, sort 0 ms, write 0 ms, index 779 ms: 7 candidates, 98606 repo-hours, 1134 releases; waiting 472 ms; commit 0 ms)
2026-11-08T05:01:27Z [load_day 2024-03-08] 2024-03-08 hour 1: 257695 events in 0 files, snapshot none (task 7680 ms: download 4616 ms overlapping gunzip 1013 ms, parse 4754 ms, sort 0 ms, write 0 ms, index 1099 ms: 7 candidates, 98509 repo-hours, 751 releases; waiting 500 ms; commit 0 ms)
2026-11-08T05:01:34Z [load_day 2024-03-08] 2024-03-08 hour 2: 229846 events in 0 files, snapshot none (task 6664 ms: download 4191 ms overlapping gunzip 1009 ms, parse 4370 ms, sort 0 ms, write 0 ms, index 466 ms: 12 candidates, 64545 repo-hours, 697 releases; waiting 489 ms; commit 0 ms)
2026-11-08T05:01:34Z [load_day 2024-03-08] 2024-03-08 hour 3: 229177 events in 0 files, snapshot none (task 6198 ms: download 3641 ms overlapping gunzip 976 ms, parse 3983 ms, sort 0 ms, write 0 ms, index 470 ms: 14 candidates, 61923 repo-hours, 1011 releases; waiting 457 ms; commit 0 ms)
2026-11-08T05:01:40Z [load_day 2024-03-08] 2024-03-08 hour 4: 218705 events in 0 files, snapshot none (task 5740 ms: download 4343 ms overlapping gunzip 760 ms, parse 3343 ms, sort 0 ms, write 0 ms, index 477 ms: 14 candidates, 57610 repo-hours, 532 releases; waiting 804 ms; commit 0 ms)
2026-11-08T05:01:40Z [load_day 2024-03-08] 2024-03-08 hour 5: 222517 events in 0 files, snapshot none (task 5335 ms: download 3429 ms overlapping gunzip 752 ms, parse 3167 ms, sort 0 ms, write 0 ms, index 466 ms: 6 candidates, 63010 repo-hours, 703 releases; waiting 565 ms; commit 0 ms)
2026-11-08T05:01:46Z [load_day 2024-03-08] 2024-03-08 hour 6: 242218 events in 0 files, snapshot none (task 5520 ms: download 3165 ms overlapping gunzip 767 ms, parse 3311 ms, sort 0 ms, write 0 ms, index 579 ms: 10 candidates, 76273 repo-hours, 802 releases; waiting 521 ms; commit 0 ms)
2026-11-08T05:01:47Z [load_day 2024-03-08] 2024-03-08 hour 7: 246625 events in 0 files, snapshot none (task 6031 ms: download 3555 ms overlapping gunzip 875 ms, parse 3743 ms, sort 0 ms, write 0 ms, index 596 ms: 6 candidates, 74242 repo-hours, 1001 releases; waiting 523 ms; commit 0 ms)
2026-11-08T05:01:55Z [load_day 2024-03-08] 2024-03-08 hour 8: 256724 events in 0 files, snapshot none (task 8385 ms: download 5528 ms overlapping gunzip 1325 ms, parse 5611 ms, sort 0 ms, write 0 ms, index 652 ms: 6 candidates, 81114 repo-hours, 972 releases; waiting 530 ms; commit 0 ms)
2026-11-08T05:01:56Z [load_day 2024-03-08] 2024-03-08 hour 9: 273956 events in 0 files, snapshot none (task 8843 ms: download 6184 ms overlapping gunzip 1459 ms, parse 6275 ms, sort 0 ms, write 0 ms, index 639 ms: 9 candidates, 86243 repo-hours, 1214 releases; waiting 174 ms; commit 0 ms)
2026-11-08T05:02:05Z [load_day 2024-03-08] 2024-03-08 hour 10: 266852 events in 0 files, snapshot none (task 9544 ms: download 6435 ms overlapping gunzip 1544 ms, parse 6496 ms, sort 0 ms, write 0 ms, index 722 ms: 9 candidates, 83406 repo-hours, 1164 releases; waiting 511 ms; commit 0 ms)
2026-11-08T05:02:06Z [load_day 2024-03-08] 2024-03-08 hour 11: 264412 events in 0 files, snapshot none (task 9276 ms: download 5673 ms overlapping gunzip 1434 ms, parse 6411 ms, sort 0 ms, write 0 ms, index 555 ms: 7 candidates, 79667 repo-hours, 1104 releases; waiting 560 ms; commit 0 ms)
2026-11-08T05:02:15Z [load_day 2024-03-08] 2024-03-08 hour 12: 313282 events in 0 files, snapshot none (task 9376 ms: download 6070 ms overlapping gunzip 1372 ms, parse 6255 ms, sort 0 ms, write 0 ms, index 861 ms: 11 candidates, 110196 repo-hours, 1050 releases; waiting 523 ms; commit 0 ms)
2026-11-08T05:02:16Z [load_day 2024-03-08] 2024-03-08 hour 13: 288389 events in 0 files, snapshot none (task 8818 ms: download 6148 ms overlapping gunzip 1319 ms, parse 5941 ms, sort 0 ms, write 0 ms, index 773 ms: 12 candidates, 104155 repo-hours, 1084 releases; waiting 472 ms; commit 0 ms)
2026-11-08T05:02:24Z [load_day 2024-03-08] 2024-03-08 hour 14: 285101 events in 0 files, snapshot none (task 8815 ms: download 5727 ms overlapping gunzip 1367 ms, parse 5952 ms, sort 0 ms, write 0 ms, index 704 ms: 14 candidates, 93510 repo-hours, 1208 releases; waiting 486 ms; commit 0 ms)
2026-11-08T05:02:25Z [load_day 2024-03-08] 2024-03-08 hour 15: 283596 events in 0 files, snapshot none (task 8711 ms: download 5557 ms overlapping gunzip 1391 ms, parse 5896 ms, sort 0 ms, write 0 ms, index 645 ms: 8 candidates, 92933 repo-hours, 1380 releases; waiting 473 ms; commit 0 ms)
2026-11-08T05:02:33Z [load_day 2024-03-08] 2024-03-08 hour 16: 277636 events in 0 files, snapshot none (task 8573 ms: download 5907 ms overlapping gunzip 1323 ms, parse 5730 ms, sort 0 ms, write 0 ms, index 668 ms: 8 candidates, 88974 repo-hours, 1151 releases; waiting 502 ms; commit 0 ms)
2026-11-08T05:02:33Z [load_day 2024-03-08] 2024-03-08 hour 17: 275115 events in 0 files, snapshot none (task 8038 ms: download 5329 ms overlapping gunzip 1228 ms, parse 5323 ms, sort 0 ms, write 0 ms, index 656 ms: 3 candidates, 88594 repo-hours, 1012 releases; waiting 543 ms; commit 0 ms)
2026-11-08T05:02:42Z [load_day 2024-03-08] 2024-03-08 hour 18: 268582 events in 0 files, snapshot none (task 7812 ms: download 5204 ms overlapping gunzip 1186 ms, parse 5155 ms, sort 0 ms, write 0 ms, index 644 ms: 5 candidates, 87130 repo-hours, 1137 releases; waiting 494 ms; commit 0 ms)
2026-11-08T05:02:42Z [load_day 2024-03-08] 2024-03-08 hour 19: 252482 events in 0 files, snapshot none (task 7725 ms: download 5229 ms overlapping gunzip 1190 ms, parse 5122 ms, sort 0 ms, write 0 ms, index 592 ms: 11 candidates, 72620 repo-hours, 984 releases; waiting 529 ms; commit 0 ms)
2026-11-08T05:02:51Z [load_day 2024-03-08] 2024-03-08 hour 20: 244695 events in 0 files, snapshot none (task 8765 ms: download 5481 ms overlapping gunzip 1285 ms, parse 5313 ms, sort 0 ms, write 0 ms, index 1296 ms: 4 candidates, 70765 repo-hours, 987 releases; waiting 568 ms; commit 0 ms)
2026-11-08T05:02:51Z [load_day 2024-03-08] 2024-03-08 hour 21: 236225 events in 0 files, snapshot none (task 8607 ms: download 5497 ms overlapping gunzip 1352 ms, parse 5544 ms, sort 0 ms, write 0 ms, index 890 ms: 7 candidates, 64483 repo-hours, 969 releases; waiting 495 ms; commit 0 ms)
2026-11-08T05:02:58Z [load_day 2024-03-08] 2024-03-08 hour 22: 223199 events in 0 files, snapshot none (task 6731 ms: download 4296 ms overlapping gunzip 1022 ms, parse 4287 ms, sort 0 ms, write 0 ms, index 553 ms: 4 candidates, 59550 repo-hours, 937 releases; waiting 527 ms; commit 0 ms)
2026-11-08T05:02:58Z [load_day 2024-03-08] 2024-03-08 hour 23: 209226 events in 0 files, snapshot none (task 5938 ms: download 3504 ms overlapping gunzip 908 ms, parse 3730 ms, sort 0 ms, write 0 ms, index 499 ms: 2 candidates, 54667 repo-hours, 735 releases; waiting 526 ms; commit 0 ms)
2026-11-08T05:03:06Z [load_day 2024-03-08] 2024-03-08: repo_hour merged from 24 files to 1 (1912725 rows, 8123 ms)
2026-11-08T05:03:08Z [load_day 2024-03-08] 2024-03-08: index committed in 10289 ms (24 + 1 + 24 files)
2026-11-08T05:03:08Z [load_day 2024-03-08] 2024-03-08: 6128552 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T05:03:08Z [load_day 2024-03-08] attempt 1 succeeded