orcaLog in

Runs · run 2608

load_day 2024-06-18, attempt 1 succeeded

Host
73ccef5e07c2:138104
Started
2026-11-08T06:35:21Z
Ended
2026-11-08T06:37:32Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
735 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
205.8 s, up to 3.3 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/2608/load_day/2024-06-18/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T06:35:21Z [load_day 2024-06-18] attempt 1 started
2026-11-08T06:35:22Z [load_day 2024-06-18] 2024-06-18: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T06:35:30Z [load_day 2024-06-18] 2024-06-18 hour 0: 195188 events in 0 files, snapshot none (task 7786 ms: download 5209 ms overlapping gunzip 1464 ms, parse 5373 ms, sort 0 ms, write 0 ms, index 761 ms: 16 candidates, 97536 repo-hours, 1974 releases; waiting 0 ms; commit 0 ms)
2026-11-08T06:35:31Z [load_day 2024-06-18] 2024-06-18 hour 1: 208535 events in 0 files, snapshot none (task 8680 ms: download 5897 ms overlapping gunzip 1534 ms, parse 5515 ms, sort 0 ms, write 0 ms, index 834 ms: 20 candidates, 113322 repo-hours, 1422 releases; waiting 468 ms; commit 0 ms)
2026-11-08T06:35:39Z [load_day 2024-06-18] 2024-06-18 hour 2: 172170 events in 0 files, snapshot none (task 8764 ms: download 5952 ms overlapping gunzip 1582 ms, parse 5506 ms, sort 0 ms, write 0 ms, index 591 ms: 10 candidates, 71826 repo-hours, 1351 releases; waiting 691 ms; commit 0 ms)
2026-11-08T06:35:39Z [load_day 2024-06-18] 2024-06-18 hour 3: 186660 events in 0 files, snapshot none (task 7969 ms: download 4972 ms overlapping gunzip 1278 ms, parse 5150 ms, sort 0 ms, write 0 ms, index 757 ms: 5 candidates, 78710 repo-hours, 5834 releases; waiting 480 ms; commit 0 ms)
2026-11-08T06:35:48Z [load_day 2024-06-18] 2024-06-18 hour 4: 163432 events in 0 files, snapshot none (task 8675 ms: download 5509 ms overlapping gunzip 1517 ms, parse 5759 ms, sort 0 ms, write 0 ms, index 609 ms: 11 candidates, 63350 repo-hours, 961 releases; waiting 515 ms; commit 0 ms)
2026-11-08T06:35:50Z [load_day 2024-06-18] 2024-06-18 hour 5: 178820 events in 0 files, snapshot none (task 9725 ms: download 6728 ms overlapping gunzip 1636 ms, parse 6745 ms, sort 0 ms, write 0 ms, index 584 ms: 7 candidates, 71022 repo-hours, 1146 releases; waiting 489 ms; commit 0 ms)
2026-11-08T06:35:59Z [load_day 2024-06-18] 2024-06-18 hour 6: 218643 events in 0 files, snapshot none (task 10288 ms: download 6879 ms overlapping gunzip 1667 ms, parse 6499 ms, sort 0 ms, write 0 ms, index 889 ms: 12 candidates, 99048 repo-hours, 1557 releases; waiting 923 ms; commit 0 ms)
2026-11-08T06:36:01Z [load_day 2024-06-18] 2024-06-18 hour 7: 221128 events in 0 files, snapshot none (task 10555 ms: download 7775 ms overlapping gunzip 1764 ms, parse 7252 ms, sort 0 ms, write 0 ms, index 734 ms: 12 candidates, 90216 repo-hours, 1571 releases; waiting 512 ms; commit 0 ms)
2026-11-08T06:36:08Z [load_day 2024-06-18] 2024-06-18 hour 8: 231419 events in 0 files, snapshot none (task 8525 ms: download 5896 ms overlapping gunzip 1365 ms, parse 5410 ms, sort 0 ms, write 0 ms, index 736 ms: 6 candidates, 96804 repo-hours, 1820 releases; waiting 654 ms; commit 0 ms)
2026-11-08T06:36:08Z [load_day 2024-06-18] 2024-06-18 hour 9: 232975 events in 0 files, snapshot none (task 6967 ms: download 4446 ms overlapping gunzip 1202 ms, parse 4785 ms, sort 0 ms, write 0 ms, index 765 ms: 12 candidates, 100577 repo-hours, 1858 releases; waiting 20 ms; commit 0 ms)
2026-11-08T06:36:16Z [load_day 2024-06-18] 2024-06-18 hour 10: 216164 events in 0 files, snapshot none (task 7477 ms: download 4906 ms overlapping gunzip 1145 ms, parse 4700 ms, sort 0 ms, write 0 ms, index 750 ms: 10 candidates, 89903 repo-hours, 1754 releases; waiting 581 ms; commit 0 ms)
2026-11-08T06:36:16Z [load_day 2024-06-18] 2024-06-18 hour 11: 216623 events in 0 files, snapshot none (task 7304 ms: download 4847 ms overlapping gunzip 1152 ms, parse 4687 ms, sort 0 ms, write 0 ms, index 651 ms: 8 candidates, 87419 repo-hours, 1710 releases; waiting 537 ms; commit 0 ms)
2026-11-08T06:36:28Z [load_day 2024-06-18] 2024-06-18 hour 12: 276474 events in 0 files, snapshot none (task 11031 ms: download 7193 ms overlapping gunzip 1597 ms, parse 6844 ms, sort 0 ms, write 0 ms, index 1787 ms: 15 candidates, 133530 repo-hours, 1854 releases; waiting 520 ms; commit 0 ms)
2026-11-08T06:36:28Z [load_day 2024-06-18] 2024-06-18 hour 13: 256086 events in 0 files, snapshot none (task 11652 ms: download 8147 ms overlapping gunzip 1831 ms, parse 7700 ms, sort 0 ms, write 0 ms, index 1453 ms: 12 candidates, 117727 repo-hours, 1675 releases; waiting 393 ms; commit 0 ms)
2026-11-08T06:36:41Z [load_day 2024-06-18] 2024-06-18 hour 14: 243213 events in 0 files, snapshot none (task 12370 ms: download 9396 ms overlapping gunzip 2184 ms, parse 8559 ms, sort 0 ms, write 0 ms, index 778 ms: 9 candidates, 102730 repo-hours, 1666 releases; waiting 590 ms; commit 0 ms)
2026-11-08T06:36:41Z [load_day 2024-06-18] 2024-06-18 hour 15: 251506 events in 0 files, snapshot none (task 12157 ms: download 9197 ms overlapping gunzip 2115 ms, parse 8368 ms, sort 0 ms, write 0 ms, index 761 ms: 13 candidates, 111428 repo-hours, 1900 releases; waiting 498 ms; commit 0 ms)
2026-11-08T06:36:51Z [load_day 2024-06-18] 2024-06-18 hour 16: 227387 events in 0 files, snapshot none (task 10090 ms: download 7490 ms overlapping gunzip 1709 ms, parse 7371 ms, sort 0 ms, write 0 ms, index 794 ms: 12 candidates, 96304 repo-hours, 1700 releases; waiting 17 ms; commit 0 ms)
2026-11-08T06:36:52Z [load_day 2024-06-18] 2024-06-18 hour 17: 220691 events in 0 files, snapshot none (task 10659 ms: download 8253 ms overlapping gunzip 1865 ms, parse 7406 ms, sort 0 ms, write 0 ms, index 643 ms: 10 candidates, 88962 repo-hours, 1541 releases; waiting 449 ms; commit 0 ms)
2026-11-08T06:37:02Z [load_day 2024-06-18] 2024-06-18 hour 18: 229675 events in 0 files, snapshot none (task 9816 ms: download 7050 ms overlapping gunzip 1605 ms, parse 6540 ms, sort 0 ms, write 0 ms, index 867 ms: 8 candidates, 103227 repo-hours, 1597 releases; waiting 502 ms; commit 0 ms)
2026-11-08T06:37:02Z [load_day 2024-06-18] 2024-06-18 hour 19: 207063 events in 0 files, snapshot none (task 8600 ms: download 6082 ms overlapping gunzip 1443 ms, parse 5650 ms, sort 0 ms, write 0 ms, index 668 ms: 14 candidates, 86084 repo-hours, 1396 releases; waiting 543 ms; commit 0 ms)
2026-11-08T06:37:12Z [load_day 2024-06-18] 2024-06-18 hour 20: 201997 events in 0 files, snapshot none (task 9203 ms: download 6667 ms overlapping gunzip 1540 ms, parse 6427 ms, sort 0 ms, write 0 ms, index 674 ms: 13 candidates, 83776 repo-hours, 1527 releases; waiting 221 ms; commit 0 ms)
2026-11-08T06:37:12Z [load_day 2024-06-18] 2024-06-18 hour 21: 191098 events in 0 files, snapshot none (task 8983 ms: download 6187 ms overlapping gunzip 1663 ms, parse 6077 ms, sort 0 ms, write 0 ms, index 631 ms: 16 candidates, 78742 repo-hours, 1425 releases; waiting 309 ms; commit 0 ms)
2026-11-08T06:37:20Z [load_day 2024-06-18] 2024-06-18 hour 22: 170594 events in 0 files, snapshot none (task 8014 ms: download 5528 ms overlapping gunzip 1280 ms, parse 5391 ms, sort 0 ms, write 0 ms, index 459 ms: 13 candidates, 64514 repo-hours, 1465 releases; waiting 584 ms; commit 0 ms)
2026-11-08T06:37:20Z [load_day 2024-06-18] 2024-06-18 hour 23: 162542 events in 0 files, snapshot none (task 7183 ms: download 4685 ms overlapping gunzip 1182 ms, parse 4719 ms, sort 0 ms, write 0 ms, index 540 ms: 4 candidates, 61710 repo-hours, 1272 releases; waiting 505 ms; commit 0 ms)
2026-11-08T06:37:30Z [load_day 2024-06-18] 2024-06-18: repo_hour merged from 24 files to 1 (2188467 rows, 9907 ms)
2026-11-08T06:37:32Z [load_day 2024-06-18] 2024-06-18: index committed in 12157 ms (24 + 1 + 24 files)
2026-11-08T06:37:32Z [load_day 2024-06-18] 2024-06-18: 5080083 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T06:37:32Z [load_day 2024-06-18] attempt 1 succeeded