orcaLog in

Runs · run 2346

load_day 2024-04-19, attempt 1 succeeded

Host
73ccef5e07c2:111773
Started
2026-11-08T05:41:25Z
Ended
2026-11-08T05:43:28Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
694 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
200.8 s, up to 3.0 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/2346/load_day/2024-04-19/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T05:41:25Z [load_day 2024-04-19] attempt 1 started
2026-11-08T05:41:26Z [load_day 2024-04-19] 2024-04-19: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T05:41:34Z [load_day 2024-04-19] 2024-04-19 hour 0: 216053 events in 0 files, snapshot none (task 7962 ms: download 4345 ms overlapping gunzip 1149 ms, parse 5169 ms, sort 0 ms, write 0 ms, index 836 ms: 17 candidates, 94124 repo-hours, 1197 releases; waiting 500 ms; commit 0 ms)
2026-11-08T05:41:35Z [load_day 2024-04-19] 2024-04-19 hour 1: 221667 events in 0 files, snapshot none (task 8311 ms: download 4280 ms overlapping gunzip 1153 ms, parse 5089 ms, sort 0 ms, write 0 ms, index 1244 ms: 23 candidates, 97210 repo-hours, 955 releases; waiting 531 ms; commit 0 ms)
2026-11-08T05:41:42Z [load_day 2024-04-19] 2024-04-19 hour 2: 188535 events in 0 files, snapshot none (task 5823 ms: download 3478 ms overlapping gunzip 871 ms, parse 3713 ms, sort 0 ms, write 0 ms, index 475 ms: 17 candidates, 66450 repo-hours, 810 releases; waiting 510 ms; commit 0 ms)
2026-11-08T05:41:42Z [load_day 2024-04-19] 2024-04-19 hour 3: 192916 events in 0 files, snapshot none (task 5745 ms: download 3346 ms overlapping gunzip 845 ms, parse 3652 ms, sort 0 ms, write 0 ms, index 489 ms: 9 candidates, 64286 repo-hours, 1074 releases; waiting 497 ms; commit 0 ms)
2026-11-08T05:41:48Z [load_day 2024-04-19] 2024-04-19 hour 4: 187570 events in 0 files, snapshot none (task 5650 ms: download 3322 ms overlapping gunzip 802 ms, parse 3612 ms, sort 0 ms, write 0 ms, index 469 ms: 8 candidates, 60484 repo-hours, 916 releases; waiting 506 ms; commit 0 ms)
2026-11-08T05:41:48Z [load_day 2024-04-19] 2024-04-19 hour 5: 214168 events in 0 files, snapshot none (task 5506 ms: download 3223 ms overlapping gunzip 882 ms, parse 3771 ms, sort 0 ms, write 0 ms, index 434 ms: 10 candidates, 63796 repo-hours, 998 releases; waiting 207 ms; commit 0 ms)
2026-11-08T05:41:56Z [load_day 2024-04-19] 2024-04-19 hour 6: 220525 events in 0 files, snapshot none (task 7518 ms: download 4118 ms overlapping gunzip 1122 ms, parse 4912 ms, sort 0 ms, write 0 ms, index 705 ms: 6 candidates, 84320 repo-hours, 1252 releases; waiting 498 ms; commit 0 ms)
2026-11-08T05:41:57Z [load_day 2024-04-19] 2024-04-19 hour 7: 228979 events in 0 files, snapshot none (task 8440 ms: download 5507 ms overlapping gunzip 1299 ms, parse 5542 ms, sort 0 ms, write 0 ms, index 625 ms: 9 candidates, 81659 repo-hours, 1217 releases; waiting 669 ms; commit 0 ms)
2026-11-08T05:42:07Z [load_day 2024-04-19] 2024-04-19 hour 8: 255355 events in 0 files, snapshot none (task 9870 ms: download 7009 ms overlapping gunzip 1491 ms, parse 6699 ms, sort 0 ms, write 0 ms, index 907 ms: 12 candidates, 90321 repo-hours, 1606 releases; waiting 527 ms; commit 0 ms)
2026-11-08T05:42:08Z [load_day 2024-04-19] 2024-04-19 hour 9: 258497 events in 0 files, snapshot none (task 10020 ms: download 7101 ms overlapping gunzip 1538 ms, parse 7019 ms, sort 0 ms, write 0 ms, index 676 ms: 15 candidates, 91217 repo-hours, 1477 releases; waiting 487 ms; commit 0 ms)
2026-11-08T05:42:17Z [load_day 2024-04-19] 2024-04-19 hour 10: 254764 events in 0 files, snapshot none (task 10159 ms: download 7541 ms overlapping gunzip 1534 ms, parse 7030 ms, sort 0 ms, write 0 ms, index 648 ms: 13 candidates, 83627 repo-hours, 1350 releases; waiting 692 ms; commit 0 ms)
2026-11-08T05:42:17Z [load_day 2024-04-19] 2024-04-19 hour 11: 244172 events in 0 files, snapshot none (task 9254 ms: download 6617 ms overlapping gunzip 1463 ms, parse 6325 ms, sort 0 ms, write 0 ms, index 666 ms: 9 candidates, 80850 repo-hours, 1419 releases; waiting 571 ms; commit 0 ms)
2026-11-08T05:42:29Z [load_day 2024-04-19] 2024-04-19 hour 12: 301004 events in 0 files, snapshot none (task 11667 ms: download 8572 ms overlapping gunzip 1916 ms, parse 8222 ms, sort 0 ms, write 0 ms, index 885 ms: 15 candidates, 117714 repo-hours, 1451 releases; waiting 442 ms; commit 0 ms)
2026-11-08T05:42:30Z [load_day 2024-04-19] 2024-04-19 hour 13: 285575 events in 0 files, snapshot none (task 11573 ms: download 8727 ms overlapping gunzip 1858 ms, parse 8136 ms, sort 0 ms, write 0 ms, index 758 ms: 15 candidates, 108540 repo-hours, 1479 releases; waiting 547 ms; commit 0 ms)
2026-11-08T05:42:42Z [load_day 2024-04-19] 2024-04-19 hour 14: 261854 events in 0 files, snapshot none (task 12440 ms: download 8986 ms overlapping gunzip 1788 ms, parse 9237 ms, sort 0 ms, write 0 ms, index 684 ms: 14 candidates, 95519 repo-hours, 1446 releases; waiting 493 ms; commit 0 ms)
2026-11-08T05:42:42Z [load_day 2024-04-19] 2024-04-19 hour 15: 256592 events in 0 files, snapshot none (task 10007 ms: download 6939 ms overlapping gunzip 1516 ms, parse 6577 ms, sort 0 ms, write 0 ms, index 1096 ms: 11 candidates, 95138 repo-hours, 1450 releases; waiting 526 ms; commit 0 ms)
2026-11-08T05:42:52Z [load_day 2024-04-19] 2024-04-19 hour 16: 244841 events in 0 files, snapshot none (task 9091 ms: download 6513 ms overlapping gunzip 1395 ms, parse 6280 ms, sort 0 ms, write 0 ms, index 687 ms: 11 candidates, 89307 repo-hours, 1189 releases; waiting 516 ms; commit 0 ms)
2026-11-08T05:42:52Z [load_day 2024-04-19] 2024-04-19 hour 17: 236221 events in 0 files, snapshot none (task 9205 ms: download 6636 ms overlapping gunzip 1388 ms, parse 6330 ms, sort 0 ms, write 0 ms, index 696 ms: 13 candidates, 85014 repo-hours, 1315 releases; waiting 506 ms; commit 0 ms)
2026-11-08T05:43:01Z [load_day 2024-04-19] 2024-04-19 hour 18: 239433 events in 0 files, snapshot none (task 8720 ms: download 5458 ms overlapping gunzip 1321 ms, parse 5871 ms, sort 0 ms, write 0 ms, index 749 ms: 4 candidates, 86824 repo-hours, 1414 releases; waiting 512 ms; commit 0 ms)
2026-11-08T05:43:01Z [load_day 2024-04-19] 2024-04-19 hour 19: 218530 events in 0 files, snapshot none (task 8258 ms: download 5489 ms overlapping gunzip 1241 ms, parse 5588 ms, sort 0 ms, write 0 ms, index 684 ms: 16 candidates, 74229 repo-hours, 1325 releases; waiting 494 ms; commit 0 ms)
2026-11-08T05:43:10Z [load_day 2024-04-19] 2024-04-19 hour 20: 203171 events in 0 files, snapshot none (task 8630 ms: download 5799 ms overlapping gunzip 1208 ms, parse 5499 ms, sort 0 ms, write 0 ms, index 630 ms: 11 candidates, 73049 repo-hours, 1225 releases; waiting 644 ms; commit 0 ms)
2026-11-08T05:43:10Z [load_day 2024-04-19] 2024-04-19 hour 21: 185507 events in 0 files, snapshot none (task 7829 ms: download 5481 ms overlapping gunzip 1233 ms, parse 5154 ms, sort 0 ms, write 0 ms, index 494 ms: 7 candidates, 64293 repo-hours, 1026 releases; waiting 673 ms; commit 0 ms)
2026-11-08T05:43:17Z [load_day 2024-04-19] 2024-04-19 hour 22: 170522 events in 0 files, snapshot none (task 6060 ms: download 3735 ms overlapping gunzip 902 ms, parse 3906 ms, sort 0 ms, write 0 ms, index 424 ms: 7 candidates, 58350 repo-hours, 1055 releases; waiting 526 ms; commit 0 ms)
2026-11-08T05:43:17Z [load_day 2024-04-19] 2024-04-19 hour 23: 147771 events in 0 files, snapshot none (task 4822 ms: download 2714 ms overlapping gunzip 697 ms, parse 2973 ms, sort 0 ms, write 0 ms, index 358 ms: 7 candidates, 52133 repo-hours, 761 releases; waiting 523 ms; commit 0 ms)
2026-11-08T05:43:25Z [load_day 2024-04-19] 2024-04-19: repo_hour merged from 24 files to 1 (1958454 rows, 8533 ms)
2026-11-08T05:43:28Z [load_day 2024-04-19] 2024-04-19: index committed in 11458 ms (24 + 1 + 24 files)
2026-11-08T05:43:28Z [load_day 2024-04-19] 2024-04-19: 5434222 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T05:43:28Z [load_day 2024-04-19] attempt 1 succeeded