orcaLog in

Runs · run 2699

load_day 2024-07-10, attempt 1 succeeded

Host
73ccef5e07c2:147646
Started
2026-11-08T06:55:22Z
Ended
2026-11-08T06:57:25Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
784 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
189.0 s, up to 3.0 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/2699/load_day/2024-07-10/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T06:55:22Z [load_day 2024-07-10] attempt 1 started
2026-11-08T06:55:23Z [load_day 2024-07-10] 2024-07-10: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T06:55:33Z [load_day 2024-07-10] 2024-07-10 hour 0: 182336 events in 0 files, snapshot none (task 9053 ms: download 5987 ms overlapping gunzip 1296 ms, parse 5830 ms, sort 0 ms, write 0 ms, index 805 ms: 3 candidates, 94504 repo-hours, 1088 releases; waiting 778 ms; commit 0 ms)
2026-11-08T06:55:33Z [load_day 2024-07-10] 2024-07-10 hour 1: 195830 events in 0 files, snapshot none (task 8710 ms: download 5395 ms overlapping gunzip 1247 ms, parse 5761 ms, sort 0 ms, write 0 ms, index 1028 ms: 9 candidates, 109719 repo-hours, 949 releases; waiting 362 ms; commit 0 ms)
2026-11-08T06:55:40Z [load_day 2024-07-10] 2024-07-10 hour 2: 167841 events in 0 files, snapshot none (task 7115 ms: download 4272 ms overlapping gunzip 1136 ms, parse 4589 ms, sort 0 ms, write 0 ms, index 631 ms: 10 candidates, 76262 repo-hours, 878 releases; waiting 491 ms; commit 0 ms)
2026-11-08T06:55:41Z [load_day 2024-07-10] 2024-07-10 hour 3: 189435 events in 0 files, snapshot none (task 7359 ms: download 4259 ms overlapping gunzip 1144 ms, parse 4845 ms, sort 0 ms, write 0 ms, index 636 ms: 7 candidates, 81890 repo-hours, 5342 releases; waiting 477 ms; commit 0 ms)
2026-11-08T06:55:50Z [load_day 2024-07-10] 2024-07-10 hour 4: 163202 events in 0 files, snapshot none (task 8923 ms: download 6220 ms overlapping gunzip 1026 ms, parse 4313 ms, sort 0 ms, write 0 ms, index 499 ms: 6 candidates, 62944 repo-hours, 595 releases; waiting 2745 ms; commit 0 ms)
2026-11-08T06:55:50Z [load_day 2024-07-10] 2024-07-10 hour 5: 181060 events in 0 files, snapshot none (task 8971 ms: download 5791 ms overlapping gunzip 1271 ms, parse 5222 ms, sort 0 ms, write 0 ms, index 643 ms: 8 candidates, 70393 repo-hours, 927 releases; waiting 1524 ms; commit 0 ms)
2026-11-08T06:55:59Z [load_day 2024-07-10] 2024-07-10 hour 6: 219636 events in 0 files, snapshot none (task 8651 ms: download 5108 ms overlapping gunzip 1331 ms, parse 5793 ms, sort 0 ms, write 0 ms, index 878 ms: 16 candidates, 99019 repo-hours, 990 releases; waiting 293 ms; commit 0 ms)
2026-11-08T06:55:59Z [load_day 2024-07-10] 2024-07-10 hour 7: 233740 events in 0 files, snapshot none (task 8673 ms: download 5944 ms overlapping gunzip 1327 ms, parse 5869 ms, sort 0 ms, write 0 ms, index 682 ms: 5 candidates, 90844 repo-hours, 1043 releases; waiting 519 ms; commit 0 ms)
2026-11-08T06:56:10Z [load_day 2024-07-10] 2024-07-10 hour 8: 236429 events in 0 files, snapshot none (task 10589 ms: download 7514 ms overlapping gunzip 1654 ms, parse 6852 ms, sort 0 ms, write 0 ms, index 779 ms: 9 candidates, 98787 repo-hours, 1235 releases; waiting 973 ms; commit 0 ms)
2026-11-08T06:56:10Z [load_day 2024-07-10] 2024-07-10 hour 9: 238406 events in 0 files, snapshot none (task 10978 ms: download 7786 ms overlapping gunzip 1675 ms, parse 6840 ms, sort 0 ms, write 0 ms, index 707 ms: 8 candidates, 104043 repo-hours, 1441 releases; waiting 1028 ms; commit 0 ms)
2026-11-08T06:56:18Z [load_day 2024-07-10] 2024-07-10 hour 10: 212408 events in 0 files, snapshot none (task 7608 ms: download 5062 ms overlapping gunzip 1166 ms, parse 5004 ms, sort 0 ms, write 0 ms, index 638 ms: 7 candidates, 91166 repo-hours, 1379 releases; waiting 524 ms; commit 0 ms)
2026-11-08T06:56:19Z [load_day 2024-07-10] 2024-07-10 hour 11: 213594 events in 0 files, snapshot none (task 7978 ms: download 5304 ms overlapping gunzip 1212 ms, parse 5097 ms, sort 0 ms, write 0 ms, index 714 ms: 11 candidates, 88255 repo-hours, 1171 releases; waiting 584 ms; commit 0 ms)
2026-11-08T06:56:27Z [load_day 2024-07-10] 2024-07-10 hour 12: 260079 events in 0 files, snapshot none (task 8994 ms: download 5719 ms overlapping gunzip 1324 ms, parse 5536 ms, sort 0 ms, write 0 ms, index 875 ms: 8 candidates, 128937 repo-hours, 1245 releases; waiting 527 ms; commit 0 ms)
2026-11-08T06:56:28Z [load_day 2024-07-10] 2024-07-10 hour 13: 253927 events in 0 files, snapshot none (task 8719 ms: download 6056 ms overlapping gunzip 1362 ms, parse 5730 ms, sort 0 ms, write 0 ms, index 843 ms: 15 candidates, 118897 repo-hours, 1384 releases; waiting 495 ms; commit 0 ms)
2026-11-08T06:56:38Z [load_day 2024-07-10] 2024-07-10 hour 14: 251937 events in 0 files, snapshot none (task 10187 ms: download 7135 ms overlapping gunzip 1627 ms, parse 6838 ms, sort 0 ms, write 0 ms, index 884 ms: 11 candidates, 109490 repo-hours, 1413 releases; waiting 504 ms; commit 0 ms)
2026-11-08T06:56:38Z [load_day 2024-07-10] 2024-07-10 hour 15: 249257 events in 0 files, snapshot none (task 9728 ms: download 7027 ms overlapping gunzip 1542 ms, parse 6666 ms, sort 0 ms, write 0 ms, index 778 ms: 15 candidates, 110093 repo-hours, 1364 releases; waiting 513 ms; commit 0 ms)
2026-11-08T06:56:48Z [load_day 2024-07-10] 2024-07-10 hour 16: 230382 events in 0 files, snapshot none (task 9661 ms: download 7132 ms overlapping gunzip 1481 ms, parse 6697 ms, sort 0 ms, write 0 ms, index 743 ms: 10 candidates, 96433 repo-hours, 1153 releases; waiting 509 ms; commit 0 ms)
2026-11-08T06:56:48Z [load_day 2024-07-10] 2024-07-10 hour 17: 217333 events in 0 files, snapshot none (task 8618 ms: download 6002 ms overlapping gunzip 1331 ms, parse 5882 ms, sort 0 ms, write 0 ms, index 704 ms: 14 candidates, 90082 repo-hours, 1155 releases; waiting 494 ms; commit 0 ms)
2026-11-08T06:56:58Z [load_day 2024-07-10] 2024-07-10 hour 18: 220225 events in 0 files, snapshot none (task 8908 ms: download 5595 ms overlapping gunzip 1307 ms, parse 5655 ms, sort 0 ms, write 0 ms, index 1124 ms: 11 candidates, 100316 repo-hours, 1191 releases; waiting 524 ms; commit 0 ms)
2026-11-08T06:56:58Z [load_day 2024-07-10] 2024-07-10 hour 19: 199629 events in 0 files, snapshot none (task 8476 ms: download 5148 ms overlapping gunzip 1282 ms, parse 5124 ms, sort 0 ms, write 0 ms, index 1271 ms: 7 candidates, 83396 repo-hours, 1090 releases; waiting 495 ms; commit 0 ms)
2026-11-08T06:57:06Z [load_day 2024-07-10] 2024-07-10 hour 20: 187103 events in 0 files, snapshot none (task 7709 ms: download 5005 ms overlapping gunzip 1185 ms, parse 4992 ms, sort 0 ms, write 0 ms, index 710 ms: 7 candidates, 76441 repo-hours, 986 releases; waiting 485 ms; commit 0 ms)
2026-11-08T06:57:06Z [load_day 2024-07-10] 2024-07-10 hour 21: 182838 events in 0 files, snapshot none (task 7164 ms: download 4523 ms overlapping gunzip 1135 ms, parse 4760 ms, sort 0 ms, write 0 ms, index 713 ms: 14 candidates, 76371 repo-hours, 1076 releases; waiting 305 ms; commit 0 ms)
2026-11-08T06:57:13Z [load_day 2024-07-10] 2024-07-10 hour 22: 158344 events in 0 files, snapshot none (task 6897 ms: download 4359 ms overlapping gunzip 1071 ms, parse 4538 ms, sort 0 ms, write 0 ms, index 484 ms: 12 candidates, 60467 repo-hours, 1009 releases; waiting 475 ms; commit 0 ms)
2026-11-08T06:57:13Z [load_day 2024-07-10] 2024-07-10 hour 23: 146980 events in 0 files, snapshot none (task 5989 ms: download 3525 ms overlapping gunzip 915 ms, parse 3824 ms, sort 0 ms, write 0 ms, index 440 ms: 5 candidates, 55203 repo-hours, 868 releases; waiting 484 ms; commit 0 ms)
2026-11-08T06:57:23Z [load_day 2024-07-10] 2024-07-10: repo_hour merged from 24 files to 1 (2173952 rows, 9703 ms)
2026-11-08T06:57:25Z [load_day 2024-07-10] 2024-07-10: index committed in 11985 ms (24 + 1 + 24 files)
2026-11-08T06:57:25Z [load_day 2024-07-10] 2024-07-10: 4991951 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T06:57:25Z [load_day 2024-07-10] attempt 1 succeeded