orcaLog in

Runs · run 1823

load_day 2023-12-06, attempt 1 succeeded

Host
3c2b29713ce8:637391
Started
2026-11-08T03:32:32Z
Ended
2026-11-08T03:36:48Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/1823/load_day/2023-12-06/1.log
Code
pipelines/gharchive.mojo:116

Log

2026-11-08T03:32:32Z [load_day 2023-12-06] attempt 1 started
2026-11-08T03:32:34Z [load_day 2023-12-06] 2023-12-06: 2 hours in flight, about 1200 MB
2026-11-08T03:32:59Z [load_day 2023-12-06] 2023-12-06 hour 0: 238461 events in 5 files, snapshot 341133828791737785 (task 20130 ms: download 11436 ms overlapping gunzip 1182 ms, parse 5459 ms, sort 313 ms, write 11805 ms, index 586 ms: 10 candidates, 87297 repo-hours, 923 releases; waiting 517 ms; commit 3142 ms)
2026-11-08T03:33:05Z [load_day 2023-12-06] 2023-12-06 hour 1: 228027 events in 5 files, snapshot 7268846126435671890 (task 19520 ms: download 10114 ms overlapping gunzip 1024 ms, parse 4952 ms, sort 176 ms, write 11755 ms, index 693 ms: 6 candidates, 93904 repo-hours, 829 releases; waiting 549 ms; commit 5846 ms)
2026-11-08T03:33:17Z [load_day 2023-12-06] 2023-12-06 hour 2: 249270 events in 5 files, snapshot 6530026111678591003 (task 17781 ms: download 9600 ms overlapping gunzip 1196 ms, parse 5525 ms, sort 244 ms, write 9513 ms, index 528 ms: 4 candidates, 63936 repo-hours, 796 releases; waiting 501 ms; commit 2898 ms)
2026-11-08T03:33:21Z [load_day 2023-12-06] 2023-12-06 hour 3: 258447 events in 6 files, snapshot 503936373574116432 (task 17259 ms: download 10307 ms overlapping gunzip 1093 ms, parse 4893 ms, sort 203 ms, write 9755 ms, index 524 ms: 8 candidates, 61046 repo-hours, 801 releases; waiting 520 ms; commit 3300 ms)
2026-11-08T03:33:33Z [load_day 2023-12-06] 2023-12-06 hour 4: 227681 events in 5 files, snapshot 1043929238255232420 (task 15125 ms: download 7251 ms overlapping gunzip 871 ms, parse 4119 ms, sort 178 ms, write 8654 ms, index 538 ms: 8 candidates, 57710 repo-hours, 662 releases; waiting 477 ms; commit 2562 ms)
2026-11-08T03:33:39Z [load_day 2023-12-06] 2023-12-06 hour 5: 224112 events in 5 files, snapshot 1472404610823574685 (task 15362 ms: download 8075 ms overlapping gunzip 976 ms, parse 4265 ms, sort 221 ms, write 7945 ms, index 777 ms: 7 candidates, 63677 repo-hours, 693 releases; waiting 826 ms; commit 4518 ms)
2026-11-08T03:33:52Z [load_day 2023-12-06] 2023-12-06 hour 6: 227556 events in 5 files, snapshot 7343910025132351073 (task 17234 ms: download 9016 ms overlapping gunzip 947 ms, parse 4599 ms, sort 187 ms, write 10073 ms, index 684 ms: 7 candidates, 75607 repo-hours, 746 releases; waiting 513 ms; commit 3001 ms)
2026-11-08T03:33:57Z [load_day 2023-12-06] 2023-12-06 hour 7: 248134 events in 5 files, snapshot 7746640162993524993 (task 18419 ms: download 11342 ms overlapping gunzip 1058 ms, parse 4978 ms, sort 244 ms, write 10710 ms, index 634 ms: 11 candidates, 72883 repo-hours, 694 releases; waiting 448 ms; commit 3017 ms)
2026-11-08T03:34:15Z [load_day 2023-12-06] 2023-12-06 hour 8: 272414 events in 6 files, snapshot 8922660317177670321 (task 20294 ms: download 12033 ms overlapping gunzip 1265 ms, parse 5588 ms, sort 284 ms, write 11896 ms, index 511 ms: 11 candidates, 76624 repo-hours, 845 releases; waiting 508 ms; commit 4432 ms)
2026-11-08T03:34:20Z [load_day 2023-12-06] 2023-12-06 hour 9: 279291 events in 6 files, snapshot 3597640096378095569 (task 21459 ms: download 12727 ms overlapping gunzip 1200 ms, parse 5482 ms, sort 243 ms, write 13249 ms, index 538 ms: 7 candidates, 79871 repo-hours, 1021 releases; waiting 511 ms; commit 2929 ms)
2026-11-08T03:34:45Z [load_day 2023-12-06] 2023-12-06 hour 10: 278614 events in 6 files, snapshot 6552603705858990583 (task 23036 ms: download 14250 ms overlapping gunzip 1447 ms, parse 6597 ms, sort 222 ms, write 13302 ms, index 649 ms: 14 candidates, 80084 repo-hours, 952 releases; waiting 507 ms; commit 10536 ms)
2026-11-08T03:34:49Z [load_day 2023-12-06] 2023-12-06 hour 11: 263057 events in 6 files, snapshot 2186717378833104188 (task 21370 ms: download 12636 ms overlapping gunzip 1218 ms, parse 5649 ms, sort 226 ms, write 12763 ms, index 731 ms: 12 candidates, 77756 repo-hours, 1079 releases; waiting 494 ms; commit 3165 ms)
2026-11-08T03:35:03Z [load_day 2023-12-06] 2023-12-06 hour 12: 295421 events in 6 files, snapshot 5551280375386140365 (task 22519 ms: download 15586 ms overlapping gunzip 1342 ms, parse 6467 ms, sort 244 ms, write 12981 ms, index 689 ms: 10 candidates, 104966 repo-hours, 1120 releases; waiting 498 ms; commit 3614 ms)
2026-11-08T03:35:10Z [load_day 2023-12-06] 2023-12-06 hour 13: 289246 events in 6 files, snapshot 3105989878980865484 (task 20415 ms: download 13905 ms overlapping gunzip 1089 ms, parse 5126 ms, sort 246 ms, write 12554 ms, index 634 ms: 10 candidates, 97827 repo-hours, 992 releases; waiting 499 ms; commit 2627 ms)
2026-11-08T03:35:22Z [load_day 2023-12-06] 2023-12-06 hour 14: 291527 events in 6 files, snapshot 3248180448476162591 (task 20066 ms: download 13904 ms overlapping gunzip 1141 ms, parse 5194 ms, sort 223 ms, write 12152 ms, index 595 ms: 9 candidates, 93153 repo-hours, 1064 releases; waiting 496 ms; commit 2220 ms)
2026-11-08T03:35:31Z [load_day 2023-12-06] 2023-12-06 hour 15: 306364 events in 7 files, snapshot 295258520343428825 (task 19783 ms: download 13118 ms overlapping gunzip 1168 ms, parse 5283 ms, sort 244 ms, write 11698 ms, index 600 ms: 8 candidates, 87798 repo-hours, 1138 releases; waiting 522 ms; commit 2254 ms)
2026-11-08T03:35:42Z [load_day 2023-12-06] 2023-12-06 hour 16: 305876 events in 7 files, snapshot 5812034728842766848 (task 18073 ms: download 11992 ms overlapping gunzip 1093 ms, parse 5025 ms, sort 255 ms, write 10356 ms, index 561 ms: 12 candidates, 81507 repo-hours, 965 releases; waiting 490 ms; commit 2459 ms)
2026-11-08T03:35:49Z [load_day 2023-12-06] 2023-12-06 hour 17: 302707 events in 7 files, snapshot 8774688193207034337 (task 17768 ms: download 11731 ms overlapping gunzip 1044 ms, parse 4789 ms, sort 253 ms, write 10328 ms, index 525 ms: 9 candidates, 78876 repo-hours, 816 releases; waiting 496 ms; commit 2350 ms)
2026-11-08T03:36:00Z [load_day 2023-12-06] 2023-12-06 hour 18: 298011 events in 6 files, snapshot 6459649754275092972 (task 17057 ms: download 11337 ms overlapping gunzip 1036 ms, parse 4741 ms, sort 232 ms, write 9731 ms, index 542 ms: 15 candidates, 79942 repo-hours, 919 releases; waiting 505 ms; commit 2496 ms)
2026-11-08T03:36:07Z [load_day 2023-12-06] 2023-12-06 hour 19: 294098 events in 6 files, snapshot 797621037243897590 (task 16636 ms: download 11097 ms overlapping gunzip 1010 ms, parse 4586 ms, sort 230 ms, write 9554 ms, index 497 ms: 21 candidates, 71136 repo-hours, 825 releases; waiting 500 ms; commit 2288 ms)
2026-11-08T03:36:18Z [load_day 2023-12-06] 2023-12-06 hour 20: 297603 events in 6 files, snapshot 705544379684507251 (task 16544 ms: download 11244 ms overlapping gunzip 1032 ms, parse 4613 ms, sort 252 ms, write 9298 ms, index 516 ms: 9 candidates, 68991 repo-hours, 789 releases; waiting 520 ms; commit 2706 ms)
2026-11-08T03:36:24Z [load_day 2023-12-06] 2023-12-06 hour 21: 292878 events in 6 files, snapshot 8637158360420437530 (task 15632 ms: download 10381 ms overlapping gunzip 956 ms, parse 4393 ms, sort 225 ms, write 8772 ms, index 454 ms: 8 candidates, 63202 repo-hours, 763 releases; waiting 526 ms; commit 2408 ms)
2026-11-08T03:36:33Z [load_day 2023-12-06] 2023-12-06 hour 22: 294192 events in 6 files, snapshot 1013938280378834504 (task 14618 ms: download 8229 ms overlapping gunzip 893 ms, parse 4127 ms, sort 232 ms, write 8096 ms, index 388 ms: 10 candidates, 57317 repo-hours, 747 releases; waiting 557 ms; commit 2453 ms)
2026-11-08T03:36:38Z [load_day 2023-12-06] 2023-12-06 hour 23: 299888 events in 6 files, snapshot 5881305292571112014 (task 13657 ms: download 7784 ms overlapping gunzip 836 ms, parse 3947 ms, sort 223 ms, write 7425 ms, index 350 ms: 5 candidates, 53358 repo-hours, 623 releases; waiting 566 ms; commit 2286 ms)
2026-11-08T03:36:46Z [load_day 2023-12-06] 2023-12-06: repo_hour merged from 24 files to 1 (1828468 rows, 8174 ms)
2026-11-08T03:36:48Z [load_day 2023-12-06] 2023-12-06: index committed in 10126 ms (24 + 1 + 24 files)
2026-11-08T03:36:48Z [load_day 2023-12-06] 2023-12-06: 6562875 events in 24 hours
2026-11-08T03:36:48Z [load_day 2023-12-06] attempt 1 succeeded