__all__ SAL

<!DOCTYPE html> <html lang="en"> <head> <meta http-equiv="Content-language" content="en"> <meta charset="utf-8"> <meta http-equiv="X-UA-Compatible" content="IE=edge"> <meta name="viewport" content="width=device-width, initial-scale=1"> <link rel="shortcut icon" type="image/x-icon" href="https://sal.toolforge.org/favicon.ico"> <link rel="icon" type="image/x-icon" href="https://sal.toolforge.org/favicon.ico"> <link rel="stylesheet" type="text/css" href="https://sal.toolforge.org/assets/main.css"> <link href="/atom/__all__" type="application/atom+xml" rel="alternate" title="Atom feed" /> <title>__all__ SAL - SAL</title> </head> <body> <header class="header"> <nav class="navbar"> <a class="navbar-brand" href="/about"><img id="logo" src="https://sal.toolforge.org/assets/logo.png">SAL</a> <ul class="nav"> <li><a href="/production">Prod</a></li> <li><a href="/releng">RelEng</a></li> <li><a href="/__all__">Firehose</a></li> <li><a href="/projects">Other</a></li> </ul> </nav> </header> <div class="container"> <form id="search-form" method="get" action="/__all__"> <input type="hidden" name="p" value="0"> <div> <label class="sr-only" for="q">Search</label> <input type="text" id="q" name="q" placeholder="search SAL" value=""> </div> <div> <label class="sr-only" for="d">On or before date</label> <input type="date" id="d" name="d" placeholder="YYYY-MM-DD" value=""> </div> <div> <button type="submit">go</button> </div> </form> <div class="hits">1-50 of 10000 results (25ms)</div> <div class="pagination"><ul><li class="disabled"><span>«</span></li><li class="active"><a href="/__all__?p=0" id="prev">1</a></li><li class=""><a href="/__all__?p=1" id="prev">2</a></li><li class=""><a href="/__all__?p=2" id="prev">3</a></li><li class=""><a href="/__all__?p=3" id="prev">4</a></li><li class=""><a href="/__all__?p=4" id="prev">5</a></li><li class="disabled"><span>…</span></li><li><a href="/__all__?p=1" >»</a></li></ul></div><table class="sal"> <tbody> <tr> <th colspan="4"> <a class="day" href="/__all__?d=2025-03-02"> 2025-03-02 </a> <span class="section">搂</span> </th> </tr> <tr> <td class="time"><a href="/log/lx7mWJUB8tZ8Ohr0YWNv">22:07</a></td> <td class="nick"><marostegui@cumin1002></td> <td class="message">dbctl commit (dc=all): 'db1248 (re)pooling @ 100%: Repooling after rebuild index', diff saved to <a href="https://phabricator.wikimedia.org/P73921" target="_blank">https://phabricator.wikimedia.org/P73921</a> and previous config saved to /var/cache/conftool/dbconfig/20250302-220727-root.json</td> <td class="project">[production]</td> </tr> <tr> <td class="time"><a href="/log/Cx7YWJUB8tZ8Ohr0j1sg">21:52</a></td> <td class="nick"><marostegui@cumin1002></td> <td class="message">dbctl commit (dc=all): 'db1248 (re)pooling @ 75%: Repooling after rebuild index', diff saved to <a href="https://phabricator.wikimedia.org/P73920" target="_blank">https://phabricator.wikimedia.org/P73920</a> and previous config saved to /var/cache/conftool/dbconfig/20250302-215221-root.json</td> <td class="project">[production]</td> </tr> <tr> <td class="time"><a href="/log/5HTKWJUBffdvpiTrvce3">21:37</a></td> <td class="nick"><marostegui@cumin1002></td> <td class="message">dbctl commit (dc=all): 'db1248 (re)pooling @ 50%: Repooling after rebuild index', diff saved to <a href="https://phabricator.wikimedia.org/P73919" target="_blank">https://phabricator.wikimedia.org/P73919</a> and previous config saved to /var/cache/conftool/dbconfig/20250302-213716-root.json</td> <td class="project">[production]</td> </tr> <tr> <td class="time"><a href="/log/mXS8WJUBffdvpiTr7rrC">21:22</a></td> <td class="nick"><marostegui@cumin1002></td> <td class="message">dbctl commit (dc=all): 'db1248 (re)pooling @ 25%: Repooling after rebuild index', diff saved to <a href="https://phabricator.wikimedia.org/P73918" target="_blank">https://phabricator.wikimedia.org/P73918</a> and previous config saved to /var/cache/conftool/dbconfig/20250302-212211-root.json</td> <td class="project">[production]</td> </tr> <tr> <td class="time"><a href="/log/NPCvWJUBvg159pQrHGPz">21:07</a></td> <td class="nick"><marostegui@cumin1002></td> <td class="message">dbctl commit (dc=all): 'db1248 (re)pooling @ 10%: Repooling after rebuild index', diff saved to <a href="https://phabricator.wikimedia.org/P73917" target="_blank">https://phabricator.wikimedia.org/P73917</a> and previous config saved to /var/cache/conftool/dbconfig/20250302-210705-root.json</td> <td class="project">[production]</td> </tr> <tr> <td class="time"><a href="/log/_3SiWJUBffdvpiTrCKYQ">20:52</a></td> <td class="nick"><mvernon@cumin1002></td> <td class="message">DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2 days, 0:00:00 on db1246.eqiad.wmnet with reason: crashed</td> <td class="project">[production]</td> </tr> <tr> <td class="time"><a href="/log/CR6gWJUB8tZ8Ohr0vDNz">20:51</a></td> <td class="nick"><mvernon@cumin1002></td> <td class="message">dbctl commit (dc=all): 'Depool db1246', diff saved to <a href="https://phabricator.wikimedia.org/P73916" target="_blank">https://phabricator.wikimedia.org/P73916</a> and previous config saved to /var/cache/conftool/dbconfig/20250302-205123-mvernon.json</td> <td class="project">[production]</td> </tr> <tr> <td class="time"><a href="/log/Mx0vWJUB8tZ8Ohr0aNKI">18:47</a></td> <td class="nick"><wmbot~anticomposite@tools-bastion-13></td> <td class="message">stewardbots/StewardBot/manage.sh restart # no ES connection</td> <td class="project">[tools.stewardbots]</td> </tr> <tr> <td class="time"><a href="/log/Zh2sV5UB8tZ8Ohr0RJJO">16:24</a></td> <td class="nick"><marostegui@cumin1002></td> <td class="message">dbctl commit (dc=all): 'db2163 (re)pooling @ 100%: Repooling after rebuild index', diff saved to <a href="https://phabricator.wikimedia.org/P73915" target="_blank">https://phabricator.wikimedia.org/P73915</a> and previous config saved to /var/cache/conftool/dbconfig/20250302-162421-root.json</td> <td class="project">[production]</td> </tr> <tr> <td class="time"><a href="/log/wnOeV5UBffdvpiTrcfrF">16:09</a></td> <td class="nick"><marostegui@cumin1002></td> <td class="message">dbctl commit (dc=all): 'db2163 (re)pooling @ 75%: Repooling after rebuild index', diff saved to <a href="https://phabricator.wikimedia.org/P73914" target="_blank">https://phabricator.wikimedia.org/P73914</a> and previous config saved to /var/cache/conftool/dbconfig/20250302-160915-root.json</td> <td class="project">[production]</td> </tr> <tr> <td class="time"><a href="/log/3e-QV5UBvg159pQroJ1I">15:54</a></td> <td class="nick"><marostegui@cumin1002></td> <td class="message">dbctl commit (dc=all): 'db2163 (re)pooling @ 50%: Repooling after rebuild index', diff saved to <a href="https://phabricator.wikimedia.org/P73913" target="_blank">https://phabricator.wikimedia.org/P73913</a> and previous config saved to /var/cache/conftool/dbconfig/20250302-155410-root.json</td> <td class="project">[production]</td> </tr> <tr> <td class="time"><a href="/log/yB2CV5UB8tZ8Ohr0zoMT">15:39</a></td> <td class="nick"><marostegui@cumin1002></td> <td class="message">dbctl commit (dc=all): 'db2163 (re)pooling @ 25%: Repooling after rebuild index', diff saved to <a href="https://phabricator.wikimedia.org/P73912" target="_blank">https://phabricator.wikimedia.org/P73912</a> and previous config saved to /var/cache/conftool/dbconfig/20250302-153904-root.json</td> <td class="project">[production]</td> </tr> <tr> <td class="time"><a href="/log/F-90V5UBvg159pQr_ZSO">15:23</a></td> <td class="nick"><marostegui@cumin1002></td> <td class="message">dbctl commit (dc=all): 'db2163 (re)pooling @ 10%: Repooling after rebuild index', diff saved to <a href="https://phabricator.wikimedia.org/P73911" target="_blank">https://phabricator.wikimedia.org/P73911</a> and previous config saved to /var/cache/conftool/dbconfig/20250302-152359-root.json</td> <td class="project">[production]</td> </tr> <tr> <td class="time"><a href="/log/IO9cVpUBvg159pQrViDu">10:17</a></td> <td class="nick"><root@cumin1002></td> <td class="message">DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 12:00:00 on db1248.eqiad.wmnet with reason: Index rebuild</td> <td class="project">[production]</td> </tr> <tr> <td class="time"><a href="/log/SnNbVpUBffdvpiTr8H1p">10:17</a></td> <td class="nick"><marostegui@cumin1002></td> <td class="message">END (PASS) - Cookbook sre.mysql.upgrade (exit_code=0) for db1248.eqiad.wmnet</td> <td class="project">[production]</td> </tr> <tr> <td class="time"><a href="/log/hB1XVpUB8tZ8Ohr0GBNs">10:11</a></td> <td class="nick"><marostegui@cumin1002></td> <td class="message">START - Cookbook sre.mysql.upgrade for db1248.eqiad.wmnet</td> <td class="project">[production]</td> </tr> <tr> <td class="time"><a href="/log/ex1WVpUB8tZ8Ohr07RMY">10:11</a></td> <td class="nick"><root@cumin1002></td> <td class="message">DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 12:00:00 on db2163.codfw.wmnet with reason: Index rebuild</td> <td class="project">[production]</td> </tr> <tr> <td class="time"><a href="/log/ax1UVpUB8tZ8Ohr0kxEx">10:08</a></td> <td class="nick"><marostegui@cumin1002></td> <td class="message">END (PASS) - Cookbook sre.mysql.upgrade (exit_code=0) for db2163.codfw.wmnet</td> <td class="project">[production]</td> </tr> <tr> <td class="time"><a href="/log/3XNQVpUBffdvpiTr0XUK">10:04</a></td> <td class="nick"><marostegui@cumin1002></td> <td class="message">DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 12:00:00 on db2163.codfw.wmnet with reason: Setup</td> <td class="project">[production]</td> </tr> <tr> <td class="time"><a href="/log/re9PVpUBvg159pQrfhZ1">10:03</a></td> <td class="nick"><marostegui@cumin1002></td> <td class="message">dbctl commit (dc=all): 'Depool db2167', diff saved to <a href="https://phabricator.wikimedia.org/P73910" target="_blank">https://phabricator.wikimedia.org/P73910</a> and previous config saved to /var/cache/conftool/dbconfig/20250302-100324-marostegui.json</td> <td class="project">[production]</td> </tr> <tr> <td class="time"><a href="/log/GnNMVpUBffdvpiTrmXUR">10:00</a></td> <td class="nick"><marostegui@cumin1002></td> <td class="message">START - Cookbook sre.mysql.upgrade for db2163.codfw.wmnet</td> <td class="project">[production]</td> </tr> <tr> <td class="time"><a href="/log/KR1LVpUB8tZ8Ohr0JA6T">09:58</a></td> <td class="nick"><marostegui@cumin1002></td> <td class="message">dbctl commit (dc=all): 'Depool db2163', diff saved to <a href="https://phabricator.wikimedia.org/P73909" target="_blank">https://phabricator.wikimedia.org/P73909</a> and previous config saved to /var/cache/conftool/dbconfig/20250302-095839-root.json</td> <td class="project">[production]</td> </tr> <tr> <td class="time"><a href="/log/JRx1VZUB8tZ8Ohr0BNDP">06:04</a></td> <td class="nick"><_joe_></td> <td class="message">started replication on db2167</td> <td class="project">[production]</td> </tr> <tr> <td class="time"><a href="/log/nu5iVZUBvg159pQrtMmX">05:44</a></td> <td class="nick"><tchin@deploy2002></td> <td class="message">helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/mw-content-history-reconcile-enrich: apply</td> <td class="project">[production]</td> </tr> <tr> <td class="time"><a href="/log/m-5iVZUBvg159pQrnclt">05:44</a></td> <td class="nick"><tchin@deploy2002></td> <td class="message">helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/mw-content-history-reconcile-enrich: apply</td> <td class="project">[production]</td> </tr> <tr> <td class="time"><a href="/log/4u5EVJUBvg159pQrsowK">00:32</a></td> <td class="nick"><reedy@deploy2002></td> <td class="message">Finished scap sync-world: Backport for [[<a href="https://gerrit.wikimedia.org/r/#/c/1123772" target="_blank">gerrit:1123772</a>|UserGroupsHookHandler: Return early if performer is false (<a href="https://phabricator.wikimedia.org/T387523" target="_blank">T387523</a>)]] (duration: 10m 33s)</td> <td class="project">[production]</td> </tr> <tr> <td class="time"><a href="/log/fBw-VJUB8tZ8Ohr0wZFY">00:25</a></td> <td class="nick"><reedy@deploy2002></td> <td class="message">reedy, dreamyjazz: Continuing with sync</td> <td class="project">[production]</td> </tr> <tr> <td class="time"><a href="/log/exw-VJUB8tZ8Ohr0rJGu">00:25</a></td> <td class="nick"><reedy@deploy2002></td> <td class="message">reedy, dreamyjazz: Backport for [[<a href="https://gerrit.wikimedia.org/r/#/c/1123772" target="_blank">gerrit:1123772</a>|UserGroupsHookHandler: Return early if performer is false (<a href="https://phabricator.wikimedia.org/T387523" target="_blank">T387523</a>)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug)</td> <td class="project">[production]</td> </tr> <tr> <td class="time"><a href="/log/8xw7VJUB8tZ8Ohr0B48Y">00:21</a></td> <td class="nick"><reedy@deploy2002></td> <td class="message">Started scap sync-world: Backport for [[<a href="https://gerrit.wikimedia.org/r/#/c/1123772" target="_blank">gerrit:1123772</a>|UserGroupsHookHandler: Return early if performer is false (<a href="https://phabricator.wikimedia.org/T387523" target="_blank">T387523</a>)]]</td> <td class="project">[production]</td> </tr> <tbody> <tr> <th colspan="4"> <a class="day" href="/__all__?d=2025-03-01"> 2025-03-01 </a> <span class="section">搂</span> </th> </tr> <tr> <td class="time"><a href="/log/c-4mVJUBvg159pQrXoDL">23:59</a></td> <td class="nick"><tchin@deploy2002></td> <td class="message">helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/mw-content-history-reconcile-enrich: apply</td> <td class="project">[production]</td> </tr> <tr> <td class="time"><a href="/log/aO4mVJUBvg159pQrSoBi">23:59</a></td> <td class="nick"><tchin@deploy2002></td> <td class="message">helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/mw-content-history-reconcile-enrich: apply</td> <td class="project">[production]</td> </tr> <tr> <td class="time"><a href="/log/txs1U5UB8tZ8Ohr0Av4J">19:35</a></td> <td class="nick"><andrewbogott></td> <td class="message">installed new bookworm base images in eqiad1</td> <td class="project">[admin]</td> </tr> <tr> <td class="time"><a href="/log/qRs0U5UB8tZ8Ohr0y_4R">19:35</a></td> <td class="nick"><andrewbogott></td> <td class="message">installed new bookworm and bullseye base images in codfw1dev</td> <td class="project">[admin]</td> </tr> <tr> <td class="time"><a href="/log/cu0bU5UBvg159pQrzeh1">19:08</a></td> <td class="nick"><andrew@cloudcumin1001></td> <td class="message">END (PASS) - Cookbook wmcs.toolforge.k8s.reboot (exit_code=0) for tools-k8s-worker-nfs-38</td> <td class="project">[tools]</td> </tr> <tr> <td class="time"><a href="/log/mRsWU5UB8tZ8Ohr05fd7">19:02</a></td> <td class="nick"><andrew@cloudcumin1001></td> <td class="message">START - Cookbook wmcs.toolforge.k8s.reboot for tools-k8s-worker-nfs-38</td> <td class="project">[tools]</td> </tr> <tr> <td class="time"><a href="/log/Bu0AU5UBvg159pQrI-Dk">18:37</a></td> <td class="nick"><dcausse></td> <td class="message">disabling the saneitizer on the cirrus streaming updater for consumer-search@eqiad & consumer-cloudelastic (pre-emptive hotfix for <a href="https://phabricator.wikimedia.org/T387625" target="_blank">T387625</a>)</td> <td class="project">[production]</td> </tr> <tr> <td class="time"><a href="/log/7O3_UpUBvg159pQri98M">18:37</a></td> <td class="nick"><dcausse@deploy2002></td> <td class="message">helmfile [eqiad] DONE helmfile.d/services/cirrus-streaming-updater: apply</td> <td class="project">[production]</td> </tr> <tr> <td class="time"><a href="/log/6-3_UpUBvg159pQrZd_1">18:37</a></td> <td class="nick"><dcausse@deploy2002></td> <td class="message">helmfile [eqiad] START helmfile.d/services/cirrus-streaming-updater: apply</td> <td class="project">[production]</td> </tr> <tr> <td class="time"><a href="/log/qHL_UpUBffdvpiTrF0MC">18:36</a></td> <td class="nick"><dcausse@deploy2002></td> <td class="message">helmfile [eqiad] DONE helmfile.d/services/cirrus-streaming-updater: apply</td> <td class="project">[production]</td> </tr> <tr> <td class="time"><a href="/log/rBv-UpUB8tZ8Ohr0TvBE">18:35</a></td> <td class="nick"><dcausse@deploy2002></td> <td class="message">helmfile [eqiad] START helmfile.d/services/cirrus-streaming-updater: apply</td> <td class="project">[production]</td> </tr> <tr> <td class="time"><a href="/log/fHL5UpUBffdvpiTrrUL1">18:30</a></td> <td class="nick"><dcausse></td> <td class="message">disabling the saneitizer on the cirrus streaming updater in codfw (hotfix for <a href="https://phabricator.wikimedia.org/T387625" target="_blank">T387625</a>)</td> <td class="project">[production]</td> </tr> <tr> <td class="time"><a href="/log/d3L4UpUBffdvpiTrRkKV">18:29</a></td> <td class="nick"><dcausse@deploy2002></td> <td class="message">helmfile [codfw] DONE helmfile.d/services/cirrus-streaming-updater: apply</td> <td class="project">[production]</td> </tr> <tr> <td class="time"><a href="/log/dnL4UpUBffdvpiTrCkIB">18:29</a></td> <td class="nick"><dcausse@deploy2002></td> <td class="message">helmfile [codfw] START helmfile.d/services/cirrus-streaming-updater: apply</td> <td class="project">[production]</td> </tr> <tr> <td class="time"><a href="/log/mu3SUpUBvg159pQrH9mz">17:47</a></td> <td class="nick"><godog></td> <td class="message">bounce mtail on centrallog2002</td> <td class="project">[production]</td> </tr> <tr> <td class="time"><a href="/log/BXK7UpUBffdvpiTrjDfe">17:22</a></td> <td class="nick"><tchin@deploy2002></td> <td class="message">helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/mw-content-history-reconcile-enrich: apply</td> <td class="project">[production]</td> </tr> <tr> <td class="time"><a href="/log/Khu7UpUB8tZ8Ohr0eOWo">17:22</a></td> <td class="nick"><tchin@deploy2002></td> <td class="message">helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/mw-content-history-reconcile-enrich: apply</td> <td class="project">[production]</td> </tr> <tr> <td class="time"><a href="/log/8u2HUpUBvg159pQr9Mk9">16:26</a></td> <td class="nick"><andrew@cloudcumin1001></td> <td class="message">END (PASS) - Cookbook wmcs.toolforge.k8s.reboot (exit_code=0) for tools-k8s-worker-nfs-57</td> <td class="project">[tools]</td> </tr> <tr> <td class="time"><a href="/log/y-2DUpUBvg159pQrBslh">16:21</a></td> <td class="nick"><andrew@cloudcumin1001></td> <td class="message">START - Cookbook wmcs.toolforge.k8s.reboot for tools-k8s-worker-nfs-57</td> <td class="project">[tools]</td> </tr> <tr> <td class="time"><a href="/log/xXJnUpUBffdvpiTriimn">15:51</a></td> <td class="nick"><andrew@cloudcumin1001></td> <td class="message">END (PASS) - Cookbook wmcs.toolforge.k8s.reboot (exit_code=0) for tools-k8s-worker-nfs-57</td> <td class="project">[tools]</td> </tr> <tr> <td class="time"><a href="/log/WO1jUpUBvg159pQra8Ya">15:46</a></td> <td class="nick"><andrew@cloudcumin1001></td> <td class="message">START - Cookbook wmcs.toolforge.k8s.reboot for tools-k8s-worker-nfs-57</td> <td class="project">[tools]</td> </tr> </table> <div class="pagination"><ul><li class="disabled"><span>«</span></li><li class="active"><a href="/__all__?p=0" id="prev">1</a></li><li class=""><a href="/__all__?p=1" id="prev">2</a></li><li class=""><a href="/__all__?p=2" id="prev">3</a></li><li class=""><a href="/__all__?p=3" id="prev">4</a></li><li class=""><a href="/__all__?p=4" id="prev">5</a></li><li class="disabled"><span>…</span></li><li><a href="/__all__?p=1" >»</a></li></ul></div> </div> <footer class="footer"> <ul class="nav"> <li><a href="/about">about</a></li> </ul> </footer> </body> </html>

CINXE.COM

all SAL - SAL