Datum a čas: 2022-10-25 01:05 CEST Očekavaná délka: 40 minut Oznámení se týká serverů: node24.prg Typ odstávky: vps_restart Důvod: Upgrade na Linux 5.10.149 + aktualizovane ZFS Odstávku řeší: Pavel Šnajdr, Jakub Skokan
ENGLISH: Date and time: 2022-10-25 01:05 CEST Expected duration: 40 minutes Affected systems: node24.prg Maintenance type: vps_restart Reason: Upgrade to Linux 5.10.149 + updated ZFS Handled by: Pavel Šnajdr, Jakub Skokan
-----BEGIN BASE64 ENCODED PARSEABLE JSON----- eyJpZCI6OTYxLCJwbGFubmVkIjp0cnVlLCJiZWdpbnNfYXQiOiIyMDIyLTEw LTI1VDAxOjA1OjAwKzAyOjAwIiwiZHVyYXRpb24iOjQwLCJ0eXBlIjoidnBz X3Jlc3RhcnQiLCJlbnRpdGllcyI6W3sibmFtZSI6Ik5vZGUiLCJpZCI6MTI1 LCJsYWJlbCI6Im5vZGUyNC5wcmcifV0sImhhbmRsZXJzIjpbIlBhdmVsIMWg bmFqZHIiLCJKYWt1YiBTa29rYW4iXSwidHJhbnNsYXRpb25zIjp7ImVuIjp7 InN1bW1hcnkiOiJVcGdyYWRlIHRvIExpbnV4IDUuMTAuMTQ5ICsgdXBkYXRl ZCBaRlMiLCJkZXNjcmlwdGlvbiI6bnVsbH0sImNzIjp7InN1bW1hcnkiOiJV cGdyYWRlIG5hIExpbnV4IDUuMTAuMTQ5ICsgYWt0dWFsaXpvdmFuZSBaRlMi LCJkZXNjcmlwdGlvbiI6bnVsbH19fQ== -----END BASE64 ENCODED PARSEABLE JSON-----
Očekávaná délka: 40 -> 200 minut
Popis: ZFS bug
ktery se nepovedlo zreplikovat na stagingu, nadmerne pametove alokace pri mountu, shodi masinu
Nahlásil: Pavel Šnajdr
ENGLISH: Duration: 40 -> 200 minutes
Summary: Hit ZFS bug
does not replicate @ staging, large memory allocs on dataset mount, shoots the machine down
Reported by: Pavel Šnajdr
-----BEGIN BASE64 ENCODED PARSEABLE JSON----- eyJpZCI6MjU0NiwiY2hhbmdlcyI6eyJkdXJhdGlvbiI6eyJmcm9tIjo0MCwi dG8iOjIwMH19LCJ0cmFuc2xhdGlvbnMiOnsiZW4iOnsic3VtbWFyeSI6Ikhp dCBaRlMgYnVnIiwiZGVzY3JpcHRpb24iOiJkb2VzIG5vdCByZXBsaWNhdGUg QCBzdGFnaW5nLCBsYXJnZSBtZW1vcnkgYWxsb2NzIG9uIGRhdGFzZXQgbW91 bnQsIHNob290cyB0aGUgbWFjaGluZSBkb3duIn0sImNzIjp7InN1bW1hcnki OiJaRlMgYnVnIiwiZGVzY3JpcHRpb24iOiJrdGVyeSBzZSBuZXBvdmVkbG8g enJlcGxpa292YXQgbmEgc3RhZ2luZ3UsIG5hZG1lcm5lIHBhbWV0b3ZlIGFs b2thY2UgcHJpIG1vdW50dSwgc2hvZGkgbWFzaW51In19fQ== -----END BASE64 ENCODED PARSEABLE JSON-----
Očekávaná délka: 200 -> 175 minut
Popis: Uz bezime
Problem byl zpusobeny interakci CONFIG_LOCK_STAT a ZFS, neprojevil se na stagingu bohuzel; chvili trvalo, nez jsme na to prisli
Nahlásil: Pavel Šnajdr
ENGLISH: Duration: 200 -> 175 minutes
Summary: Up & running
The problem was in interaction of CONFIG_LOCK_STAT & ZFS, which hasn't manifested in staging, sadly; took a bit to figure it out
Reported by: Pavel Šnajdr
-----BEGIN BASE64 ENCODED PARSEABLE JSON----- eyJpZCI6MjU0NywiY2hhbmdlcyI6eyJkdXJhdGlvbiI6eyJmcm9tIjoyMDAs InRvIjoxNzV9fSwidHJhbnNsYXRpb25zIjp7ImVuIjp7InN1bW1hcnkiOiJV cCBcdTAwMjYgcnVubmluZyIsImRlc2NyaXB0aW9uIjoiVGhlIHByb2JsZW0g d2FzIGluIGludGVyYWN0aW9uIG9mIENPTkZJR19MT0NLX1NUQVQgXHUwMDI2 IFpGUywgd2hpY2ggaGFzbid0IG1hbmlmZXN0ZWQgaW4gc3RhZ2luZywgc2Fk bHk7IHRvb2sgYSBiaXQgdG8gZmlndXJlIGl0IG91dCJ9LCJjcyI6eyJzdW1t YXJ5IjoiVXogYmV6aW1lIiwiZGVzY3JpcHRpb24iOiJQcm9ibGVtIGJ5bCB6 cHVzb2JlbnkgaW50ZXJha2NpIENPTkZJR19MT0NLX1NUQVQgYSBaRlMsIG5l cHJvamV2aWwgc2UgbmEgc3RhZ2luZ3UgYm9odXplbDsgY2h2aWxpIHRydmFs bywgbmV6IGpzbWUgbmEgdG8gcHJpc2xpIn19fQ== -----END BASE64 ENCODED PARSEABLE JSON-----