kubernetes - Kubelet fails to update node status -

-

on latest rhel atomic host (kubernetes 1.2) regularly seeing following entries in kubelet logs:

kubelet.go:2761] error updating node status, retry: nodes "x.y.z" cannot updated: object has been modified; please apply changes latest version , try again

this causes node temporary go notready. during these notready periods, pods on node show ready, looks kubernetes stops routing traffic them, causing problem.

in go sources can see during heartbeat of kubelet fetch latest status, overwrites own status, , sends put apiserver.

this see in logs:

jul 15 12:42:45 lxa160j.srv.pl.ing.net kubelet[3736]: i0715 12:42:45.086322 3736 round_trippers.go:264] https://lxa160g.srv.pl.ing.net:6443/api/v1/nodes/lxa160j.srv.pl.ing.net jul 15 12:42:45 lxa160j.srv.pl.ing.net kubelet[3736]: i0715 12:42:45.091579 3736 round_trippers.go:289] response status: 200 ok in 5 milliseconds jul 15 12:42:45 lxa160j.srv.pl.ing.net kubelet[3736]: i0715 12:42:45.373091 3736 round_trippers.go:264] put https://lxa160g.srv.pl.ing.net:6443/api/v1/nodes/lxa160j.srv.pl.ing.net/status jul 15 12:42:45 lxa160j.srv.pl.ing.net kubelet[3736]: i0715 12:42:45.409752 3736 round_trippers.go:289] response status: 200 ok in 36 milliseconds jul 15 12:42:55 lxa160j.srv.pl.ing.net kubelet[3736]: i0715 12:42:55.411267 3736 round_trippers.go:264] https://lxa160g.srv.pl.ing.net:6443/api/v1/nodes/lxa160j.srv.pl.ing.net jul 15 12:42:55 lxa160j.srv.pl.ing.net kubelet[3736]: i0715 12:42:55.431056 3736 round_trippers.go:289] response status: 200 ok in 19 milliseconds jul 15 12:43:38 lxa160j.srv.pl.ing.net kubelet[3736]: i0715 12:43:38.020203 3736 round_trippers.go:264] put https://lxa160g.srv.pl.ing.net:6443/api/v1/nodes/lxa160j.srv.pl.ing.net/status jul 15 12:43:38 lxa160j.srv.pl.ing.net kubelet[3736]: i0715 12:43:38.029575 3736 round_trippers.go:289] response status: 409 conflict in 9 milliseconds jul 15 12:43:38 lxa160j.srv.pl.ing.net kubelet[3736]: i0715 12:43:38.029772 3736 round_trippers.go:264] https://lxa160g.srv.pl.ing.net:6443/api/v1/nodes/lxa160j.srv.pl.ing.net jul 15 12:43:38 lxa160j.srv.pl.ing.net kubelet[3736]: i0715 12:43:38.034980 3736 round_trippers.go:289] response status: 200 ok in 5 milliseconds jul 15 12:43:38 lxa160j.srv.pl.ing.net kubelet[3736]: i0715 12:43:38.298752 3736 round_trippers.go:264] put https://lxa160g.srv.pl.ing.net:6443/api/v1/nodes/lxa160j.srv.pl.ing.net/status jul 15 12:43:38 lxa160j.srv.pl.ing.net kubelet[3736]: i0715 12:43:38.320192 3736 round_trippers.go:289] response status: 200 ok in 21 milliseconds

so takes long time fire put after successful get. why?

thanks


Comments

Post a Comment

Popular posts from this blog

java - Static nested class instance -

-
this question has answer here: java inner class , static nested class 23 answers i came across in java, know static nested class why create instance of 'static'. isn't whole idea of 'static' use without instance? understand concept of inner classes, why (and frankly how possible to) create 'instance' of 'static' member @ ? why this: 1- outerclass.staticnestedclass nestedobject = new outerclass.staticnestedclass(); 2- nestedobject.anestedclassmethod(); and not this: 1- outerclass outerinstance=new outerclass(); 2- outerinstance.staticnestedclass.anestedclassmethod(); use on inner classes, keyword static indicates can access inner class without instance of outer class. for example: public class outer { public static class inner { /* code here. */ } } with construction, can create instance of inn
Read more

c# - Bluetooth LE CanUpdate Characteristic property -

-
i building xamarin.forms cross platform mobile app, uses monkey.robotics bluetoth low energy functionality. connecting mbed based implimentation of custom gatt service . in xamarin c#, triggers characteristic. canupdate property in monkey.robotics? this standard example c# based on: if (characteristic.canupdate) { characteristic.valueupdated += (s, e) => { debug.writeline("characteristic.valueupdated"); device.begininvokeonmainthread( () => { updatedisplay(characteristic); }); isbusy = false; // spin until first result received }; isbusy = true; characteristic.startupdates(); } this has been working, since changed own custom gatt service connecting to, canupdate property false. property , how triggered? me debugging gatt service code. thanks monkey.robotics open sour
Read more

JavaScript - Replace variable from string in all occurrences -

-
ok, know if have character '-' , want remove in places in string javascript, ... someword = someword.replace(/-/g, ''); but, when applying array of characters, s not working ... const badchars = ('\/:*?"<>|').split(''); let filename = title.replace(/ /g, '-').tolocalelowercase(); (let item = 0; item < badchars.length; item++) { // below not work global '/ /g' filename = filename.replace(/badchars[item]/g, ''); } any ideas? /badchars[item]/g looks badchars , literally, followed i , t , e , or m . if you're trying use character badchars[item] , you'll need use regexp constructor, , you'll need escape regex-specific characters. escaping regular expression has been well-covered . using that: filename = filename.replace(new regexp(regexp.quote(badchars[item]), 'g'), ''); but , don't want that. want character class: let filename = title.replac
Read more