Timeout while handling message
Below is my configuration:
mCollective client 2.5.2, erlang-R16B03-0.2, rabbitmq server 3.3.4 installed on RHEL 6.4
mCollective server 2.5.2 (with stomp rubygem 1.3.2 and ruby 1.8.7) installed on RHEL 5.10 (on multiple hosts which are in a different data center than the host running MC client)
mco ping shows all mCollective servers in the results for a while. But If I run any agents (plugins) across the fleet, some hosts stop responding to the mco ping any longer. I see the message below in mCollective server.log only on the hosts which are missing. Other hosts dont have this message.
W, [2015-10-15T20:56:39.968701 #29827] WARN -- : agents.rb:136:in `dispatch' Timeout while handling message for <agent name>
I tried increasing the timeout values in the below files and restarted mCollective, but it didnt help.
Also added the plugin.discovery.timeout parameter to server.cfg and client.cfg, but to no avail.
Can anyone please suggest a solution? Thank you