Backend issue on chef

Hi all,

Can any one help me on the chef backend, i had setup chef backend server and i am able to join the node.

chefleader node.


chef-serverctl status

Service Local Status Time in State Distributed Node Status
leaderl running (pid 2353) 0d 0h 17m 20s Error: no cluster configured
epmd running (pid 2182) 0d 0h 17m 47s Error: no cluster configured
etcd running (pid 1992) 0d 0h 18m 0s Error: no cluster configured
postgresql running (pid 2415) 0d 0h 17m 12s Error: no cluster configured
elasticsearch running (pid 2272) 0d 0h 17m 41s Error: no cluster configured

System Local Status Distributed Node Status
disks /var/log/chef-backend: OK; /var/opt/chef-backend: OK health: green; healthy nodes: 1/1

Chef Follower


I ran the below command at the follower node and i got the below error.

root@chefpf ]# chef-backendctl join-cluster 192.168.56.12 -p 192.168.56.11 -s /root/chef-backend-secrets.json -accept-license --yes

Generating configuration
Getting peer date from cluster —> it fails here
Joining node to cluster
Waiting for the node to come online

An errorr occured during this operation:

Failed to open TCP connection to 192.168.56.12:2379 ( No route to the host connect(2) for “192.168.56.12” port 2379)

The stack trace can be found in “/tmp/chef-backend-join-cluster-stacktrace.log”
[root@chefpf ]#

I am able to ping between the nodes and ssh between them.

[root@chefpl]# ifconfig enp0s3
enp0s3: flags=4163<UP,BROADCAST,RUNNING,MULTICAST> mtu 1500
inet 192.168.56.12 netmask 255.255.255.0 broadcast 192.168.56.255
inet6 fe80::8f37:466c:220e:c5e9 prefixlen 64 scopeid 0x20
ether 08:00:27:78:30:99 txqueuelen 1000 (Ethernet)
RX packets 40 bytes 5566 (5.4 KiB)
RX errors 0 dropped 0 overruns 0 frame 0
TX packets 51 bytes 16813 (16.4 KiB)
TX errors 0 dropped 0 overruns 0 carrier 0 collisions 0

tcp 0 0 127.0.0.1:32991 127.0.0.1:2379 ESTABLISHED
tcp 0 0 127.0.0.1:34053 127.0.0.1:2379 ESTABLISHED
tcp 0 0 127.0.0.1:34272 127.0.0.1:2379 ESTABLISHED
tcp6 0 0 :::2379 :::* LISTEN
tcp6 0 0 127.0.0.1:2379 127.0.0.1:34053 ESTABLISHED
tcp6 0 0 127.0.0.1:2379 127.0.0.1:34272 ESTABLISHED
tcp6 0 0 127.0.0.1:2379 127.0.0.1:32991 ESTABLISHED

The error from the error logs below on follower node @ tthe location “/tmp/chef-backend-join-cluster-stacktrace.log”

Exception of type Errno::EHOSTUNREACH occurred at 2018-07-25 23:07:32 +0100

/opt/chef-backend/embedded/lib/ruby/2.3.0/net/http.rb:882:in rescue in block in connect' /opt/chef-backend/embedded/lib/ruby/2.3.0/net/http.rb:879:inblock in connect’
/opt/chef-backend/embedded/lib/ruby/2.3.0/timeout.rb:91:in block in timeout' /opt/chef-backend/embedded/lib/ruby/2.3.0/timeout.rb:101:intimeout’
/opt/chef-backend/embedded/lib/ruby/2.3.0/net/http.rb:878:in connect' /opt/chef-backend/embedded/lib/ruby/2.3.0/net/http.rb:863:indo_start’
/opt/chef-backend/embedded/lib/ruby/2.3.0/net/http.rb:852:in start' /opt/chef-backend/embedded/lib/ruby/2.3.0/net/http.rb:1384:inrequest’
/opt/chef-backend/embedded/lib/ruby/gems/2.3.0/gems/etcd-0.3.0/lib/etcd/client.rb:111:in api_execute' /opt/chef-backend/embedded/lib/ruby/gems/2.3.0/gems/libcb-0.1.0/lib/libcb/connectors/etcd_connector.rb:364:inblock (2 levels) in request’
/opt/chef-backend/embedded/lib/ruby/2.3.0/timeout.rb:91:in block in timeout' /opt/chef-backend/embedded/lib/ruby/2.3.0/timeout.rb:33:inblock in catch’
/opt/chef-backend/embedded/lib/ruby/2.3.0/timeout.rb:33:in catch' /opt/chef-backend/embedded/lib/ruby/2.3.0/timeout.rb:33:incatch’
/opt/chef-backend/embedded/lib/ruby/2.3.0/timeout.rb:106:in timeout' /opt/chef-backend/embedded/lib/ruby/gems/2.3.0/gems/libcb-0.1.0/lib/libcb/connectors/etcd_connector.rb:363:inblock in request’
/opt/chef-backend/embedded/lib/ruby/gems/2.3.0/gems/libcb-0.1.0/lib/libcb/connectors/etcd_connector.rb:284:in block in with_connection' /opt/chef-backend/embedded/lib/ruby/2.3.0/timeout.rb:74:intimeout’
/opt/chef-backend/embedded/lib/ruby/gems/2.3.0/gems/libcb-0.1.0/lib/libcb/connectors/etcd_connector.rb:282:in with_connection' /opt/chef-backend/embedded/lib/ruby/gems/2.3.0/gems/libcb-0.1.0/lib/libcb/connectors/etcd_connector.rb:357:inrequest’
/opt/chef-backend/embedded/lib/ruby/gems/2.3.0/gems/libcb-0.1.0/lib/libcb/connectors/etcd_connector.rb:329:in get' /opt/chef-backend/embedded/lib/ruby/gems/2.3.0/gems/libcb-0.1.0/lib/libcb/connectors/etcd_connector.rb:219:inmembers_raw’
/opt/chef-backend/embedded/lib/ruby/gems/2.3.0/gems/libcb-0.1.0/lib/libcb/connectors/etcd_connector.rb:170:in member_client_hosts' /opt/chef-backend/embedded/lib/ruby/gems/2.3.0/gems/libcb-0.1.0/lib/libcb/command/join-cluster.rb:120:inblock in run’
/opt/chef-backend/embedded/lib/ruby/gems/2.3.0/gems/libcb-0.1.0/lib/libcb/task_list_renderer.rb:55:in block (2 levels) in run_tasks' /opt/chef-backend/embedded/lib/ruby/gems/2.3.0/gems/libcb-0.1.0/lib/libcb/task_list_renderer.rb:124:indo_task’
/opt/chef-backend/embedded/lib/ruby/gems/2.3.0/gems/libcb-0.1.0/lib/libcb/task_list_renderer.rb:54:in block in run_tasks' /opt/chef-backend/embedded/lib/ruby/gems/2.3.0/gems/libcb-0.1.0/lib/libcb/task_list_renderer.rb:53:inupto’
/opt/chef-backend/embedded/lib/ruby/gems/2.3.0/gems/libcb-0.1.0/lib/libcb/task_list_renderer.rb:53:in each' /opt/chef-backend/embedded/lib/ruby/gems/2.3.0/gems/libcb-0.1.0/lib/libcb/task_list_renderer.rb:53:inrun_tasks’
/opt/chef-backend/embedded/lib/ruby/gems/2.3.0/gems/libcb-0.1.0/lib/libcb/command/join-cluster.rb:136:in run' /opt/chef-backend/embedded/lib/ruby/gems/2.3.0/gems/libcb-0.1.0/lib/libcb/ctl.rb:354:inrun_with_pretty_errors’
/opt/chef-backend/embedded/lib/ruby/gems/2.3.0/gems/libcb-0.1.0/lib/libcb/ctl.rb:335:in run_subcommand' /opt/chef-backend/embedded/lib/ruby/gems/2.3.0/gems/libcb-0.1.0/lib/libcb/ctl.rb:268:inrun’
/opt/chef-backend/embedded/lib/ruby/gems/2.3.0/gems/libcb-0.1.0/bin/chef-backend-ctl:15:in <top (required)>' /bin/chef-backend-ctl:30:inload’
/bin/chef-backend-ctl:30:in `’


can any one able to figure out or help me as what could be the cause of this problem. i cant see any block at firewall port as all are opened.

Thanks

Raj.