Failed to run chef-server-ctl reconfigure

BackGround
We are trying to configure chef ha application in our Azure environment following the documentation provided by chef High Availability: Chef Backend. The frontend and backend are in the same subnet and we have enabled communcations between the machines by opening up the nsg rules. We copied over the chef-server.rb file from the backend to the front end.

Issue
While trying to create the frontend leader running chef-server-ctl reconfigure on Ubuntu server version 20.04 as well as 18.04. We received the following errors:

Error
Running handlers:
Running handlers complete
Chef Client failed. 22 resources updated in 37 seconds
[2022-06-03T22:14:10+00:00] FATAL: Stacktrace dumped to /var/opt/opscode/local-mode-cache/chef-stacktrace.out
[2022-06-03T22:14:10+00:00] FATAL: Please provide the contents of the stacktrace.out file if you file a bug report
[2022-06-03T22:14:10+00:00] FATAL: EOFError: elasticsearch_index[chef] (private-chef::opscode-solr4-external line 23) had an error: EOFError: end of file reached