# Node search does not return all hosts

**URL:** <https://discourse.chef.io/t/node-search-does-not-return-all-hosts/2113>\
**Category:** Chef Infra (archive)\
**Created:** [October 18, 2011, 2:22pm UTC](https://discourse.chef.io/t/node-search-does-not-return-all-hosts/2113 "2011-10-18T14:22:10Z")\
**Posts on this page:** 12\
**Page:** 1

<div class="post-metadata">

**Author:** ![Brian\_Smith](https://avatars.discourse-cdn.com/v4/letter/b/e9c0ed/32.png) [@Brian\_Smith](https://discourse.chef.io/u/Brian_Smith)\
**Post date:** [October 18, 2011, 2:22pm UTC](https://discourse.chef.io/t/node-search-does-not-return-all-hosts/2113/1 "2011-10-18T14:22:10Z")

</div>

Hello, I am having an issue I am trying to work out with chef. I have two  
nodes that will not return when doing a node search with hostname:[\* TO _]  
but if I use fqdn:[_ TO \*] they show up. Any suggestions on how to  
troubshoot and correct the issue. If I look at the node in chef hostname  
and fqdn are defined in chef and hostname and hostname -f resolve correctly  
on the 2 servers that don’t show up. There is a hosts entry on the servers  
also for hostname and hostname.domainname on the server too.

Thanks!

Brian Smith  
Senior Network Engineer . Bonnier Corporation  
[brian.smith@bonniercorp.com](mailto:brian.smith@bonniercorp.com)  
407.212.7090

---

<div class="post-metadata">

**Author:** ![Bryan\_McLellan](https://sea2.discourse-cdn.com/flex016/user_avatar/discourse.chef.io/bryan_mclellan/32/81_2.png) [@Bryan\_McLellan](https://discourse.chef.io/u/Bryan_McLellan)\
**Post date:** [October 18, 2011, 2:36pm UTC](https://discourse.chef.io/t/node-search-does-not-return-all-hosts/2113/2 "2011-10-18T14:36:09Z")

</div>

On Tue, Oct 18, 2011 at 10:22 AM, Brian Smith  
[brianatbonnier@foo.undertree.us](mailto:brianatbonnier@foo.undertree.us) wrote:

> Hello, I am having an issue I am trying to work out with chef. I have two  
> nodes that will not return when doing a node search with hostname:[\* TO _]  
> but if I use fqdn:[_ TO \*] they show up. Any suggestions on how to  
> troubshoot and correct the issue. If I look at the node in chef hostname  
> and fqdn are defined in chef and hostname and hostname -f resolve correctly  
> on the 2 servers that don't show up. There is a hosts entry on the servers  
> also for hostname and hostname.domainname on the server too.

What version of Chef and Ohai are you using?

Can you run 'ohai hostname' on the hosts that aren't working and get  
the correct value?

If so, does 'knife node show NODENAME -a hostname' return the proper data?

---

<div class="post-metadata">

**Author:** ![Brian\_Smith](https://avatars.discourse-cdn.com/v4/letter/b/e9c0ed/32.png) [@Brian\_Smith](https://discourse.chef.io/u/Brian_Smith)\
**Post date:** [October 18, 2011, 3:04pm UTC](https://discourse.chef.io/t/node-search-does-not-return-all-hosts/2113/3 "2011-10-18T15:04:36Z")

</div>

Thanks for the reply.

The chef server is chef version 0.10.4 and ohai 0.6.4.  
On the node having issues chef 0.10.4 and ohai 0.6.4.  
Running ohai hostname on the node returns the hostname correctly and so does  
the knife show command from the chef server.

Brian Smith  
Senior Network Engineer . Bonnier Corporation  
[brian.smith@bonniercorp.com](mailto:brian.smith@bonniercorp.com)  
407.212.7090

On Tue, Oct 18, 2011 at 10:36 AM, Bryan McLellan [btm@loftninjas.org](mailto:btm@loftninjas.org) wrote:

> On Tue, Oct 18, 2011 at 10:22 AM, Brian Smith  
> [brianatbonnier@foo.undertree.us](mailto:brianatbonnier@foo.undertree.us) wrote:
> 
> > Hello, I am having an issue I am trying to work out with chef. I have  
> > two  
> > nodes that will not return when doing a node search with hostname:[\* TO  
> > _]  
> > but if I use fqdn:[_ TO \*] they show up. Any suggestions on how to  
> > troubshoot and correct the issue. If I look at the node in chef hostname  
> > and fqdn are defined in chef and hostname and hostname -f resolve  
> > correctly  
> > on the 2 servers that don't show up. There is a hosts entry on the  
> > servers  
> > also for hostname and hostname.domainname on the server too.
> 
> What version of Chef and Ohai are you using?
> 
> Can you run 'ohai hostname' on the hosts that aren't working and get  
> the correct value?
> 
> If so, does 'knife node show NODENAME -a hostname' return the proper data?

---

<div class="post-metadata">

**Author:** ![Ranjib\_Dey](https://avatars.discourse-cdn.com/v4/letter/r/8e8cbc/32.png) [@Ranjib\_Dey](https://discourse.chef.io/u/Ranjib_Dey)\
**Post date:** [October 18, 2011, 3:06pm UTC](https://discourse.chef.io/t/node-search-does-not-return-all-hosts/2113/4 "2011-10-18T15:06:22Z")

</div>

theres a setting in solr that limits the amount of index data, can you check  
the solr logs, you can change the max indexable data size and check if that  
fixes the problem

On Tue, Oct 18, 2011 at 8:34 PM, Brian Smith \<  
[brianatbonnier@foo.undertree.us](mailto:brianatbonnier@foo.undertree.us)\> wrote:

> Thanks for the reply.
> 
> The chef server is chef version 0.10.4 and ohai 0.6.4.  
> On the node having issues chef 0.10.4 and ohai 0.6.4.  
> Running ohai hostname on the node returns the hostname correctly and so  
> does the knife show command from the chef server.
> 
> Brian Smith  
> Senior Network Engineer . Bonnier Corporation  
> [brian.smith@bonniercorp.com](mailto:brian.smith@bonniercorp.com)  
> 407.212.7090
> 
> On Tue, Oct 18, 2011 at 10:36 AM, Bryan McLellan [btm@loftninjas.org](mailto:btm@loftninjas.org)wrote:
> 
> > On Tue, Oct 18, 2011 at 10:22 AM, Brian Smith  
> > [brianatbonnier@foo.undertree.us](mailto:brianatbonnier@foo.undertree.us) wrote:
> > 
> > > Hello, I am having an issue I am trying to work out with chef. I have  
> > > two  
> > > nodes that will not return when doing a node search with hostname:[\* TO  
> > > _]  
> > > but if I use fqdn:[_ TO \*] they show up. Any suggestions on how to  
> > > troubshoot and correct the issue. If I look at the node in chef  
> > > hostname  
> > > and fqdn are defined in chef and hostname and hostname -f resolve  
> > > correctly  
> > > on the 2 servers that don't show up. There is a hosts entry on the  
> > > servers  
> > > also for hostname and hostname.domainname on the server too.
> > 
> > What version of Chef and Ohai are you using?
> > 
> > Can you run 'ohai hostname' on the hosts that aren't working and get  
> > the correct value?
> > 
> > If so, does 'knife node show NODENAME -a hostname' return the proper data?

---

<div class="post-metadata">

**Author:** ![kallistec](https://sea2.discourse-cdn.com/flex016/user_avatar/discourse.chef.io/kallistec/32/23_2.png) [@kallistec](https://discourse.chef.io/u/kallistec)\
**Post date:** [October 18, 2011, 3:14pm UTC](https://discourse.chef.io/t/node-search-does-not-return-all-hosts/2113/5 "2011-10-18T15:14:33Z")

</div>

On Tuesday, October 18, 2011 at 8:04 AM, Brian Smith wrote:

> Thanks for the reply.
> 
> The chef server is chef version 0.10.4 and ohai 0.6.4.  
> On the node having issues chef 0.10.4 and ohai 0.6.4.  
> Running ohai hostname on the node returns the hostname correctly and so does the knife show command from the chef server.
> 
> Brian Smith  
> Senior Network Engineer . Bonnier Corporation  
> [brian.smith@bonniercorp.com](mailto:brian.smith@bonniercorp.com) ([mailto:brian.smith@bonniercorp.com](mailto:brian.smith@bonniercorp.com))  
> 407.212.7090  
> What distro is the server running? Any errors in the Solr or chef-expander logs? You can run `knife index rebuild` to trigger a reindex of your data.

--  
Dan DeLeo

---

<div class="post-metadata">

**Author:** ![Brian\_Smith](https://avatars.discourse-cdn.com/v4/letter/b/e9c0ed/32.png) [@Brian\_Smith](https://discourse.chef.io/u/Brian_Smith)\
**Post date:** [October 18, 2011, 3:35pm UTC](https://discourse.chef.io/t/node-search-does-not-return-all-hosts/2113/6 "2011-10-18T15:35:25Z")

</div>

I do not see any errors in the solr log. How do I change the max indexable  
size or check what it is set to?

Brian Smith  
Senior Network Engineer . Bonnier Corporation  
[brian.smith@bonniercorp.com](mailto:brian.smith@bonniercorp.com)  
407.212.7090

On Tue, Oct 18, 2011 at 11:06 AM, Ranjib Dey [ranjibd@thoughtworks.com](mailto:ranjibd@thoughtworks.com)wrote:

> theres a setting in solr that limits the amount of index data, can you  
> check the solr logs, you can change the max indexable data size and check if  
> that fixes the problem
> 
> On Tue, Oct 18, 2011 at 8:34 PM, Brian Smith \<  
> [brianatbonnier@foo.undertree.us](mailto:brianatbonnier@foo.undertree.us)\> wrote:
> 
> > Thanks for the reply.
> > 
> > The chef server is chef version 0.10.4 and ohai 0.6.4.  
> > On the node having issues chef 0.10.4 and ohai 0.6.4.  
> > Running ohai hostname on the node returns the hostname correctly and so  
> > does the knife show command from the chef server.
> > 
> > Brian Smith  
> > Senior Network Engineer . Bonnier Corporation  
> > [brian.smith@bonniercorp.com](mailto:brian.smith@bonniercorp.com)  
> > 407.212.7090
> > 
> > On Tue, Oct 18, 2011 at 10:36 AM, Bryan McLellan [btm@loftninjas.org](mailto:btm@loftninjas.org)wrote:
> > 
> > > On Tue, Oct 18, 2011 at 10:22 AM, Brian Smith  
> > > [brianatbonnier@foo.undertree.us](mailto:brianatbonnier@foo.undertree.us) wrote:
> > > 
> > > > Hello, I am having an issue I am trying to work out with chef. I have  
> > > > two  
> > > > nodes that will not return when doing a node search with hostname:[\* TO  
> > > > _]  
> > > > but if I use fqdn:[_ TO \*] they show up. Any suggestions on how to  
> > > > troubshoot and correct the issue. If I look at the node in chef  
> > > > hostname  
> > > > and fqdn are defined in chef and hostname and hostname -f resolve  
> > > > correctly  
> > > > on the 2 servers that don't show up. There is a hosts entry on the  
> > > > servers  
> > > > also for hostname and hostname.domainname on the server too.
> > > 
> > > What version of Chef and Ohai are you using?
> > > 
> > > Can you run 'ohai hostname' on the hosts that aren't working and get  
> > > the correct value?
> > > 
> > > If so, does 'knife node show NODENAME -a hostname' return the proper  
> > > data?

---

<div class="post-metadata">

**Author:** ![Brian\_Smith](https://avatars.discourse-cdn.com/v4/letter/b/e9c0ed/32.png) [@Brian\_Smith](https://discourse.chef.io/u/Brian_Smith)\
**Post date:** [October 18, 2011, 3:40pm UTC](https://discourse.chef.io/t/node-search-does-not-return-all-hosts/2113/7 "2011-10-18T15:40:05Z")

</div>

The chef server is ubuntu 11.04. The node with the hostname issue is  
running 10.04. My expander log is empty. I ran knife index rebuild and the  
node still does not show up, the output was

Chef::ApiClient: success  
Chef::DataBag: success  
Chef::Environment: success  
Chef::Node: success  
Chef::Role: success

Brian Smith  
Senior Network Engineer . Bonnier Corporation  
[brian.smith@bonniercorp.com](mailto:brian.smith@bonniercorp.com)  
407.212.7090

On Tue, Oct 18, 2011 at 11:14 AM, Daniel DeLeo [dan@kallistec.com](mailto:dan@kallistec.com) wrote:

> On Tuesday, October 18, 2011 at 8:04 AM, Brian Smith wrote:
> 
> > Thanks for the reply.
> > 
> > The chef server is chef version 0.10.4 and ohai 0.6.4.  
> > On the node having issues chef 0.10.4 and ohai 0.6.4.  
> > Running ohai hostname on the node returns the hostname correctly and so  
> > does the knife show command from the chef server.
> > 
> > Brian Smith  
> > Senior Network Engineer . Bonnier Corporation  
> > [brian.smith@bonniercorp.com](mailto:brian.smith@bonniercorp.com) ([mailto:brian.smith@bonniercorp.com](mailto:brian.smith@bonniercorp.com))  
> > 407.212.7090  
> > What distro is the server running? Any errors in the Solr or chef-expander  
> > logs? You can run `knife index rebuild` to trigger a reindex of your data.
> 
> --  
> Dan DeLeo

---

<div class="post-metadata">

**Author:** ![kallistec](https://sea2.discourse-cdn.com/flex016/user_avatar/discourse.chef.io/kallistec/32/23_2.png) [@kallistec](https://discourse.chef.io/u/kallistec)\
**Post date:** [October 18, 2011, 3:58pm UTC](https://discourse.chef.io/t/node-search-does-not-return-all-hosts/2113/8 "2011-10-18T15:58:26Z")

</div>

On Tuesday, October 18, 2011 at 8:40 AM, Brian Smith wrote:

> The chef server is ubuntu 11.04. The node with the hostname issue is running 10.04. My expander log is empty. I ran knife index rebuild and the node still does not show up, the output was
> 
> Chef::ApiClient: success  
> Chef::DataBag: success  
> Chef::Environment: success  
> Chef::Node: success  
> Chef::Role: success
> 
> Brian Smith  
> Senior Network Engineer . Bonnier Corporation  
> [brian.smith@bonniercorp.com](mailto:brian.smith@bonniercorp.com) ([mailto:brian.smith@bonniercorp.com](mailto:brian.smith@bonniercorp.com))  
> 407.212.7090  
> Could be this bug: [http://tickets.opscode.com/browse/CHEF-2346](http://tickets.opscode.com/browse/CHEF-2346)

Also, if your chef-expander logs are empty, that could be symptomatic of a different problem, namely that the node data isn't making it to chef-expander (via rabbitmq). You should definitely see one log entry per searchable object when you run `knife index rebuild`. You can adjust the log level of chef-expander on the fly with `chef-expanderctl log-level debug` and check the queue for a backlog with `chef-expanderctl queue-depth`. You can also ping chef-expander's workers with `chef-expanderctl node-status`.

HTH,

--  
Dan DeLeo

---

<div class="post-metadata">

**Author:** ![Brian\_Smith](https://avatars.discourse-cdn.com/v4/letter/b/e9c0ed/32.png) [@Brian\_Smith](https://discourse.chef.io/u/Brian_Smith)\
**Post date:** [October 18, 2011, 6:11pm UTC](https://discourse.chef.io/t/node-search-does-not-return-all-hosts/2113/9 "2011-10-18T18:11:29Z")

</div>

If I run chef-expander -n1 manually, I can see the logging output. It  
shows:

[Tue, 18 Oct 2011 14:01:31 -0400] INFO: Chef Expander 0.10.4 starting  
cluster with 1 nodes  
[Tue, 18 Oct 2011 14:01:31 -0400] INFO: Starting cluster worker 1  
[Tue, 18 Oct 2011 14:01:31 -0400] INFO: Starting Consumers for vnodes 0-1023  
[Tue, 18 Oct 2011 14:01:33 -0400] INFO: indexed  
node[7652cbe5-4601-430b-bc99-e6e91718534d] database[chef]  
transit,xml,solr-post | 1,0.083899974822998,0.205962896347046 |  
[Tue, 18 Oct 2011 14:02:39 -0400] INFO: indexed  
node[3b87d23a-75ea-4615-8402-172b0207d288] database[chef]  
transit,xml,solr-post | 0,0.259773015975952,0.30780291557312 |  
[Tue, 18 Oct 2011 14:03:27 -0400] INFO: indexed  
node[3b87d23a-75ea-4615-8402-172b0207d288] database[chef]  
transit,xml,solr-post | 0,0.242645025253296,0.275618076324463 |  
[Tue, 18 Oct 2011 14:03:58 -0400] INFO: indexed  
node[70325296-64d2-49f8-8cbe-fa2349da0728] database[chef]  
transit,xml,solr-post | 0,0.136043071746826,0.168022155761719 |  
[Tue, 18 Oct 2011 14:03:59 -0400] INFO: indexed  
node[70325296-64d2-49f8-8cbe-fa2349da0728] database[chef]  
transit,xml,solr-post | 0,0.106320858001709,0.124919891357422 |  
[Tue, 18 Oct 2011 14:04:37 -0400] INFO: indexed  
client[6b219262-9796-427f-98ab-6009a70bb1c9] database[chef]  
transit,xml,solr-post | 0,0.000603914260864258,0.0189318656921387 |  
[Tue, 18 Oct 2011 14:04:37 -0400] INFO: indexed  
client[62024cd2-e660-417b-8107-2013cd3e22e8] database[chef]  
transit,xml,solr-post | 0,0.0004119873046875,0.00909209251403809 |  
[Tue, 18 Oct 2011 14:04:37 -0400] INFO: indexed  
client[5e309b37-e3f7-475a-9c78-5fcc1ed43b27] database[chef]  
transit,xml,solr-post | 0,0.000396013259887695,0.00794005393981934 |  
[Tue, 18 Oct 2011 14:04:37 -0400] INFO: indexed  
client[117b3ffa-3872-4efc-b288-a597b1d8d4aa] database[chef]  
transit,xml,solr-post | 0,0.000380992889404297,0.00734901428222656 |  
[Tue, 18 Oct 2011 14:04:37 -0400] INFO: indexed  
client[2fbd1661-7dcb-4d76-b305-f448778f3bf8] database[chef]  
transit,xml,solr-post | 0,0.000608921051025391,0.0103509426116943 |  
[Tue, 18 Oct 2011 14:04:37 -0400] INFO: indexed  
client[edfc3802-a65d-4042-91a4-4a7f251e060f] database[chef]  
transit,xml,solr-post | 0,0.000377178192138672,0.00926113128662109 |  
[Tue, 18 Oct 2011 14:04:37 -0400] INFO: indexed  
client[3bf6326e-c59d-4420-9a40-4fdc92b84482] database[chef]  
transit,xml,solr-post | 0,0.000382184982299805,0.00770020484924316 |  
[Tue, 18 Oct 2011 14:04:37 -0400] INFO: indexed  
client[9b1caa3c-7dad-4329-bd82-c8106635cea8] database[chef]  
transit,xml,solr-post | 0,0.00041508674621582,0.00790596008300781 |  
[Tue, 18 Oct 2011 14:04:37 -0400] INFO: indexed  
client[8d5656e3-2244-4c94-939c-9abccbe4b9f9] database[chef]  
transit,xml,solr-post | 0,0.000387907028198242,0.00792384147644043 |  
[Tue, 18 Oct 2011 14:04:37 -0400] INFO: indexed  
client[ef3e8783-f5b5-47b5-bf20-faf92528c32c] database[chef]  
transit,xml,solr-post | 0,0.000397920608520508,0.00805187225341797 |  
[Tue, 18 Oct 2011 14:04:37 -0400] INFO: indexed  
client[f0defc29-0f7f-47fa-877f-9ea8b58fad38] database[chef]  
transit,xml,solr-post | 0,0.000381231307983398,0.00814223289489746 |  
[Tue, 18 Oct 2011 14:04:37 -0400] INFO: indexed  
client[753026ad-db27-496e-97e9-92a8eb379ae9] database[chef]  
transit,xml,solr-post | 0,0.000420093536376953,0.00829505920410156 |  
[Tue, 18 Oct 2011 14:04:37 -0400] INFO: indexed  
client[9aa15ee8-a2e8-4a3b-9c9b-4d55ac96e226] database[chef]  
transit,xml,solr-post | 0,0.000396966934204102,0.00800204277038574 |  
[Tue, 18 Oct 2011 14:04:37 -0400] INFO: indexed  
client[a413bf05-0414-44fe-a93d-8ad0dca36e93] database[chef]  
transit,xml,solr-post | 0,0.000396013259887695,0.00772786140441895 |  
[Tue, 18 Oct 2011 14:04:37 -0400] INFO: indexed  
client[6255831e-1928-4802-94bf-9873a07c3f55] database[chef]  
transit,xml,solr-post | 0,0.000390052795410156,0.00789713859558105 |  
[Tue, 18 Oct 2011 14:04:37 -0400] INFO: indexed  
client[951de01b-c8df-41fa-856b-45a1e1e71988] database[chef]  
transit,xml,solr-post | 0,0.000364065170288086,0.00783300399780273 |  
[Tue, 18 Oct 2011 14:04:38 -0400] INFO: indexed  
node[4711372a-163c-4d9a-b8dd-fc374b5e21d5] database[chef]  
transit,xml,solr-post | 0,0.000235795974731445,0.00694584846496582 |  
[Tue, 18 Oct 2011 14:04:38 -0400] INFO: indexed  
node[0735f918-3ceb-426a-aa54-0dbd6444cb8f] database[chef]  
transit,xml,solr-post | 0,0.0516819953918457,0.0682859420776367 |  
[Tue, 18 Oct 2011 14:04:38 -0400] INFO: indexed  
node[a820136d-d704-4d56-bc20-36c979b5d27d] database[chef]  
transit,xml,solr-post | 0,0.0955410003662109,0.108435869216919 |  
[Tue, 18 Oct 2011 14:04:38 -0400] INFO: indexed  
node[7652cbe5-4601-430b-bc99-e6e91718534d] database[chef]  
transit,xml,solr-post | 0,0.043848991394043,0.0569930076599121 |  
[Tue, 18 Oct 2011 14:04:39 -0400] INFO: indexed  
node[47c3e5b3-ea08-43fb-86ba-66caebde43a4] database[chef]  
transit,xml,solr-post | 1,0.110408067703247,0.126874208450317 |  
[Tue, 18 Oct 2011 14:04:39 -0400] INFO: indexed  
node[70325296-64d2-49f8-8cbe-fa2349da0728] database[chef]  
transit,xml,solr-post | 0,0.0638837814331055,0.0798130035400391 |  
[Tue, 18 Oct 2011 14:04:39 -0400] INFO: indexed  
node[3b87d23a-75ea-4615-8402-172b0207d288] database[chef]  
transit,xml,solr-post | 0,0.206537961959839,0.236276865005493 |  
[Tue, 18 Oct 2011 14:04:39 -0400] INFO: indexed  
node[897aa03d-0804-41ea-8cd6-1265cd6e764c] database[chef]  
transit,xml,solr-post | 0,0.0518558025360107,0.0679068565368652 |  
[Tue, 18 Oct 2011 14:04:39 -0400] INFO: indexed  
node[fc6ac59c-cdf0-4d16-a172-22cbd35591eb] database[chef]  
transit,xml,solr-post | 0,0.0623269081115723,0.080096960067749 |  
[Tue, 18 Oct 2011 14:04:40 -0400] INFO: indexed  
node[89e7ae14-21f1-4546-8cdb-986a846e9c8f] database[chef]  
transit,xml,solr-post | 0,0.180221080780029,0.208502054214478 |  
[Tue, 18 Oct 2011 14:04:40 -0400] INFO: indexed  
node[bd97525b-704a-4601-a313-1e7cb9c85893] database[chef]  
transit,xml,solr-post | 0,0.0465750694274902,0.117887020111084 |  
[Tue, 18 Oct 2011 14:04:40 -0400] INFO: indexed  
node[87e6263c-cba0-4a6f-b214-9c20451e84d9] database[chef]  
transit,xml,solr-post | 0,0.0579969882965088,0.0754320621490479 |  
[Tue, 18 Oct 2011 14:04:40 -0400] INFO: indexed  
role[d9c69c5a-9ad9-46e5-bda2-99fc740c82fc] database[chef]  
transit,xml,solr-post | 0,0.00243496894836426,0.0112459659576416 |  
[Tue, 18 Oct 2011 14:04:40 -0400] INFO: indexed  
role[00c31554-fcf2-4074-8678-ac47e8a99314] database[chef]  
transit,xml,solr-post | 0,0.000580787658691406,0.00935697555541992 |  
[Tue, 18 Oct 2011 14:04:40 -0400] INFO: indexed  
environment[6d2d835e-2eb6-41a0-9fc6-3cc59f406a8c] database[chef]  
transit,xml,solr-post | 0,0.000301122665405273,0.00833916664123535 |  
[Tue, 18 Oct 2011 14:04:40 -0400] INFO: indexed  
role[d996a12e-5b09-4ad8-99ac-f7ee98ee37e5] database[chef]  
transit,xml,solr-post | 0,0.00143790245056152,0.00992584228515625 |  
[Tue, 18 Oct 2011 14:04:40 -0400] INFO: indexed  
role[c1873ee1-d5e7-41c1-8b98-32972dc2285e] database[chef]  
transit,xml,solr-post | 0,0.00037693977355957,0.00780487060546875 |  
[Tue, 18 Oct 2011 14:04:40 -0400] INFO: indexed  
role[b1882ad8-3de1-4cb1-b497-c158a4b55ffa] database[chef]  
transit,xml,solr-post | 0,0.000663995742797852,0.00769305229187012 |  
[Tue, 18 Oct 2011 14:04:40 -0400] INFO: indexed  
role[1cca950d-e319-4b5d-bec6-c2366c4a5752] database[chef]  
transit,xml,solr-post | 0,0.000308990478515625,0.00720810890197754 |  
[Tue, 18 Oct 2011 14:04:40 -0400] INFO: indexed  
role[db9357fb-231a-432a-870c-df4854dbec0f] database[chef]  
transit,xml,solr-post | 0,0.000368118286132812,0.00716805458068848 |  
[Tue, 18 Oct 2011 14:04:40 -0400] INFO: indexed  
data\_bag\_item[71233651-9fab-4d6b-9d22-98f1e86ed5de] database[chef]  
transit,xml,solr-post | 0,0.000286102294921875,0.00728702545166016 |  
[Tue, 18 Oct 2011 14:04:40 -0400] INFO: indexed  
data\_bag\_item[b852aa46-50c6-46dc-a919-3acc13b0eda1] database[chef]  
transit,xml,solr-post | 0,0.000451087951660156,0.00730395317077637 |  
[Tue, 18 Oct 2011 14:04:40 -0400] INFO: indexed  
environment[bf81d04b-781c-424a-9abf-ff57c59971ab] database[chef]  
transit,xml,solr-post | 0,0.000319004058837891,0.00710606575012207 |  
[Tue, 18 Oct 2011 14:04:40 -0400] INFO: indexed  
environment[149177ba-d93a-4c01-b1b6-24ba62de1b86] database[chef]  
transit,xml,solr-post | 0,0.000303983688354492,0.00760889053344727 |  
[Tue, 18 Oct 2011 14:04:40 -0400] INFO: indexed  
role[d57ef5df-6d71-44b5-b89e-a141ecc37a15] database[chef]  
transit,xml,solr-post | 0,0.000612020492553711,0.00822687149047852 |  
[Tue, 18 Oct 2011 14:04:40 -0400] INFO: indexed  
data\_bag[60b02a5d-85f6-4632-a74e-634abcba33c8] database[chef]  
transit,xml,solr-post | 0,0.000259876251220703,0.00741982460021973 |  
[Tue, 18 Oct 2011 14:04:40 -0400] INFO: indexed  
role[37305494-ecd9-47a9-ad28-73e61841e01c] database[chef]  
transit,xml,solr-post | 0,0.000364065170288086,0.00799798965454102 |  
[Tue, 18 Oct 2011 14:04:40 -0400] INFO: indexed  
data\_bag[1e0589f2-6a50-41a8-a940-41649c1ce649] database[chef]  
transit,xml,solr-post | 0,0.00029301643371582,0.00872611999511719 |  
[Tue, 18 Oct 2011 14:04:40 -0400] INFO: indexed  
environment[68d20a83-7fb0-43f7-b310-0458e8d6f6b3] database[chef]  
transit,xml,solr-post | 0,0.000298023223876953,0.00695300102233887 |  
[Tue, 18 Oct 2011 14:04:41 -0400] INFO: indexed  
role[731b07f7-b78c-4ec6-9838-e737b0c78df4] database[chef]  
transit,xml,solr-post | 1,0.00034785270690918,0.00690293312072754 |  
[Tue, 18 Oct 2011 14:04:41 -0400] INFO: indexed  
environment[77b1e46f-4784-419c-afb1-d9e3427a5d8a] database[chef]  
transit,xml,solr-post | 1,0.000473976135253906,0.00699400901794434 |

chef-expanderctl queue-depth  
total messages: 0  
average queue depth: 0.0  
max queue depth: 0  
min queue depth: 0

chef-expanderctl node-status  
Collecting status info from the cluster...done

Host PID  
GUID Vnodes  
chef.bonniercorp.local 18713  
2fcf4dff-6499-47d5-9504-6a2861557324 0-1023

knife index rebuild  
This operation is destructive. Rebuilding the index may take some time. You  
sure? (yes/no): yes  
Chef::ApiClient: success  
Chef::DataBag: success  
Chef::Environment: success  
Chef::Node: success  
Chef::Role: success

But Still the node will not return when searching hostname:[\* TO \*]

Brian Smith  
Senior Network Engineer . Bonnier Corporation  
[brian.smith@bonniercorp.com](mailto:brian.smith@bonniercorp.com)  
407.212.7090

On Tue, Oct 18, 2011 at 11:58 AM, Daniel DeLeo [dan@kallistec.com](mailto:dan@kallistec.com) wrote:

> On Tuesday, October 18, 2011 at 8:40 AM, Brian Smith wrote:
> 
> > The chef server is ubuntu 11.04. The node with the hostname issue is  
> > running 10.04. My expander log is empty. I ran knife index rebuild and the  
> > node still does not show up, the output was
> > 
> > Chef::ApiClient: success  
> > Chef::DataBag: success  
> > Chef::Environment: success  
> > Chef::Node: success  
> > Chef::Role: success
> > 
> > Brian Smith  
> > Senior Network Engineer . Bonnier Corporation  
> > [brian.smith@bonniercorp.com](mailto:brian.smith@bonniercorp.com) ([mailto:brian.smith@bonniercorp.com](mailto:brian.smith@bonniercorp.com))  
> > 407.212.7090  
> > Could be this bug: [http://tickets.opscode.com/browse/CHEF-2346](http://tickets.opscode.com/browse/CHEF-2346)
> 
> Also, if your chef-expander logs are empty, that could be symptomatic of a  
> different problem, namely that the node data isn't making it to  
> chef-expander (via rabbitmq). You should definitely see one log entry per  
> searchable object when you run `knife index rebuild`. You can adjust the log  
> level of chef-expander on the fly with `chef-expanderctl log-level debug`  
> and check the queue for a backlog with `chef-expanderctl queue-depth`. You  
> can also ping chef-expander's workers with `chef-expanderctl node-status`.
> 
> HTH,
> 
> --  
> Dan DeLeo

---

<div class="post-metadata">

**Author:** ![kallistec](https://sea2.discourse-cdn.com/flex016/user_avatar/discourse.chef.io/kallistec/32/23_2.png) [@kallistec](https://discourse.chef.io/u/kallistec)\
**Post date:** [October 19, 2011, 3:26pm UTC](https://discourse.chef.io/t/node-search-does-not-return-all-hosts/2113/10 "2011-10-19T15:26:31Z")

</div>

On Tuesday, October 18, 2011 at 11:11 AM, Brian Smith wrote:

> If I run chef-expander -n1 manually, I can see the logging output. It shows:

Everything looks normal with rabbit and chef-expander….

> But Still the node will not return when searching hostname:[\* TO \*]
> 
> Brian Smith  
> Senior Network Engineer . Bonnier Corporation  
> [brian.smith@bonniercorp.com](mailto:brian.smith@bonniercorp.com) ([mailto:brian.smith@bonniercorp.com](mailto:brian.smith@bonniercorp.com))  
> 407.212.7090

Anything in the Solr logs?

--  
Dan DeLeo

---

<div class="post-metadata">

**Author:** ![Brian\_Smith](https://avatars.discourse-cdn.com/v4/letter/b/e9c0ed/32.png) [@Brian\_Smith](https://discourse.chef.io/u/Brian_Smith)\
**Post date:** [October 24, 2011, 2:37pm UTC](https://discourse.chef.io/t/node-search-does-not-return-all-hosts/2113/11 "2011-10-24T14:37:37Z")

</div>

I believe this is probably the issue, but not sure how to fix it. I've  
discovered the nodes that have the issue have LDAP enabled, which include in  
the node attributes all our users and groups causing the nodes size to go  
from 50k json to over 150k when I run knife node show node -l -F json. If I  
remove ldap from the node the search works fine on the node. I don't have  
any errors in the solr log so I am not sure what setting needs to change.  
Anyone have any ideas on what it could be?

Brian Smith  
Senior Network Engineer . Bonnier Corporation  
[brian.smith@bonniercorp.com](mailto:brian.smith@bonniercorp.com)  
407.212.7090

On Tue, Oct 18, 2011 at 11:06 AM, Ranjib Dey [ranjibd@thoughtworks.com](mailto:ranjibd@thoughtworks.com)wrote:

> theres a setting in solr that limits the amount of index data, can you  
> check the solr logs, you can change the max indexable data size and check if  
> that fixes the problem
> 
> On Tue, Oct 18, 2011 at 8:34 PM, Brian Smith \<  
> [brianatbonnier@foo.undertree.us](mailto:brianatbonnier@foo.undertree.us)\> wrote:
> 
> > Thanks for the reply.
> > 
> > The chef server is chef version 0.10.4 and ohai 0.6.4.  
> > On the node having issues chef 0.10.4 and ohai 0.6.4.  
> > Running ohai hostname on the node returns the hostname correctly and so  
> > does the knife show command from the chef server.
> > 
> > Brian Smith  
> > Senior Network Engineer . Bonnier Corporation  
> > [brian.smith@bonniercorp.com](mailto:brian.smith@bonniercorp.com)  
> > 407.212.7090
> > 
> > On Tue, Oct 18, 2011 at 10:36 AM, Bryan McLellan [btm@loftninjas.org](mailto:btm@loftninjas.org)wrote:
> > 
> > > On Tue, Oct 18, 2011 at 10:22 AM, Brian Smith  
> > > [brianatbonnier@foo.undertree.us](mailto:brianatbonnier@foo.undertree.us) wrote:
> > > 
> > > > Hello, I am having an issue I am trying to work out with chef. I have  
> > > > two  
> > > > nodes that will not return when doing a node search with hostname:[\* TO  
> > > > _]  
> > > > but if I use fqdn:[_ TO \*] they show up. Any suggestions on how to  
> > > > troubshoot and correct the issue. If I look at the node in chef  
> > > > hostname  
> > > > and fqdn are defined in chef and hostname and hostname -f resolve  
> > > > correctly  
> > > > on the 2 servers that don't show up. There is a hosts entry on the  
> > > > servers  
> > > > also for hostname and hostname.domainname on the server too.
> > > 
> > > What version of Chef and Ohai are you using?
> > > 
> > > Can you run 'ohai hostname' on the hosts that aren't working and get  
> > > the correct value?
> > > 
> > > If so, does 'knife node show NODENAME -a hostname' return the proper  
> > > data?

---

<div class="post-metadata">

**Author:** ![Joshua\_Timberman](https://sea2.discourse-cdn.com/flex016/user_avatar/discourse.chef.io/joshua_timberman/32/424_2.png) [@Joshua\_Timberman](https://discourse.chef.io/u/Joshua_Timberman)\
**Post date:** [October 24, 2011, 3:02pm UTC](https://discourse.chef.io/t/node-search-does-not-return-all-hosts/2113/12 "2011-10-24T15:02:22Z")

</div>

Hi Brian,

You can add the following line to your /etc/chef/client.rb to disable user/group information plugin in ohai:

Ohai::Config[:disabled\_plugins] = ["passwd"]

Then rerun chef-client on nodes and they will be indexed without the data from LDAP. You won't get the local user/group info either, however.

More information here,

[http://wiki.opscode.com/display/chef/Disabling+Ohai+Plugins](http://wiki.opscode.com/display/chef/Disabling+Ohai+Plugins)

On Oct 24, 2011, at 8:37, Brian Smith [brianatbonnier@foo.undertree.us](mailto:brianatbonnier@foo.undertree.us) wrote:

> I believe this is probably the issue, but not sure how to fix it. I've discovered the nodes that have the issue have LDAP enabled, which include in the node attributes all our users and groups causing the nodes size to go from 50k json to over 150k when I run knife node show node -l -F json. If I remove ldap from the node the search works fine on the node. I don't have any errors in the solr log so I am not sure what setting needs to change. Anyone have any ideas on what it could be?
> 
> Brian Smith  
> Senior Network Engineer . Bonnier Corporation  
> [brian.smith@bonniercorp.com](mailto:brian.smith@bonniercorp.com)  
> 407.212.7090
> 
> On Tue, Oct 18, 2011 at 11:06 AM, Ranjib Dey [ranjibd@thoughtworks.com](mailto:ranjibd@thoughtworks.com) wrote:  
> theres a setting in solr that limits the amount of index data, can you check the solr logs, you can change the max indexable data size and check if that fixes the problem
> 
> On Tue, Oct 18, 2011 at 8:34 PM, Brian Smith [brianatbonnier@foo.undertree.us](mailto:brianatbonnier@foo.undertree.us) wrote:  
> Thanks for the reply.
> 
> The chef server is chef version 0.10.4 and ohai 0.6.4.  
> On the node having issues chef 0.10.4 and ohai 0.6.4.  
> Running ohai hostname on the node returns the hostname correctly and so does the knife show command from the chef server.
> 
> Brian Smith  
> Senior Network Engineer . Bonnier Corporation  
> [brian.smith@bonniercorp.com](mailto:brian.smith@bonniercorp.com)  
> 407.212.7090
> 
> On Tue, Oct 18, 2011 at 10:36 AM, Bryan McLellan [btm@loftninjas.org](mailto:btm@loftninjas.org) wrote:  
> On Tue, Oct 18, 2011 at 10:22 AM, Brian Smith  
> [brianatbonnier@foo.undertree.us](mailto:brianatbonnier@foo.undertree.us) wrote:
> 
> > Hello, I am having an issue I am trying to work out with chef. I have two  
> > nodes that will not return when doing a node search with hostname:[\* TO _]  
> > but if I use fqdn:[_ TO \*] they show up. Any suggestions on how to  
> > troubshoot and correct the issue. If I look at the node in chef hostname  
> > and fqdn are defined in chef and hostname and hostname -f resolve correctly  
> > on the 2 servers that don't show up. There is a hosts entry on the servers  
> > also for hostname and hostname.domainname on the server too.
> 
> What version of Chef and Ohai are you using?
> 
> Can you run 'ohai hostname' on the hosts that aren't working and get  
> the correct value?
> 
> If so, does 'knife node show NODENAME -a hostname' return the proper data?