Search returns error

Paul_Welch · April 9, 2012, 4:30pm

Running Ubuntu 10.04.4 LTS and Open-Source Chef server 0.10.8 from Opscode Repo.

When searching, either inside a cookbook (in this case nagios) during
a chef-run or using `knife search users “groups:sysadmin” I get this
error:

ERROR: Server returned error for
http://chef.mydomain.com:4000/search/users?q=groups%3Asysadmin&sort=&start=0&rows=1000,
retrying 1/5 in 3s

This error happened once before and after messing with it for several
hours I decided to reinstall the chef-server from scratch. After
reinstalling I used it to build another nagios-server node with
cookbook. This worked on the fresh install. After the weekend I try
the knife search again and get the same error.

Does anyone have any suggestions on how to fix this or why it is happening?

–
Paul Welch
pwelch2004@gmail.com

Paul_Welch · April 9, 2012, 4:36pm

/var/log/chef/server.log output when running search

merb : chef-server (api) : worker (port 4000) ~ Started request
handling: Mon Apr 09 12:34:34 -0400 2012
merb : chef-server (api) : worker (port 4000) ~ Params:
{"id"=>"users", "action"=>"show", "start"=>"0", "rows
"=>"1000", "sort"=>"", "controller"=>"search", "q"=>"groups%3Asysadmin"}
merb : chef-server (api) : worker (port 4000) ~
Net::HTTPServerException: 404 "Not Found" - (Chef::Exceptions
::SolrConnectionError)
/usr/lib/ruby/vendor_ruby/chef/solr_query/solr_http_request.rb:127:in
request_failed!' /usr/lib/ruby/vendor_ruby/chef/solr_query/solr_http_request.rb:107:in run'
/usr/lib/ruby/vendor_ruby/chef/solr_query/solr_http_request.rb:66:in select' /usr/lib/ruby/vendor_ruby/chef/solr_query.rb:119:in results'
/usr/lib/ruby/vendor_ruby/chef/solr_query.rb:115:in object_ids' /usr/lib/ruby/vendor_ruby/chef/solr_query.rb:105:in objects'
/usr/lib/ruby/vendor_ruby/chef/solr_query.rb:124:in search' /usr/share/chef-server-api/app/controllers/search.rb:43:in show'
/usr/lib/ruby/1.8/merb-core/controller/abstract_controller.rb:315:in send' /usr/lib/ruby/1.8/merb-core/controller/abstract_controller.rb:315:in _call_action'
/usr/lib/ruby/1.8/merb-core/controller/abstract_controller.rb:289:in _dispatch' /usr/lib/ruby/1.8/merb-core/controller/merb_controller.rb:252:in _dispatch'
/usr/lib/ruby/1.8/merb-core/dispatch/dispatcher.rb:102:in dispatch_action' /usr/lib/ruby/1.8/merb-core/dispatch/dispatcher.rb:74:in handle'
/usr/lib/ruby/1.8/merb-core/dispatch/dispatcher.rb:36:in handle' /usr/lib/ruby/1.8/merb-core/rack/application.rb:17:in call'
/usr/lib/ruby/1.8/merb-core/rack/middleware/static.rb:28:in call' /usr/lib/ruby/1.8/rack/content_length.rb:13:in call'
/usr/lib/ruby/1.8/thin/connection.rb:76:in pre_process' /usr/lib/ruby/1.8/thin/connection.rb:74:in catch'
/usr/lib/ruby/1.8/thin/connection.rb:74:in pre_process' /usr/lib/ruby/1.8/thin/connection.rb:57:in process'
/usr/lib/ruby/1.8/thin/connection.rb:42:in receive_data' /usr/lib/ruby/vendor_ruby/eventmachine.rb:256:in run_machine'
/usr/lib/ruby/vendor_ruby/eventmachine.rb:256:in run' /usr/lib/ruby/1.8/thin/backends/base.rb:57:in start'
/usr/lib/ruby/1.8/thin/server.rb:156:in start' /usr/lib/ruby/1.8/merb-core/rack/adapter/thin.rb:30:in start_server'
/usr/lib/ruby/1.8/merb-core/rack/adapter/abstract.rb:298:in start_at_port' /usr/lib/ruby/1.8/merb-core/rack/adapter/abstract.rb:128:in start'
/usr/lib/ruby/1.8/merb-core/server.rb:174:in bootup' /usr/lib/ruby/1.8/merb-core/server.rb:159:in daemonize'
/usr/lib/ruby/1.8/merb-core/server.rb:143:in fork' /usr/lib/ruby/1.8/merb-core/server.rb:143:in daemonize'
/usr/lib/ruby/1.8/merb-core/server.rb:35:in start' /usr/lib/ruby/1.8/merb-core.rb:170:in start'
/usr/sbin/chef-server:86
merb : chef-server (api) : worker (port 4000) ~ Params:
{"action"=>"show", "start"=>"0", "rows"=>"1000", "sor
t"=>"", "type"=>"users", "controller"=>"search", "q"=>"groups%3Asysadmin"}
merb : chef-server (api) : worker (port 4000) ~

If im not mistaken it looks like an issue talking to Solr. However, I
am not sure why it would work on initial install but stop working
later...

On Mon, Apr 9, 2012 at 12:30 PM, Paul Welch pwelch2004@gmail.com wrote:

Running Ubuntu 10.04.4 LTS and Open-Source Chef server 0.10.8 from Opscode Repo.

When searching, either inside a cookbook (in this case nagios) during
a chef-run or using `knife search users "groups:sysadmin" I get this
error:

ERROR: Server returned error for
http://chef.mydomain.com:4000/search/users?q=groups%253Asysadmin&sort=&start=0&rows=1000,
retrying 1/5 in 3s

This error happened once before and after messing with it for several
hours I decided to reinstall the chef-server from scratch. After
reinstalling I used it to build another nagios-server node with
cookbook. This worked on the fresh install. After the weekend I try
the knife search again and get the same error.

Does anyone have any suggestions on how to fix this or why it is happening?

--
Paul Welch
pwelch2004@gmail.com

--
Paul Welch
pwelch2004@gmail.com
+1.352.327.8087

Bryan_McLellan · April 9, 2012, 6:04pm

On Mon, Apr 9, 2012 at 12:36 PM, Paul Welch pwelch2004@gmail.com wrote:

If im not mistaken it looks like an issue talking to Solr. However, I
am not sure why it would work on initial install but stop working
later...

Anything interesting in the solr log? Usually /var/log/chef/solr.log.

Bryan

Paul_Welch · April 9, 2012, 6:23pm

Output from my /var/log/chef/solr.log:

[Mon, 09 Apr 2012 12:45:04 -0400] INFO: About to change privilege to chef:chef
[Mon, 09 Apr 2012 12:45:04 -0400] INFO: Daemonizing..
[Mon, 09 Apr 2012 12:45:04 -0400] INFO: Forked, in 895. Priveleges: 107 115
[Mon, 09 Apr 2012 12:45:04 -0400] INFO: Starting Solr with java
-Xmx256M -Xms256M -Dsolr.data.dir=/var/cache/chef/solr/data
-Dsolr.solr.home=/var/lib/chef/solr
-DSTART=/var/lib/chef/solr/solr-jetty/etc/start.config -jar
/var/lib/chef/solr/solr-jetty/start.jar
1 [main] INFO org.mortbay.log - Logging to
org.slf4j.impl.SimpleLogger(org.mortbay.log) via
org.mortbay.log.Slf4jLog
196 [main] INFO org.mortbay.log - jetty-6.1.22
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in
[jar:file:/usr/share/java/slf4j-simple-1.5.10.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in
[jar:file:/var/lib/chef/solr/solr-jetty/webapps/solr/WEB-INF/lib/slf4j-jdk14.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See SLF4J Error Codes for an explanation.
Apr 9, 2012 12:45:17 PM org.apache.solr.core.SolrResourceLoader locateSolrHome
INFO: No /solr/home in JNDI
Apr 9, 2012 12:45:17 PM org.apache.solr.core.SolrResourceLoader locateSolrHome
INFO: using system property solr.solr.home: /var/lib/chef/solr
Apr 9, 2012 12:45:17 PM org.apache.solr.core.SolrResourceLoader
INFO: Solr home set to '/var/lib/chef/solr/'
Apr 9, 2012 12:45:17 PM org.apache.solr.servlet.SolrDispatchFilter init
INFO: SolrDispatchFilter.init()
Apr 9, 2012 12:45:17 PM org.apache.solr.core.SolrResourceLoader locateSolrHome
INFO: No /solr/home in JNDI
Apr 9, 2012 12:45:17 PM org.apache.solr.core.SolrResourceLoader locateSolrHome
INFO: using system property solr.solr.home: /var/lib/chef/solr
Apr 9, 2012 12:45:17 PM org.apache.solr.core.CoreContainer$Initializer
initialize
INFO: looking for solr.xml: /var/lib/chef/solr/solr.xml
Apr 9, 2012 12:45:17 PM org.apache.solr.core.SolrResourceLoader
INFO: Solr home set to '/var/lib/chef/solr/'
Apr 9, 2012 12:45:17 PM org.apache.solr.core.SolrConfig
INFO: Loaded SolrConfig: solrconfig.xml
Apr 9, 2012 12:45:17 PM org.apache.solr.core.SolrCore
INFO: Opening new SolrCore at /var/lib/chef/solr/,
dataDir=/var/cache/chef/solr/data/
Apr 9, 2012 12:45:17 PM org.apache.solr.schema.IndexSchema readSchema
INFO: Reading Solr Schema
Apr 9, 2012 12:45:17 PM org.apache.solr.schema.IndexSchema readSchema
INFO: Schema name=chef
Apr 9, 2012 12:45:17 PM org.apache.solr.util.plugin.AbstractPluginLoader load
INFO: created string: org.apache.solr.schema.StrField
Apr 9, 2012 12:45:17 PM org.apache.solr.util.plugin.AbstractPluginLoader load
INFO: created boolean: org.apache.solr.schema.BoolField
Apr 9, 2012 12:45:17 PM org.apache.solr.util.plugin.AbstractPluginLoader load
INFO: created integer: org.apache.solr.schema.IntField
Apr 9, 2012 12:45:17 PM org.apache.solr.util.plugin.AbstractPluginLoader load
INFO: created long: org.apache.solr.schema.LongField
Apr 9, 2012 12:45:17 PM org.apache.solr.util.plugin.AbstractPluginLoader load
INFO: created float: org.apache.solr.schema.FloatField
Apr 9, 2012 12:45:17 PM org.apache.solr.util.plugin.AbstractPluginLoader load
INFO: created double: org.apache.solr.schema.DoubleField
Apr 9, 2012 12:45:18 PM org.apache.solr.util.plugin.AbstractPluginLoader load
INFO: created sint: org.apache.solr.schema.SortableIntField
Apr 9, 2012 12:45:18 PM org.apache.solr.util.plugin.AbstractPluginLoader load
INFO: created slong: org.apache.solr.schema.SortableLongField
Apr 9, 2012 12:45:18 PM org.apache.solr.util.plugin.AbstractPluginLoader load
INFO: created sfloat: org.apache.solr.schema.SortableFloatField
Apr 9, 2012 12:45:18 PM org.apache.solr.util.plugin.AbstractPluginLoader load
INFO: created sdouble: org.apache.solr.schema.SortableDoubleField
Apr 9, 2012 12:45:18 PM org.apache.solr.util.plugin.AbstractPluginLoader load
INFO: created stuff: org.apache.solr.schema.TextField
Apr 9, 2012 12:45:18 PM org.apache.solr.util.plugin.AbstractPluginLoader load
INFO: created date: org.apache.solr.schema.DateField
Apr 9, 2012 12:45:18 PM org.apache.solr.schema.IndexSchema readSchema
INFO: default search field is content
Apr 9, 2012 12:45:18 PM org.apache.solr.schema.IndexSchema readSchema
INFO: query parser default operator is OR
Apr 9, 2012 12:45:18 PM org.apache.solr.schema.IndexSchema readSchema
INFO: unique key field: X_CHEF_id_CHEF_X
Apr 9, 2012 12:45:18 PM org.apache.solr.core.JmxMonitoredMap
INFO: No JMX servers found, not exposing Solr information with JMX.
Apr 9, 2012 12:45:18 PM org.apache.solr.core.RequestHandlers
initHandlersFromConfig
INFO: created standard: solr.SearchHandler
Apr 9, 2012 12:45:18 PM org.apache.solr.core.RequestHandlers
initHandlersFromConfig
INFO: created /update: solr.XmlUpdateRequestHandler
Apr 9, 2012 12:45:18 PM org.apache.solr.core.RequestHandlers
initHandlersFromConfig
INFO: created /update/javabin: solr.BinaryUpdateRequestHandler
Apr 9, 2012 12:45:18 PM org.apache.solr.core.RequestHandlers
initHandlersFromConfig
INFO: created /analysis/document: solr.DocumentAnalysisRequestHandler
Apr 9, 2012 12:45:18 PM org.apache.solr.core.RequestHandlers
initHandlersFromConfig
INFO: created /analysis/field: solr.FieldAnalysisRequestHandler
Apr 9, 2012 12:45:18 PM org.apache.solr.core.RequestHandlers
initHandlersFromConfig
INFO: adding lazy requestHandler: solr.CSVRequestHandler
Apr 9, 2012 12:45:18 PM org.apache.solr.core.RequestHandlers
initHandlersFromConfig
INFO: created /update/csv: solr.CSVRequestHandler
Apr 9, 2012 12:45:18 PM org.apache.solr.core.RequestHandlers
initHandlersFromConfig
INFO: created /admin/: org.apache.solr.handler.admin.AdminHandlers
Apr 9, 2012 12:45:18 PM org.apache.solr.core.RequestHandlers
initHandlersFromConfig
INFO: created /admin/ping: PingRequestHandler
Apr 9, 2012 12:45:18 PM org.apache.solr.core.RequestHandlers
initHandlersFromConfig
INFO: created /debug/dump: solr.DumpRequestHandler
Apr 9, 2012 12:45:18 PM org.apache.solr.search.SolrIndexSearcher
INFO: Opening Searcher@64a7c45e main
Apr 9, 2012 12:45:18 PM
org.apache.solr.update.DirectUpdateHandler2$CommitTracker
INFO: AutoCommit: if uncommited for 10000ms; if 100 uncommited docs
Apr 9, 2012 12:45:18 PM org.apache.solr.handler.component.SearchHandler inform
INFO: Adding component:org.apache.solr.handler.component.QueryComponent@1dc18a4c
Apr 9, 2012 12:45:18 PM org.apache.solr.handler.component.SearchHandler inform
INFO: Adding component:org.apache.solr.handler.component.FacetComponent@d5e92d7
Apr 9, 2012 12:45:18 PM org.apache.solr.handler.component.SearchHandler inform
INFO: Adding component:org.apache.solr.handler.component.MoreLikeThisComponent@3bfa681c
Apr 9, 2012 12:45:18 PM org.apache.solr.handler.component.SearchHandler inform
INFO: Adding component:org.apache.solr.handler.component.HighlightComponent@34c92507
Apr 9, 2012 12:45:18 PM org.apache.solr.handler.component.SearchHandler inform
INFO: Adding component:org.apache.solr.handler.component.StatsComponent@19e09a4
Apr 9, 2012 12:45:18 PM org.apache.solr.handler.component.SearchHandler inform
INFO: Adding debug
component:org.apache.solr.handler.component.DebugComponent@2e8aeed0
Apr 9, 2012 12:45:18 PM org.apache.solr.core.SolrCore registerSearcher
INFO: Registered new searcher Searcher@64a7c45e main
Apr 9, 2012 12:45:18 PM org.apache.solr.core.CoreContainer register
INFO: registering core:
Apr 9, 2012 12:45:18 PM org.apache.solr.servlet.SolrDispatchFilter init
INFO: user.dir=/var/lib/chef/solr/solr-jetty
Apr 9, 2012 12:45:18 PM org.apache.solr.servlet.SolrDispatchFilter init
INFO: SolrDispatchFilter.init() done
Apr 9, 2012 12:45:18 PM org.apache.solr.servlet.SolrServlet init
INFO: SolrServlet.init()
Apr 9, 2012 12:45:18 PM org.apache.solr.core.SolrResourceLoader locateSolrHome
INFO: No /solr/home in JNDI
Apr 9, 2012 12:45:18 PM org.apache.solr.core.SolrResourceLoader locateSolrHome
INFO: using system property solr.solr.home: /var/lib/chef/solr
Apr 9, 2012 12:45:18 PM org.apache.solr.servlet.SolrServlet init
INFO: SolrServlet.init() done
Apr 9, 2012 12:45:18 PM org.apache.solr.core.SolrResourceLoader locateSolrHome
INFO: No /solr/home in JNDI
Apr 9, 2012 12:45:18 PM org.apache.solr.core.SolrResourceLoader locateSolrHome
INFO: using system property solr.solr.home: /var/lib/chef/solr
Apr 9, 2012 12:45:18 PM org.apache.solr.servlet.SolrUpdateServlet init
INFO: SolrUpdateServlet.init() done
13144 [main] WARN org.mortbay.log - failed
org.mortbay.jetty.NCSARequestLog@28ae4646: java.io.IOException: Cannot
write log directory /var/log/chef
13144 [main] WARN org.mortbay.log - failed RequestLogHandler@4987b287:
java.io.IOException: Cannot write log directory /var/log/chef
13144 [main] WARN org.mortbay.log - failed HandlerCollection@6bd9e2c7:
java.io.IOException: Cannot write log directory /var/log/chef
13144 [main] WARN org.mortbay.log - Error starting handlers
java.io.IOException: Cannot write log directory /var/log/chef
at org.mortbay.util.RolloverFileOutputStream.setFile(RolloverFileOutputStream.java:217)
at org.mortbay.util.RolloverFileOutputStream.(RolloverFileOutputStream.java:164)
at org.mortbay.jetty.NCSARequestLog.doStart(NCSARequestLog.java:428)
at org.mortbay.component.AbstractLifeCycle.start(AbstractLifeCycle.java:50)
at org.mortbay.jetty.handler.RequestLogHandler.doStart(RequestLogHandler.java:117)
at org.mortbay.component.AbstractLifeCycle.start(AbstractLifeCycle.java:50)
at org.mortbay.jetty.handler.HandlerCollection.doStart(HandlerCollection.java:152)
at org.mortbay.component.AbstractLifeCycle.start(AbstractLifeCycle.java:50)
at org.mortbay.jetty.handler.HandlerWrapper.doStart(HandlerWrapper.java:130)
at org.mortbay.jetty.Server.doStart(Server.java:224)
at org.mortbay.component.AbstractLifeCycle.start(AbstractLifeCycle.java:50)
at org.mortbay.xml.XmlConfiguration.main(XmlConfiguration.java:985)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:616)
at org.mortbay.start.Main.invokeMain(Main.java:194)
at org.mortbay.start.Main.start(Main.java:534)
at org.mortbay.start.Main.start(Main.java:441)
at org.mortbay.start.Main.main(Main.java:119)
13164 [main] INFO org.mortbay.log - Started SocketConnector@127.0.0.1:8983

On Mon, Apr 9, 2012 at 2:04 PM, Bryan McLellan btm@loftninjas.org wrote:

On Mon, Apr 9, 2012 at 12:36 PM, Paul Welch pwelch2004@gmail.com wrote:

If im not mistaken it looks like an issue talking to Solr. However, I
am not sure why it would work on initial install but stop working
later...

Anything interesting in the solr log? Usually /var/log/chef/solr.log.

Bryan

--
Paul Welch
pwelch2004@gmail.com
+1.352.327.8087

Kallen · April 9, 2012, 6:55pm

i suspect the following 2 dirs have the wrong permissions: /var/run/chef
and /var/log/chef. wrong in that they are root:root owned. if you chown
them to chef:chef, restart chef-solr, it should fix this.

i keep running into this problem where chef-solr dies for whatever reason,
and for reasons i haven't figured out yet, these 2 dirs get root:root
pwned.

anyone know why these bad perms keep getting laid down?

i'm about to cron a babysitter script to restart chef-solr and keep
these dirs chowned properly :<

(yes, the chef-server recipe i run on my chef server managers proper
perms on these dirs, but something else flips them back to root:root)

kallen

On Mon, 09 Apr 2012, Paul Welch wrote:

Output from my /var/log/chef/solr.log:

[Mon, 09 Apr 2012 12:45:04 -0400] INFO: About to change privilege to chef:chef
[Mon, 09 Apr 2012 12:45:04 -0400] INFO: Daemonizing..
[Mon, 09 Apr 2012 12:45:04 -0400] INFO: Forked, in 895. Priveleges: 107 115
[Mon, 09 Apr 2012 12:45:04 -0400] INFO: Starting Solr with java
-Xmx256M -Xms256M -Dsolr.data.dir=/var/cache/chef/solr/data
-Dsolr.solr.home=/var/lib/chef/solr
-DSTART=/var/lib/chef/solr/solr-jetty/etc/start.config -jar
/var/lib/chef/solr/solr-jetty/start.jar
1 [main] INFO org.mortbay.log - Logging to
org.slf4j.impl.SimpleLogger(org.mortbay.log) via
org.mortbay.log.Slf4jLog
196 [main] INFO org.mortbay.log - jetty-6.1.22
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in
[jar:file:/usr/share/java/slf4j-simple-1.5.10.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in
[jar:file:/var/lib/chef/solr/solr-jetty/webapps/solr/WEB-INF/lib/slf4j-jdk14.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See SLF4J Error Codes for an explanation.
Apr 9, 2012 12:45:17 PM org.apache.solr.core.SolrResourceLoader locateSolrHome
INFO: No /solr/home in JNDI
Apr 9, 2012 12:45:17 PM org.apache.solr.core.SolrResourceLoader locateSolrHome
INFO: using system property solr.solr.home: /var/lib/chef/solr
Apr 9, 2012 12:45:17 PM org.apache.solr.core.SolrResourceLoader
INFO: Solr home set to '/var/lib/chef/solr/'
Apr 9, 2012 12:45:17 PM org.apache.solr.servlet.SolrDispatchFilter init
INFO: SolrDispatchFilter.init()
Apr 9, 2012 12:45:17 PM org.apache.solr.core.SolrResourceLoader locateSolrHome
INFO: No /solr/home in JNDI
Apr 9, 2012 12:45:17 PM org.apache.solr.core.SolrResourceLoader locateSolrHome
INFO: using system property solr.solr.home: /var/lib/chef/solr
Apr 9, 2012 12:45:17 PM org.apache.solr.core.CoreContainer$Initializer
initialize
INFO: looking for solr.xml: /var/lib/chef/solr/solr.xml
Apr 9, 2012 12:45:17 PM org.apache.solr.core.SolrResourceLoader
INFO: Solr home set to '/var/lib/chef/solr/'
Apr 9, 2012 12:45:17 PM org.apache.solr.core.SolrConfig
INFO: Loaded SolrConfig: solrconfig.xml
Apr 9, 2012 12:45:17 PM org.apache.solr.core.SolrCore
INFO: Opening new SolrCore at /var/lib/chef/solr/,
dataDir=/var/cache/chef/solr/data/
Apr 9, 2012 12:45:17 PM org.apache.solr.schema.IndexSchema readSchema
INFO: Reading Solr Schema
Apr 9, 2012 12:45:17 PM org.apache.solr.schema.IndexSchema readSchema
INFO: Schema name=chef
Apr 9, 2012 12:45:17 PM org.apache.solr.util.plugin.AbstractPluginLoader load
INFO: created string: org.apache.solr.schema.StrField
Apr 9, 2012 12:45:17 PM org.apache.solr.util.plugin.AbstractPluginLoader load
INFO: created boolean: org.apache.solr.schema.BoolField
Apr 9, 2012 12:45:17 PM org.apache.solr.util.plugin.AbstractPluginLoader load
INFO: created integer: org.apache.solr.schema.IntField
Apr 9, 2012 12:45:17 PM org.apache.solr.util.plugin.AbstractPluginLoader load
INFO: created long: org.apache.solr.schema.LongField
Apr 9, 2012 12:45:17 PM org.apache.solr.util.plugin.AbstractPluginLoader load
INFO: created float: org.apache.solr.schema.FloatField
Apr 9, 2012 12:45:17 PM org.apache.solr.util.plugin.AbstractPluginLoader load
INFO: created double: org.apache.solr.schema.DoubleField
Apr 9, 2012 12:45:18 PM org.apache.solr.util.plugin.AbstractPluginLoader load
INFO: created sint: org.apache.solr.schema.SortableIntField
Apr 9, 2012 12:45:18 PM org.apache.solr.util.plugin.AbstractPluginLoader load
INFO: created slong: org.apache.solr.schema.SortableLongField
Apr 9, 2012 12:45:18 PM org.apache.solr.util.plugin.AbstractPluginLoader load
INFO: created sfloat: org.apache.solr.schema.SortableFloatField
Apr 9, 2012 12:45:18 PM org.apache.solr.util.plugin.AbstractPluginLoader load
INFO: created sdouble: org.apache.solr.schema.SortableDoubleField
Apr 9, 2012 12:45:18 PM org.apache.solr.util.plugin.AbstractPluginLoader load
INFO: created stuff: org.apache.solr.schema.TextField
Apr 9, 2012 12:45:18 PM org.apache.solr.util.plugin.AbstractPluginLoader load
INFO: created date: org.apache.solr.schema.DateField
Apr 9, 2012 12:45:18 PM org.apache.solr.schema.IndexSchema readSchema
INFO: default search field is content
Apr 9, 2012 12:45:18 PM org.apache.solr.schema.IndexSchema readSchema
INFO: query parser default operator is OR
Apr 9, 2012 12:45:18 PM org.apache.solr.schema.IndexSchema readSchema
INFO: unique key field: X_CHEF_id_CHEF_X
Apr 9, 2012 12:45:18 PM org.apache.solr.core.JmxMonitoredMap
INFO: No JMX servers found, not exposing Solr information with JMX.
Apr 9, 2012 12:45:18 PM org.apache.solr.core.RequestHandlers
initHandlersFromConfig
INFO: created standard: solr.SearchHandler
Apr 9, 2012 12:45:18 PM org.apache.solr.core.RequestHandlers
initHandlersFromConfig
INFO: created /update: solr.XmlUpdateRequestHandler
Apr 9, 2012 12:45:18 PM org.apache.solr.core.RequestHandlers
initHandlersFromConfig
INFO: created /update/javabin: solr.BinaryUpdateRequestHandler
Apr 9, 2012 12:45:18 PM org.apache.solr.core.RequestHandlers
initHandlersFromConfig
INFO: created /analysis/document: solr.DocumentAnalysisRequestHandler
Apr 9, 2012 12:45:18 PM org.apache.solr.core.RequestHandlers
initHandlersFromConfig
INFO: created /analysis/field: solr.FieldAnalysisRequestHandler
Apr 9, 2012 12:45:18 PM org.apache.solr.core.RequestHandlers
initHandlersFromConfig
INFO: adding lazy requestHandler: solr.CSVRequestHandler
Apr 9, 2012 12:45:18 PM org.apache.solr.core.RequestHandlers
initHandlersFromConfig
INFO: created /update/csv: solr.CSVRequestHandler
Apr 9, 2012 12:45:18 PM org.apache.solr.core.RequestHandlers
initHandlersFromConfig
INFO: created /admin/: org.apache.solr.handler.admin.AdminHandlers
Apr 9, 2012 12:45:18 PM org.apache.solr.core.RequestHandlers
initHandlersFromConfig
INFO: created /admin/ping: PingRequestHandler
Apr 9, 2012 12:45:18 PM org.apache.solr.core.RequestHandlers
initHandlersFromConfig
INFO: created /debug/dump: solr.DumpRequestHandler
Apr 9, 2012 12:45:18 PM org.apache.solr.search.SolrIndexSearcher
INFO: Opening Searcher@64a7c45e main
Apr 9, 2012 12:45:18 PM
org.apache.solr.update.DirectUpdateHandler2$CommitTracker
INFO: AutoCommit: if uncommited for 10000ms; if 100 uncommited docs
Apr 9, 2012 12:45:18 PM org.apache.solr.handler.component.SearchHandler inform
INFO: Adding component:org.apache.solr.handler.component.QueryComponent@1dc18a4c
Apr 9, 2012 12:45:18 PM org.apache.solr.handler.component.SearchHandler inform
INFO: Adding component:org.apache.solr.handler.component.FacetComponent@d5e92d7
Apr 9, 2012 12:45:18 PM org.apache.solr.handler.component.SearchHandler inform
INFO: Adding component:org.apache.solr.handler.component.MoreLikeThisComponent@3bfa681c
Apr 9, 2012 12:45:18 PM org.apache.solr.handler.component.SearchHandler inform
INFO: Adding component:org.apache.solr.handler.component.HighlightComponent@34c92507
Apr 9, 2012 12:45:18 PM org.apache.solr.handler.component.SearchHandler inform
INFO: Adding component:org.apache.solr.handler.component.StatsComponent@19e09a4
Apr 9, 2012 12:45:18 PM org.apache.solr.handler.component.SearchHandler inform
INFO: Adding debug
component:org.apache.solr.handler.component.DebugComponent@2e8aeed0
Apr 9, 2012 12:45:18 PM org.apache.solr.core.SolrCore registerSearcher
INFO: Registered new searcher Searcher@64a7c45e main
Apr 9, 2012 12:45:18 PM org.apache.solr.core.CoreContainer register
INFO: registering core:
Apr 9, 2012 12:45:18 PM org.apache.solr.servlet.SolrDispatchFilter init
INFO: user.dir=/var/lib/chef/solr/solr-jetty
Apr 9, 2012 12:45:18 PM org.apache.solr.servlet.SolrDispatchFilter init
INFO: SolrDispatchFilter.init() done
Apr 9, 2012 12:45:18 PM org.apache.solr.servlet.SolrServlet init
INFO: SolrServlet.init()
Apr 9, 2012 12:45:18 PM org.apache.solr.core.SolrResourceLoader locateSolrHome
INFO: No /solr/home in JNDI
Apr 9, 2012 12:45:18 PM org.apache.solr.core.SolrResourceLoader locateSolrHome
INFO: using system property solr.solr.home: /var/lib/chef/solr
Apr 9, 2012 12:45:18 PM org.apache.solr.servlet.SolrServlet init
INFO: SolrServlet.init() done
Apr 9, 2012 12:45:18 PM org.apache.solr.core.SolrResourceLoader locateSolrHome
INFO: No /solr/home in JNDI
Apr 9, 2012 12:45:18 PM org.apache.solr.core.SolrResourceLoader locateSolrHome
INFO: using system property solr.solr.home: /var/lib/chef/solr
Apr 9, 2012 12:45:18 PM org.apache.solr.servlet.SolrUpdateServlet init
INFO: SolrUpdateServlet.init() done
13144 [main] WARN org.mortbay.log - failed
org.mortbay.jetty.NCSARequestLog@28ae4646: java.io.IOException: Cannot
write log directory /var/log/chef
13144 [main] WARN org.mortbay.log - failed RequestLogHandler@4987b287:
java.io.IOException: Cannot write log directory /var/log/chef
13144 [main] WARN org.mortbay.log - failed HandlerCollection@6bd9e2c7:
java.io.IOException: Cannot write log directory /var/log/chef
13144 [main] WARN org.mortbay.log - Error starting handlers
java.io.IOException: Cannot write log directory /var/log/chef
at org.mortbay.util.RolloverFileOutputStream.setFile(RolloverFileOutputStream.java:217)
at org.mortbay.util.RolloverFileOutputStream.(RolloverFileOutputStream.java:164)
at org.mortbay.jetty.NCSARequestLog.doStart(NCSARequestLog.java:428)
at org.mortbay.component.AbstractLifeCycle.start(AbstractLifeCycle.java:50)
at org.mortbay.jetty.handler.RequestLogHandler.doStart(RequestLogHandler.java:117)
at org.mortbay.component.AbstractLifeCycle.start(AbstractLifeCycle.java:50)
at org.mortbay.jetty.handler.HandlerCollection.doStart(HandlerCollection.java:152)
at org.mortbay.component.AbstractLifeCycle.start(AbstractLifeCycle.java:50)
at org.mortbay.jetty.handler.HandlerWrapper.doStart(HandlerWrapper.java:130)
at org.mortbay.jetty.Server.doStart(Server.java:224)
at org.mortbay.component.AbstractLifeCycle.start(AbstractLifeCycle.java:50)
at org.mortbay.xml.XmlConfiguration.main(XmlConfiguration.java:985)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:616)
at org.mortbay.start.Main.invokeMain(Main.java:194)
at org.mortbay.start.Main.start(Main.java:534)
at org.mortbay.start.Main.start(Main.java:441)
at org.mortbay.start.Main.main(Main.java:119)
13164 [main] INFO org.mortbay.log - Started SocketConnector@127.0.0.1:8983

On Mon, Apr 9, 2012 at 2:04 PM, Bryan McLellan btm@loftninjas.org wrote:

On Mon, Apr 9, 2012 at 12:36 PM, Paul Welch pwelch2004@gmail.com wrote:

If im not mistaken it looks like an issue talking to Solr. However, I
am not sure why it would work on initial install but stop working
later...

Anything interesting in the solr log? Usually /var/log/chef/solr.log.

Bryan

--
Paul Welch
pwelch2004@gmail.com
+1.352.327.8087

Paul_Welch · April 9, 2012, 7:09pm

kallen,

Thank you! you confirmed what I was about to start messing with but I
was unsure which directories chef should have rights on. There was a
permission issue on /var/log/chef... Changed ownership from root:root
to chef:chef and restarted. Search function restored.

I can confirm that that this has happened on two different
chef-servers. Would be interested in hearing the answer to kallen's
question.

On Mon, Apr 9, 2012 at 2:55 PM, kallen@groknaut.net wrote:

i suspect the following 2 dirs have the wrong permissions: /var/run/chef
and /var/log/chef. wrong in that they are root:root owned. if you chown
them to chef:chef, restart chef-solr, it should fix this.

i keep running into this problem where chef-solr dies for whatever reason,
and for reasons i haven't figured out yet, these 2 dirs get root:root
pwned.

anyone know why these bad perms keep getting laid down?

i'm about to cron a babysitter script to restart chef-solr and keep
these dirs chowned properly :<

(yes, the chef-server recipe i run on my chef server managers proper
perms on these dirs, but something else flips them back to root:root)

kallen

On Mon, 09 Apr 2012, Paul Welch wrote:

Output from my /var/log/chef/solr.log:

[Mon, 09 Apr 2012 12:45:04 -0400] INFO: About to change privilege to chef:chef
[Mon, 09 Apr 2012 12:45:04 -0400] INFO: Daemonizing..
[Mon, 09 Apr 2012 12:45:04 -0400] INFO: Forked, in 895. Priveleges: 107 115
[Mon, 09 Apr 2012 12:45:04 -0400] INFO: Starting Solr with java
-Xmx256M -Xms256M -Dsolr.data.dir=/var/cache/chef/solr/data
-Dsolr.solr.home=/var/lib/chef/solr
-DSTART=/var/lib/chef/solr/solr-jetty/etc/start.config -jar
/var/lib/chef/solr/solr-jetty/start.jar
1 [main] INFO org.mortbay.log - Logging to
org.slf4j.impl.SimpleLogger(org.mortbay.log) via
org.mortbay.log.Slf4jLog
196 [main] INFO org.mortbay.log - jetty-6.1.22
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in
[jar:file:/usr/share/java/slf4j-simple-1.5.10.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in
[jar:file:/var/lib/chef/solr/solr-jetty/webapps/solr/WEB-INF/lib/slf4j-jdk14.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See SLF4J Error Codes for an explanation.
Apr 9, 2012 12:45:17 PM org.apache.solr.core.SolrResourceLoader locateSolrHome
INFO: No /solr/home in JNDI
Apr 9, 2012 12:45:17 PM org.apache.solr.core.SolrResourceLoader locateSolrHome
INFO: using system property solr.solr.home: /var/lib/chef/solr
Apr 9, 2012 12:45:17 PM org.apache.solr.core.SolrResourceLoader
INFO: Solr home set to '/var/lib/chef/solr/'
Apr 9, 2012 12:45:17 PM org.apache.solr.servlet.SolrDispatchFilter init
INFO: SolrDispatchFilter.init()
Apr 9, 2012 12:45:17 PM org.apache.solr.core.SolrResourceLoader locateSolrHome
INFO: No /solr/home in JNDI
Apr 9, 2012 12:45:17 PM org.apache.solr.core.SolrResourceLoader locateSolrHome
INFO: using system property solr.solr.home: /var/lib/chef/solr
Apr 9, 2012 12:45:17 PM org.apache.solr.core.CoreContainer$Initializer
initialize
INFO: looking for solr.xml: /var/lib/chef/solr/solr.xml
Apr 9, 2012 12:45:17 PM org.apache.solr.core.SolrResourceLoader
INFO: Solr home set to '/var/lib/chef/solr/'
Apr 9, 2012 12:45:17 PM org.apache.solr.core.SolrConfig
INFO: Loaded SolrConfig: solrconfig.xml
Apr 9, 2012 12:45:17 PM org.apache.solr.core.SolrCore
INFO: Opening new SolrCore at /var/lib/chef/solr/,
dataDir=/var/cache/chef/solr/data/
Apr 9, 2012 12:45:17 PM org.apache.solr.schema.IndexSchema readSchema
INFO: Reading Solr Schema
Apr 9, 2012 12:45:17 PM org.apache.solr.schema.IndexSchema readSchema
INFO: Schema name=chef
Apr 9, 2012 12:45:17 PM org.apache.solr.util.plugin.AbstractPluginLoader load
INFO: created string: org.apache.solr.schema.StrField
Apr 9, 2012 12:45:17 PM org.apache.solr.util.plugin.AbstractPluginLoader load
INFO: created boolean: org.apache.solr.schema.BoolField
Apr 9, 2012 12:45:17 PM org.apache.solr.util.plugin.AbstractPluginLoader load
INFO: created integer: org.apache.solr.schema.IntField
Apr 9, 2012 12:45:17 PM org.apache.solr.util.plugin.AbstractPluginLoader load
INFO: created long: org.apache.solr.schema.LongField
Apr 9, 2012 12:45:17 PM org.apache.solr.util.plugin.AbstractPluginLoader load
INFO: created float: org.apache.solr.schema.FloatField
Apr 9, 2012 12:45:17 PM org.apache.solr.util.plugin.AbstractPluginLoader load
INFO: created double: org.apache.solr.schema.DoubleField
Apr 9, 2012 12:45:18 PM org.apache.solr.util.plugin.AbstractPluginLoader load
INFO: created sint: org.apache.solr.schema.SortableIntField
Apr 9, 2012 12:45:18 PM org.apache.solr.util.plugin.AbstractPluginLoader load
INFO: created slong: org.apache.solr.schema.SortableLongField
Apr 9, 2012 12:45:18 PM org.apache.solr.util.plugin.AbstractPluginLoader load
INFO: created sfloat: org.apache.solr.schema.SortableFloatField
Apr 9, 2012 12:45:18 PM org.apache.solr.util.plugin.AbstractPluginLoader load
INFO: created sdouble: org.apache.solr.schema.SortableDoubleField
Apr 9, 2012 12:45:18 PM org.apache.solr.util.plugin.AbstractPluginLoader load
INFO: created stuff: org.apache.solr.schema.TextField
Apr 9, 2012 12:45:18 PM org.apache.solr.util.plugin.AbstractPluginLoader load
INFO: created date: org.apache.solr.schema.DateField
Apr 9, 2012 12:45:18 PM org.apache.solr.schema.IndexSchema readSchema
INFO: default search field is content
Apr 9, 2012 12:45:18 PM org.apache.solr.schema.IndexSchema readSchema
INFO: query parser default operator is OR
Apr 9, 2012 12:45:18 PM org.apache.solr.schema.IndexSchema readSchema
INFO: unique key field: X_CHEF_id_CHEF_X
Apr 9, 2012 12:45:18 PM org.apache.solr.core.JmxMonitoredMap
INFO: No JMX servers found, not exposing Solr information with JMX.
Apr 9, 2012 12:45:18 PM org.apache.solr.core.RequestHandlers
initHandlersFromConfig
INFO: created standard: solr.SearchHandler
Apr 9, 2012 12:45:18 PM org.apache.solr.core.RequestHandlers
initHandlersFromConfig
INFO: created /update: solr.XmlUpdateRequestHandler
Apr 9, 2012 12:45:18 PM org.apache.solr.core.RequestHandlers
initHandlersFromConfig
INFO: created /update/javabin: solr.BinaryUpdateRequestHandler
Apr 9, 2012 12:45:18 PM org.apache.solr.core.RequestHandlers
initHandlersFromConfig
INFO: created /analysis/document: solr.DocumentAnalysisRequestHandler
Apr 9, 2012 12:45:18 PM org.apache.solr.core.RequestHandlers
initHandlersFromConfig
INFO: created /analysis/field: solr.FieldAnalysisRequestHandler
Apr 9, 2012 12:45:18 PM org.apache.solr.core.RequestHandlers
initHandlersFromConfig
INFO: adding lazy requestHandler: solr.CSVRequestHandler
Apr 9, 2012 12:45:18 PM org.apache.solr.core.RequestHandlers
initHandlersFromConfig
INFO: created /update/csv: solr.CSVRequestHandler
Apr 9, 2012 12:45:18 PM org.apache.solr.core.RequestHandlers
initHandlersFromConfig
INFO: created /admin/: org.apache.solr.handler.admin.AdminHandlers
Apr 9, 2012 12:45:18 PM org.apache.solr.core.RequestHandlers
initHandlersFromConfig
INFO: created /admin/ping: PingRequestHandler
Apr 9, 2012 12:45:18 PM org.apache.solr.core.RequestHandlers
initHandlersFromConfig
INFO: created /debug/dump: solr.DumpRequestHandler
Apr 9, 2012 12:45:18 PM org.apache.solr.search.SolrIndexSearcher
INFO: Opening Searcher@64a7c45e main
Apr 9, 2012 12:45:18 PM
org.apache.solr.update.DirectUpdateHandler2$CommitTracker
INFO: AutoCommit: if uncommited for 10000ms; if 100 uncommited docs
Apr 9, 2012 12:45:18 PM org.apache.solr.handler.component.SearchHandler inform
INFO: Adding component:org.apache.solr.handler.component.QueryComponent@1dc18a4c
Apr 9, 2012 12:45:18 PM org.apache.solr.handler.component.SearchHandler inform
INFO: Adding component:org.apache.solr.handler.component.FacetComponent@d5e92d7
Apr 9, 2012 12:45:18 PM org.apache.solr.handler.component.SearchHandler inform
INFO: Adding component:org.apache.solr.handler.component.MoreLikeThisComponent@3bfa681c
Apr 9, 2012 12:45:18 PM org.apache.solr.handler.component.SearchHandler inform
INFO: Adding component:org.apache.solr.handler.component.HighlightComponent@34c92507
Apr 9, 2012 12:45:18 PM org.apache.solr.handler.component.SearchHandler inform
INFO: Adding component:org.apache.solr.handler.component.StatsComponent@19e09a4
Apr 9, 2012 12:45:18 PM org.apache.solr.handler.component.SearchHandler inform
INFO: Adding debug
component:org.apache.solr.handler.component.DebugComponent@2e8aeed0
Apr 9, 2012 12:45:18 PM org.apache.solr.core.SolrCore registerSearcher
INFO: Registered new searcher Searcher@64a7c45e main
Apr 9, 2012 12:45:18 PM org.apache.solr.core.CoreContainer register
INFO: registering core:
Apr 9, 2012 12:45:18 PM org.apache.solr.servlet.SolrDispatchFilter init
INFO: user.dir=/var/lib/chef/solr/solr-jetty
Apr 9, 2012 12:45:18 PM org.apache.solr.servlet.SolrDispatchFilter init
INFO: SolrDispatchFilter.init() done
Apr 9, 2012 12:45:18 PM org.apache.solr.servlet.SolrServlet init
INFO: SolrServlet.init()
Apr 9, 2012 12:45:18 PM org.apache.solr.core.SolrResourceLoader locateSolrHome
INFO: No /solr/home in JNDI
Apr 9, 2012 12:45:18 PM org.apache.solr.core.SolrResourceLoader locateSolrHome
INFO: using system property solr.solr.home: /var/lib/chef/solr
Apr 9, 2012 12:45:18 PM org.apache.solr.servlet.SolrServlet init
INFO: SolrServlet.init() done
Apr 9, 2012 12:45:18 PM org.apache.solr.core.SolrResourceLoader locateSolrHome
INFO: No /solr/home in JNDI
Apr 9, 2012 12:45:18 PM org.apache.solr.core.SolrResourceLoader locateSolrHome
INFO: using system property solr.solr.home: /var/lib/chef/solr
Apr 9, 2012 12:45:18 PM org.apache.solr.servlet.SolrUpdateServlet init
INFO: SolrUpdateServlet.init() done
13144 [main] WARN org.mortbay.log - failed
org.mortbay.jetty.NCSARequestLog@28ae4646: java.io.IOException: Cannot
write log directory /var/log/chef
13144 [main] WARN org.mortbay.log - failed RequestLogHandler@4987b287:
java.io.IOException: Cannot write log directory /var/log/chef
13144 [main] WARN org.mortbay.log - failed HandlerCollection@6bd9e2c7:
java.io.IOException: Cannot write log directory /var/log/chef
13144 [main] WARN org.mortbay.log - Error starting handlers
java.io.IOException: Cannot write log directory /var/log/chef
at org.mortbay.util.RolloverFileOutputStream.setFile(RolloverFileOutputStream.java:217)
at org.mortbay.util.RolloverFileOutputStream.(RolloverFileOutputStream.java:164)
at org.mortbay.jetty.NCSARequestLog.doStart(NCSARequestLog.java:428)
at org.mortbay.component.AbstractLifeCycle.start(AbstractLifeCycle.java:50)
at org.mortbay.jetty.handler.RequestLogHandler.doStart(RequestLogHandler.java:117)
at org.mortbay.component.AbstractLifeCycle.start(AbstractLifeCycle.java:50)
at org.mortbay.jetty.handler.HandlerCollection.doStart(HandlerCollection.java:152)
at org.mortbay.component.AbstractLifeCycle.start(AbstractLifeCycle.java:50)
at org.mortbay.jetty.handler.HandlerWrapper.doStart(HandlerWrapper.java:130)
at org.mortbay.jetty.Server.doStart(Server.java:224)
at org.mortbay.component.AbstractLifeCycle.start(AbstractLifeCycle.java:50)
at org.mortbay.xml.XmlConfiguration.main(XmlConfiguration.java:985)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:616)
at org.mortbay.start.Main.invokeMain(Main.java:194)
at org.mortbay.start.Main.start(Main.java:534)
at org.mortbay.start.Main.start(Main.java:441)
at org.mortbay.start.Main.main(Main.java:119)
13164 [main] INFO org.mortbay.log - Started SocketConnector@127.0.0.1:8983

On Mon, Apr 9, 2012 at 2:04 PM, Bryan McLellan btm@loftninjas.org wrote:

On Mon, Apr 9, 2012 at 12:36 PM, Paul Welch pwelch2004@gmail.com wrote:

If im not mistaken it looks like an issue talking to Solr. However, I
am not sure why it would work on initial install but stop working
later...

Anything interesting in the solr log? Usually /var/log/chef/solr.log.

Bryan

--
Paul Welch
pwelch2004@gmail.com
+1.352.327.8087

--
Paul Welch
pwelch2004@gmail.com
+1.352.327.8087

Kallen · April 9, 2012, 7:21pm

hi. i thought i'd update subject in case it helps get more eyeballs
on this. the details are right here:

On Mon, 09 Apr 2012, kallen@groknaut.net wrote:

i suspect the following 2 dirs have the wrong permissions: /var/run/chef
and /var/log/chef. wrong in that they are root:root owned. if you chown
them to chef:chef, restart chef-solr, it should fix this.

i keep running into this problem where chef-solr dies for whatever reason,
and for reasons i haven't figured out yet, these 2 dirs get root:root
pwned.

anyone know why these bad perms keep getting laid down?

i'm about to cron a babysitter script to restart chef-solr and keep
these dirs chowned properly :<

(yes, the chef-server recipe i run on my chef server managers proper
perms on these dirs, but something else flips them back to root:root)

kallen

On Mon, 09 Apr 2012, Paul Welch wrote:

Output from my /var/log/chef/solr.log:

[Mon, 09 Apr 2012 12:45:04 -0400] INFO: About to change privilege to chef:chef
[Mon, 09 Apr 2012 12:45:04 -0400] INFO: Daemonizing..
[Mon, 09 Apr 2012 12:45:04 -0400] INFO: Forked, in 895. Priveleges: 107 115
[Mon, 09 Apr 2012 12:45:04 -0400] INFO: Starting Solr with java
-Xmx256M -Xms256M -Dsolr.data.dir=/var/cache/chef/solr/data
-Dsolr.solr.home=/var/lib/chef/solr
-DSTART=/var/lib/chef/solr/solr-jetty/etc/start.config -jar
/var/lib/chef/solr/solr-jetty/start.jar
1 [main] INFO org.mortbay.log - Logging to
org.slf4j.impl.SimpleLogger(org.mortbay.log) via
org.mortbay.log.Slf4jLog
196 [main] INFO org.mortbay.log - jetty-6.1.22
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in
[jar:file:/usr/share/java/slf4j-simple-1.5.10.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in
[jar:file:/var/lib/chef/solr/solr-jetty/webapps/solr/WEB-INF/lib/slf4j-jdk14.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See SLF4J Error Codes for an explanation.
Apr 9, 2012 12:45:17 PM org.apache.solr.core.SolrResourceLoader locateSolrHome
INFO: No /solr/home in JNDI
Apr 9, 2012 12:45:17 PM org.apache.solr.core.SolrResourceLoader locateSolrHome
INFO: using system property solr.solr.home: /var/lib/chef/solr
Apr 9, 2012 12:45:17 PM org.apache.solr.core.SolrResourceLoader
INFO: Solr home set to '/var/lib/chef/solr/'
Apr 9, 2012 12:45:17 PM org.apache.solr.servlet.SolrDispatchFilter init
INFO: SolrDispatchFilter.init()
Apr 9, 2012 12:45:17 PM org.apache.solr.core.SolrResourceLoader locateSolrHome
INFO: No /solr/home in JNDI
Apr 9, 2012 12:45:17 PM org.apache.solr.core.SolrResourceLoader locateSolrHome
INFO: using system property solr.solr.home: /var/lib/chef/solr
Apr 9, 2012 12:45:17 PM org.apache.solr.core.CoreContainer$Initializer
initialize
INFO: looking for solr.xml: /var/lib/chef/solr/solr.xml
Apr 9, 2012 12:45:17 PM org.apache.solr.core.SolrResourceLoader
INFO: Solr home set to '/var/lib/chef/solr/'
Apr 9, 2012 12:45:17 PM org.apache.solr.core.SolrConfig
INFO: Loaded SolrConfig: solrconfig.xml
Apr 9, 2012 12:45:17 PM org.apache.solr.core.SolrCore
INFO: Opening new SolrCore at /var/lib/chef/solr/,
dataDir=/var/cache/chef/solr/data/
Apr 9, 2012 12:45:17 PM org.apache.solr.schema.IndexSchema readSchema
INFO: Reading Solr Schema
Apr 9, 2012 12:45:17 PM org.apache.solr.schema.IndexSchema readSchema
INFO: Schema name=chef
Apr 9, 2012 12:45:17 PM org.apache.solr.util.plugin.AbstractPluginLoader load
INFO: created string: org.apache.solr.schema.StrField
Apr 9, 2012 12:45:17 PM org.apache.solr.util.plugin.AbstractPluginLoader load
INFO: created boolean: org.apache.solr.schema.BoolField
Apr 9, 2012 12:45:17 PM org.apache.solr.util.plugin.AbstractPluginLoader load
INFO: created integer: org.apache.solr.schema.IntField
Apr 9, 2012 12:45:17 PM org.apache.solr.util.plugin.AbstractPluginLoader load
INFO: created long: org.apache.solr.schema.LongField
Apr 9, 2012 12:45:17 PM org.apache.solr.util.plugin.AbstractPluginLoader load
INFO: created float: org.apache.solr.schema.FloatField
Apr 9, 2012 12:45:17 PM org.apache.solr.util.plugin.AbstractPluginLoader load
INFO: created double: org.apache.solr.schema.DoubleField
Apr 9, 2012 12:45:18 PM org.apache.solr.util.plugin.AbstractPluginLoader load
INFO: created sint: org.apache.solr.schema.SortableIntField
Apr 9, 2012 12:45:18 PM org.apache.solr.util.plugin.AbstractPluginLoader load
INFO: created slong: org.apache.solr.schema.SortableLongField
Apr 9, 2012 12:45:18 PM org.apache.solr.util.plugin.AbstractPluginLoader load
INFO: created sfloat: org.apache.solr.schema.SortableFloatField
Apr 9, 2012 12:45:18 PM org.apache.solr.util.plugin.AbstractPluginLoader load
INFO: created sdouble: org.apache.solr.schema.SortableDoubleField
Apr 9, 2012 12:45:18 PM org.apache.solr.util.plugin.AbstractPluginLoader load
INFO: created stuff: org.apache.solr.schema.TextField
Apr 9, 2012 12:45:18 PM org.apache.solr.util.plugin.AbstractPluginLoader load
INFO: created date: org.apache.solr.schema.DateField
Apr 9, 2012 12:45:18 PM org.apache.solr.schema.IndexSchema readSchema
INFO: default search field is content
Apr 9, 2012 12:45:18 PM org.apache.solr.schema.IndexSchema readSchema
INFO: query parser default operator is OR
Apr 9, 2012 12:45:18 PM org.apache.solr.schema.IndexSchema readSchema
INFO: unique key field: X_CHEF_id_CHEF_X
Apr 9, 2012 12:45:18 PM org.apache.solr.core.JmxMonitoredMap
INFO: No JMX servers found, not exposing Solr information with JMX.
Apr 9, 2012 12:45:18 PM org.apache.solr.core.RequestHandlers
initHandlersFromConfig
INFO: created standard: solr.SearchHandler
Apr 9, 2012 12:45:18 PM org.apache.solr.core.RequestHandlers
initHandlersFromConfig
INFO: created /update: solr.XmlUpdateRequestHandler
Apr 9, 2012 12:45:18 PM org.apache.solr.core.RequestHandlers
initHandlersFromConfig
INFO: created /update/javabin: solr.BinaryUpdateRequestHandler
Apr 9, 2012 12:45:18 PM org.apache.solr.core.RequestHandlers
initHandlersFromConfig
INFO: created /analysis/document: solr.DocumentAnalysisRequestHandler
Apr 9, 2012 12:45:18 PM org.apache.solr.core.RequestHandlers
initHandlersFromConfig
INFO: created /analysis/field: solr.FieldAnalysisRequestHandler
Apr 9, 2012 12:45:18 PM org.apache.solr.core.RequestHandlers
initHandlersFromConfig
INFO: adding lazy requestHandler: solr.CSVRequestHandler
Apr 9, 2012 12:45:18 PM org.apache.solr.core.RequestHandlers
initHandlersFromConfig
INFO: created /update/csv: solr.CSVRequestHandler
Apr 9, 2012 12:45:18 PM org.apache.solr.core.RequestHandlers
initHandlersFromConfig
INFO: created /admin/: org.apache.solr.handler.admin.AdminHandlers
Apr 9, 2012 12:45:18 PM org.apache.solr.core.RequestHandlers
initHandlersFromConfig
INFO: created /admin/ping: PingRequestHandler
Apr 9, 2012 12:45:18 PM org.apache.solr.core.RequestHandlers
initHandlersFromConfig
INFO: created /debug/dump: solr.DumpRequestHandler
Apr 9, 2012 12:45:18 PM org.apache.solr.search.SolrIndexSearcher
INFO: Opening Searcher@64a7c45e main
Apr 9, 2012 12:45:18 PM
org.apache.solr.update.DirectUpdateHandler2$CommitTracker
INFO: AutoCommit: if uncommited for 10000ms; if 100 uncommited docs
Apr 9, 2012 12:45:18 PM org.apache.solr.handler.component.SearchHandler inform
INFO: Adding component:org.apache.solr.handler.component.QueryComponent@1dc18a4c
Apr 9, 2012 12:45:18 PM org.apache.solr.handler.component.SearchHandler inform
INFO: Adding component:org.apache.solr.handler.component.FacetComponent@d5e92d7
Apr 9, 2012 12:45:18 PM org.apache.solr.handler.component.SearchHandler inform
INFO: Adding component:org.apache.solr.handler.component.MoreLikeThisComponent@3bfa681c
Apr 9, 2012 12:45:18 PM org.apache.solr.handler.component.SearchHandler inform
INFO: Adding component:org.apache.solr.handler.component.HighlightComponent@34c92507
Apr 9, 2012 12:45:18 PM org.apache.solr.handler.component.SearchHandler inform
INFO: Adding component:org.apache.solr.handler.component.StatsComponent@19e09a4
Apr 9, 2012 12:45:18 PM org.apache.solr.handler.component.SearchHandler inform
INFO: Adding debug
component:org.apache.solr.handler.component.DebugComponent@2e8aeed0
Apr 9, 2012 12:45:18 PM org.apache.solr.core.SolrCore registerSearcher
INFO: Registered new searcher Searcher@64a7c45e main
Apr 9, 2012 12:45:18 PM org.apache.solr.core.CoreContainer register
INFO: registering core:
Apr 9, 2012 12:45:18 PM org.apache.solr.servlet.SolrDispatchFilter init
INFO: user.dir=/var/lib/chef/solr/solr-jetty
Apr 9, 2012 12:45:18 PM org.apache.solr.servlet.SolrDispatchFilter init
INFO: SolrDispatchFilter.init() done
Apr 9, 2012 12:45:18 PM org.apache.solr.servlet.SolrServlet init
INFO: SolrServlet.init()
Apr 9, 2012 12:45:18 PM org.apache.solr.core.SolrResourceLoader locateSolrHome
INFO: No /solr/home in JNDI
Apr 9, 2012 12:45:18 PM org.apache.solr.core.SolrResourceLoader locateSolrHome
INFO: using system property solr.solr.home: /var/lib/chef/solr
Apr 9, 2012 12:45:18 PM org.apache.solr.servlet.SolrServlet init
INFO: SolrServlet.init() done
Apr 9, 2012 12:45:18 PM org.apache.solr.core.SolrResourceLoader locateSolrHome
INFO: No /solr/home in JNDI
Apr 9, 2012 12:45:18 PM org.apache.solr.core.SolrResourceLoader locateSolrHome
INFO: using system property solr.solr.home: /var/lib/chef/solr
Apr 9, 2012 12:45:18 PM org.apache.solr.servlet.SolrUpdateServlet init
INFO: SolrUpdateServlet.init() done
13144 [main] WARN org.mortbay.log - failed
org.mortbay.jetty.NCSARequestLog@28ae4646: java.io.IOException: Cannot
write log directory /var/log/chef
13144 [main] WARN org.mortbay.log - failed RequestLogHandler@4987b287:
java.io.IOException: Cannot write log directory /var/log/chef
13144 [main] WARN org.mortbay.log - failed HandlerCollection@6bd9e2c7:
java.io.IOException: Cannot write log directory /var/log/chef
13144 [main] WARN org.mortbay.log - Error starting handlers
java.io.IOException: Cannot write log directory /var/log/chef
at org.mortbay.util.RolloverFileOutputStream.setFile(RolloverFileOutputStream.java:217)
at org.mortbay.util.RolloverFileOutputStream.(RolloverFileOutputStream.java:164)
at org.mortbay.jetty.NCSARequestLog.doStart(NCSARequestLog.java:428)
at org.mortbay.component.AbstractLifeCycle.start(AbstractLifeCycle.java:50)
at org.mortbay.jetty.handler.RequestLogHandler.doStart(RequestLogHandler.java:117)
at org.mortbay.component.AbstractLifeCycle.start(AbstractLifeCycle.java:50)
at org.mortbay.jetty.handler.HandlerCollection.doStart(HandlerCollection.java:152)
at org.mortbay.component.AbstractLifeCycle.start(AbstractLifeCycle.java:50)
at org.mortbay.jetty.handler.HandlerWrapper.doStart(HandlerWrapper.java:130)
at org.mortbay.jetty.Server.doStart(Server.java:224)
at org.mortbay.component.AbstractLifeCycle.start(AbstractLifeCycle.java:50)
at org.mortbay.xml.XmlConfiguration.main(XmlConfiguration.java:985)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:616)
at org.mortbay.start.Main.invokeMain(Main.java:194)
at org.mortbay.start.Main.start(Main.java:534)
at org.mortbay.start.Main.start(Main.java:441)
at org.mortbay.start.Main.main(Main.java:119)
13164 [main] INFO org.mortbay.log - Started SocketConnector@127.0.0.1:8983

On Mon, Apr 9, 2012 at 2:04 PM, Bryan McLellan btm@loftninjas.org wrote:

On Mon, Apr 9, 2012 at 12:36 PM, Paul Welch pwelch2004@gmail.com wrote:

If im not mistaken it looks like an issue talking to Solr. However, I
am not sure why it would work on initial install but stop working
later...

Anything interesting in the solr log? Usually /var/log/chef/solr.log.

Bryan

Chris · April 9, 2012, 8:09pm

Looking in /etc/init.d/chef-solr i see

[ -r /etc/default/$NAME ] && . /etc/default/$NAME

if [ ! -d /var/run/chef ]; then
mkdir /var/run/chef
chown $USER:$GROUP /var/run/chef
fi

and when i look in /etc/default/chef-solr:

USER=chef
GROUP=chef

This was the default installation for me. I wonder if your was set
root:root at some point.

On Mon, Apr 9, 2012 at 12:09 PM, Paul Welch pwelch2004@gmail.com wrote:

kallen,

Thank you! you confirmed what I was about to start messing with but I
was unsure which directories chef should have rights on. There was a
permission issue on /var/log/chef... Changed ownership from root:root
to chef:chef and restarted. Search function restored.

I can confirm that that this has happened on two different
chef-servers. Would be interested in hearing the answer to kallen's
question.

On Mon, Apr 9, 2012 at 2:55 PM, kallen@groknaut.net wrote:

i suspect the following 2 dirs have the wrong permissions: /var/run/chef
and /var/log/chef. wrong in that they are root:root owned. if you chown
them to chef:chef, restart chef-solr, it should fix this.

i keep running into this problem where chef-solr dies for whatever reason,
and for reasons i haven't figured out yet, these 2 dirs get root:root
pwned.

anyone know why these bad perms keep getting laid down?

i'm about to cron a babysitter script to restart chef-solr and keep
these dirs chowned properly :<

(yes, the chef-server recipe i run on my chef server managers proper
perms on these dirs, but something else flips them back to root:root)

kallen

On Mon, 09 Apr 2012, Paul Welch wrote:

Output from my /var/log/chef/solr.log:

[Mon, 09 Apr 2012 12:45:04 -0400] INFO: About to change privilege to chef:chef
[Mon, 09 Apr 2012 12:45:04 -0400] INFO: Daemonizing..
[Mon, 09 Apr 2012 12:45:04 -0400] INFO: Forked, in 895. Priveleges: 107 115
[Mon, 09 Apr 2012 12:45:04 -0400] INFO: Starting Solr with java
-Xmx256M -Xms256M -Dsolr.data.dir=/var/cache/chef/solr/data
-Dsolr.solr.home=/var/lib/chef/solr
-DSTART=/var/lib/chef/solr/solr-jetty/etc/start.config -jar
/var/lib/chef/solr/solr-jetty/start.jar
1 [main] INFO org.mortbay.log - Logging to
org.slf4j.impl.SimpleLogger(org.mortbay.log) via
org.mortbay.log.Slf4jLog
196 [main] INFO org.mortbay.log - jetty-6.1.22
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in
[jar:file:/usr/share/java/slf4j-simple-1.5.10.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in
[jar:file:/var/lib/chef/solr/solr-jetty/webapps/solr/WEB-INF/lib/slf4j-jdk14.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See SLF4J Error Codes for an explanation.
Apr 9, 2012 12:45:17 PM org.apache.solr.core.SolrResourceLoader locateSolrHome
INFO: No /solr/home in JNDI
Apr 9, 2012 12:45:17 PM org.apache.solr.core.SolrResourceLoader locateSolrHome
INFO: using system property solr.solr.home: /var/lib/chef/solr
Apr 9, 2012 12:45:17 PM org.apache.solr.core.SolrResourceLoader
INFO: Solr home set to '/var/lib/chef/solr/'
Apr 9, 2012 12:45:17 PM org.apache.solr.servlet.SolrDispatchFilter init
INFO: SolrDispatchFilter.init()
Apr 9, 2012 12:45:17 PM org.apache.solr.core.SolrResourceLoader locateSolrHome
INFO: No /solr/home in JNDI
Apr 9, 2012 12:45:17 PM org.apache.solr.core.SolrResourceLoader locateSolrHome
INFO: using system property solr.solr.home: /var/lib/chef/solr
Apr 9, 2012 12:45:17 PM org.apache.solr.core.CoreContainer$Initializer
initialize
INFO: looking for solr.xml: /var/lib/chef/solr/solr.xml
Apr 9, 2012 12:45:17 PM org.apache.solr.core.SolrResourceLoader
INFO: Solr home set to '/var/lib/chef/solr/'
Apr 9, 2012 12:45:17 PM org.apache.solr.core.SolrConfig
INFO: Loaded SolrConfig: solrconfig.xml
Apr 9, 2012 12:45:17 PM org.apache.solr.core.SolrCore
INFO: Opening new SolrCore at /var/lib/chef/solr/,
dataDir=/var/cache/chef/solr/data/
Apr 9, 2012 12:45:17 PM org.apache.solr.schema.IndexSchema readSchema
INFO: Reading Solr Schema
Apr 9, 2012 12:45:17 PM org.apache.solr.schema.IndexSchema readSchema
INFO: Schema name=chef
Apr 9, 2012 12:45:17 PM org.apache.solr.util.plugin.AbstractPluginLoader load
INFO: created string: org.apache.solr.schema.StrField
Apr 9, 2012 12:45:17 PM org.apache.solr.util.plugin.AbstractPluginLoader load
INFO: created boolean: org.apache.solr.schema.BoolField
Apr 9, 2012 12:45:17 PM org.apache.solr.util.plugin.AbstractPluginLoader load
INFO: created integer: org.apache.solr.schema.IntField
Apr 9, 2012 12:45:17 PM org.apache.solr.util.plugin.AbstractPluginLoader load
INFO: created long: org.apache.solr.schema.LongField
Apr 9, 2012 12:45:17 PM org.apache.solr.util.plugin.AbstractPluginLoader load
INFO: created float: org.apache.solr.schema.FloatField
Apr 9, 2012 12:45:17 PM org.apache.solr.util.plugin.AbstractPluginLoader load
INFO: created double: org.apache.solr.schema.DoubleField
Apr 9, 2012 12:45:18 PM org.apache.solr.util.plugin.AbstractPluginLoader load
INFO: created sint: org.apache.solr.schema.SortableIntField
Apr 9, 2012 12:45:18 PM org.apache.solr.util.plugin.AbstractPluginLoader load
INFO: created slong: org.apache.solr.schema.SortableLongField
Apr 9, 2012 12:45:18 PM org.apache.solr.util.plugin.AbstractPluginLoader load
INFO: created sfloat: org.apache.solr.schema.SortableFloatField
Apr 9, 2012 12:45:18 PM org.apache.solr.util.plugin.AbstractPluginLoader load
INFO: created sdouble: org.apache.solr.schema.SortableDoubleField
Apr 9, 2012 12:45:18 PM org.apache.solr.util.plugin.AbstractPluginLoader load
INFO: created stuff: org.apache.solr.schema.TextField
Apr 9, 2012 12:45:18 PM org.apache.solr.util.plugin.AbstractPluginLoader load
INFO: created date: org.apache.solr.schema.DateField
Apr 9, 2012 12:45:18 PM org.apache.solr.schema.IndexSchema readSchema
INFO: default search field is content
Apr 9, 2012 12:45:18 PM org.apache.solr.schema.IndexSchema readSchema
INFO: query parser default operator is OR
Apr 9, 2012 12:45:18 PM org.apache.solr.schema.IndexSchema readSchema
INFO: unique key field: X_CHEF_id_CHEF_X
Apr 9, 2012 12:45:18 PM org.apache.solr.core.JmxMonitoredMap
INFO: No JMX servers found, not exposing Solr information with JMX.
Apr 9, 2012 12:45:18 PM org.apache.solr.core.RequestHandlers
initHandlersFromConfig
INFO: created standard: solr.SearchHandler
Apr 9, 2012 12:45:18 PM org.apache.solr.core.RequestHandlers
initHandlersFromConfig
INFO: created /update: solr.XmlUpdateRequestHandler
Apr 9, 2012 12:45:18 PM org.apache.solr.core.RequestHandlers
initHandlersFromConfig
INFO: created /update/javabin: solr.BinaryUpdateRequestHandler
Apr 9, 2012 12:45:18 PM org.apache.solr.core.RequestHandlers
initHandlersFromConfig
INFO: created /analysis/document: solr.DocumentAnalysisRequestHandler
Apr 9, 2012 12:45:18 PM org.apache.solr.core.RequestHandlers
initHandlersFromConfig
INFO: created /analysis/field: solr.FieldAnalysisRequestHandler
Apr 9, 2012 12:45:18 PM org.apache.solr.core.RequestHandlers
initHandlersFromConfig
INFO: adding lazy requestHandler: solr.CSVRequestHandler
Apr 9, 2012 12:45:18 PM org.apache.solr.core.RequestHandlers
initHandlersFromConfig
INFO: created /update/csv: solr.CSVRequestHandler
Apr 9, 2012 12:45:18 PM org.apache.solr.core.RequestHandlers
initHandlersFromConfig
INFO: created /admin/: org.apache.solr.handler.admin.AdminHandlers
Apr 9, 2012 12:45:18 PM org.apache.solr.core.RequestHandlers
initHandlersFromConfig
INFO: created /admin/ping: PingRequestHandler
Apr 9, 2012 12:45:18 PM org.apache.solr.core.RequestHandlers
initHandlersFromConfig
INFO: created /debug/dump: solr.DumpRequestHandler
Apr 9, 2012 12:45:18 PM org.apache.solr.search.SolrIndexSearcher
INFO: Opening Searcher@64a7c45e main
Apr 9, 2012 12:45:18 PM
org.apache.solr.update.DirectUpdateHandler2$CommitTracker
INFO: AutoCommit: if uncommited for 10000ms; if 100 uncommited docs
Apr 9, 2012 12:45:18 PM org.apache.solr.handler.component.SearchHandler inform
INFO: Adding component:org.apache.solr.handler.component.QueryComponent@1dc18a4c
Apr 9, 2012 12:45:18 PM org.apache.solr.handler.component.SearchHandler inform
INFO: Adding component:org.apache.solr.handler.component.FacetComponent@d5e92d7
Apr 9, 2012 12:45:18 PM org.apache.solr.handler.component.SearchHandler inform
INFO: Adding component:org.apache.solr.handler.component.MoreLikeThisComponent@3bfa681c
Apr 9, 2012 12:45:18 PM org.apache.solr.handler.component.SearchHandler inform
INFO: Adding component:org.apache.solr.handler.component.HighlightComponent@34c92507
Apr 9, 2012 12:45:18 PM org.apache.solr.handler.component.SearchHandler inform
INFO: Adding component:org.apache.solr.handler.component.StatsComponent@19e09a4
Apr 9, 2012 12:45:18 PM org.apache.solr.handler.component.SearchHandler inform
INFO: Adding debug
component:org.apache.solr.handler.component.DebugComponent@2e8aeed0
Apr 9, 2012 12:45:18 PM org.apache.solr.core.SolrCore registerSearcher
INFO: Registered new searcher Searcher@64a7c45e main
Apr 9, 2012 12:45:18 PM org.apache.solr.core.CoreContainer register
INFO: registering core:
Apr 9, 2012 12:45:18 PM org.apache.solr.servlet.SolrDispatchFilter init
INFO: user.dir=/var/lib/chef/solr/solr-jetty
Apr 9, 2012 12:45:18 PM org.apache.solr.servlet.SolrDispatchFilter init
INFO: SolrDispatchFilter.init() done
Apr 9, 2012 12:45:18 PM org.apache.solr.servlet.SolrServlet init
INFO: SolrServlet.init()
Apr 9, 2012 12:45:18 PM org.apache.solr.core.SolrResourceLoader locateSolrHome
INFO: No /solr/home in JNDI
Apr 9, 2012 12:45:18 PM org.apache.solr.core.SolrResourceLoader locateSolrHome
INFO: using system property solr.solr.home: /var/lib/chef/solr
Apr 9, 2012 12:45:18 PM org.apache.solr.servlet.SolrServlet init
INFO: SolrServlet.init() done
Apr 9, 2012 12:45:18 PM org.apache.solr.core.SolrResourceLoader locateSolrHome
INFO: No /solr/home in JNDI
Apr 9, 2012 12:45:18 PM org.apache.solr.core.SolrResourceLoader locateSolrHome
INFO: using system property solr.solr.home: /var/lib/chef/solr
Apr 9, 2012 12:45:18 PM org.apache.solr.servlet.SolrUpdateServlet init
INFO: SolrUpdateServlet.init() done
13144 [main] WARN org.mortbay.log - failed
org.mortbay.jetty.NCSARequestLog@28ae4646: java.io.IOException: Cannot
write log directory /var/log/chef
13144 [main] WARN org.mortbay.log - failed RequestLogHandler@4987b287:
java.io.IOException: Cannot write log directory /var/log/chef
13144 [main] WARN org.mortbay.log - failed HandlerCollection@6bd9e2c7:
java.io.IOException: Cannot write log directory /var/log/chef
13144 [main] WARN org.mortbay.log - Error starting handlers
java.io.IOException: Cannot write log directory /var/log/chef
at org.mortbay.util.RolloverFileOutputStream.setFile(RolloverFileOutputStream.java:217)
at org.mortbay.util.RolloverFileOutputStream.(RolloverFileOutputStream.java:164)
at org.mortbay.jetty.NCSARequestLog.doStart(NCSARequestLog.java:428)
at org.mortbay.component.AbstractLifeCycle.start(AbstractLifeCycle.java:50)
at org.mortbay.jetty.handler.RequestLogHandler.doStart(RequestLogHandler.java:117)
at org.mortbay.component.AbstractLifeCycle.start(AbstractLifeCycle.java:50)
at org.mortbay.jetty.handler.HandlerCollection.doStart(HandlerCollection.java:152)
at org.mortbay.component.AbstractLifeCycle.start(AbstractLifeCycle.java:50)
at org.mortbay.jetty.handler.HandlerWrapper.doStart(HandlerWrapper.java:130)
at org.mortbay.jetty.Server.doStart(Server.java:224)
at org.mortbay.component.AbstractLifeCycle.start(AbstractLifeCycle.java:50)
at org.mortbay.xml.XmlConfiguration.main(XmlConfiguration.java:985)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:616)
at org.mortbay.start.Main.invokeMain(Main.java:194)
at org.mortbay.start.Main.start(Main.java:534)
at org.mortbay.start.Main.start(Main.java:441)
at org.mortbay.start.Main.main(Main.java:119)
13164 [main] INFO org.mortbay.log - Started SocketConnector@127.0.0.1:8983

On Mon, Apr 9, 2012 at 2:04 PM, Bryan McLellan btm@loftninjas.org wrote:

On Mon, Apr 9, 2012 at 12:36 PM, Paul Welch pwelch2004@gmail.com wrote:

If im not mistaken it looks like an issue talking to Solr. However, I
am not sure why it would work on initial install but stop working
later...

Anything interesting in the solr log? Usually /var/log/chef/solr.log.

Bryan

--
Paul Welch
pwelch2004@gmail.com
+1.352.327.8087

--
Paul Welch
pwelch2004@gmail.com
+1.352.327.8087

--
Debian GNU/Linux comes with ABSOLUTELY NO WARRANTY, to the extent
permitted by applicable law.

realityforge · April 9, 2012, 11:11pm

Hi,

I believe it is actually the lograte script that is causing the
problem - I think it may be something you need to edit in
/etc/logrotate.d/chef-solr but I don't have access to the config at
the moment. For a long time I just ran a cron script that enforced the
correct permissions and bounced the solr server when necessary

On Tue, Apr 10, 2012 at 5:21 AM, kallen@groknaut.net wrote:

hi. i thought i'd update subject in case it helps get more eyeballs
on this. the details are right here:

On Mon, 09 Apr 2012, kallen@groknaut.net wrote:

i suspect the following 2 dirs have the wrong permissions: /var/run/chef
and /var/log/chef. wrong in that they are root:root owned. if you chown
them to chef:chef, restart chef-solr, it should fix this.

i keep running into this problem where chef-solr dies for whatever reason,
and for reasons i haven't figured out yet, these 2 dirs get root:root
pwned.

anyone know why these bad perms keep getting laid down?

i'm about to cron a babysitter script to restart chef-solr and keep
these dirs chowned properly :<

(yes, the chef-server recipe i run on my chef server managers proper
perms on these dirs, but something else flips them back to root:root)

kallen

On Mon, 09 Apr 2012, Paul Welch wrote:

Output from my /var/log/chef/solr.log:

[Mon, 09 Apr 2012 12:45:04 -0400] INFO: About to change privilege to chef:chef
[Mon, 09 Apr 2012 12:45:04 -0400] INFO: Daemonizing..
[Mon, 09 Apr 2012 12:45:04 -0400] INFO: Forked, in 895. Priveleges: 107 115
[Mon, 09 Apr 2012 12:45:04 -0400] INFO: Starting Solr with java
-Xmx256M -Xms256M -Dsolr.data.dir=/var/cache/chef/solr/data
-Dsolr.solr.home=/var/lib/chef/solr
-DSTART=/var/lib/chef/solr/solr-jetty/etc/start.config -jar
/var/lib/chef/solr/solr-jetty/start.jar
1 [main] INFO org.mortbay.log - Logging to
org.slf4j.impl.SimpleLogger(org.mortbay.log) via
org.mortbay.log.Slf4jLog
196 [main] INFO org.mortbay.log - jetty-6.1.22
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in
[jar:file:/usr/share/java/slf4j-simple-1.5.10.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in
[jar:file:/var/lib/chef/solr/solr-jetty/webapps/solr/WEB-INF/lib/slf4j-jdk14.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See SLF4J Error Codes for an explanation.
Apr 9, 2012 12:45:17 PM org.apache.solr.core.SolrResourceLoader locateSolrHome
INFO: No /solr/home in JNDI
Apr 9, 2012 12:45:17 PM org.apache.solr.core.SolrResourceLoader locateSolrHome
INFO: using system property solr.solr.home: /var/lib/chef/solr
Apr 9, 2012 12:45:17 PM org.apache.solr.core.SolrResourceLoader
INFO: Solr home set to '/var/lib/chef/solr/'
Apr 9, 2012 12:45:17 PM org.apache.solr.servlet.SolrDispatchFilter init
INFO: SolrDispatchFilter.init()
Apr 9, 2012 12:45:17 PM org.apache.solr.core.SolrResourceLoader locateSolrHome
INFO: No /solr/home in JNDI
Apr 9, 2012 12:45:17 PM org.apache.solr.core.SolrResourceLoader locateSolrHome
INFO: using system property solr.solr.home: /var/lib/chef/solr
Apr 9, 2012 12:45:17 PM org.apache.solr.core.CoreContainer$Initializer
initialize
INFO: looking for solr.xml: /var/lib/chef/solr/solr.xml
Apr 9, 2012 12:45:17 PM org.apache.solr.core.SolrResourceLoader
INFO: Solr home set to '/var/lib/chef/solr/'
Apr 9, 2012 12:45:17 PM org.apache.solr.core.SolrConfig
INFO: Loaded SolrConfig: solrconfig.xml
Apr 9, 2012 12:45:17 PM org.apache.solr.core.SolrCore
INFO: Opening new SolrCore at /var/lib/chef/solr/,
dataDir=/var/cache/chef/solr/data/
Apr 9, 2012 12:45:17 PM org.apache.solr.schema.IndexSchema readSchema
INFO: Reading Solr Schema
Apr 9, 2012 12:45:17 PM org.apache.solr.schema.IndexSchema readSchema
INFO: Schema name=chef
Apr 9, 2012 12:45:17 PM org.apache.solr.util.plugin.AbstractPluginLoader load
INFO: created string: org.apache.solr.schema.StrField
Apr 9, 2012 12:45:17 PM org.apache.solr.util.plugin.AbstractPluginLoader load
INFO: created boolean: org.apache.solr.schema.BoolField
Apr 9, 2012 12:45:17 PM org.apache.solr.util.plugin.AbstractPluginLoader load
INFO: created integer: org.apache.solr.schema.IntField
Apr 9, 2012 12:45:17 PM org.apache.solr.util.plugin.AbstractPluginLoader load
INFO: created long: org.apache.solr.schema.LongField
Apr 9, 2012 12:45:17 PM org.apache.solr.util.plugin.AbstractPluginLoader load
INFO: created float: org.apache.solr.schema.FloatField
Apr 9, 2012 12:45:17 PM org.apache.solr.util.plugin.AbstractPluginLoader load
INFO: created double: org.apache.solr.schema.DoubleField
Apr 9, 2012 12:45:18 PM org.apache.solr.util.plugin.AbstractPluginLoader load
INFO: created sint: org.apache.solr.schema.SortableIntField
Apr 9, 2012 12:45:18 PM org.apache.solr.util.plugin.AbstractPluginLoader load
INFO: created slong: org.apache.solr.schema.SortableLongField
Apr 9, 2012 12:45:18 PM org.apache.solr.util.plugin.AbstractPluginLoader load
INFO: created sfloat: org.apache.solr.schema.SortableFloatField
Apr 9, 2012 12:45:18 PM org.apache.solr.util.plugin.AbstractPluginLoader load
INFO: created sdouble: org.apache.solr.schema.SortableDoubleField
Apr 9, 2012 12:45:18 PM org.apache.solr.util.plugin.AbstractPluginLoader load
INFO: created stuff: org.apache.solr.schema.TextField
Apr 9, 2012 12:45:18 PM org.apache.solr.util.plugin.AbstractPluginLoader load
INFO: created date: org.apache.solr.schema.DateField
Apr 9, 2012 12:45:18 PM org.apache.solr.schema.IndexSchema readSchema
INFO: default search field is content
Apr 9, 2012 12:45:18 PM org.apache.solr.schema.IndexSchema readSchema
INFO: query parser default operator is OR
Apr 9, 2012 12:45:18 PM org.apache.solr.schema.IndexSchema readSchema
INFO: unique key field: X_CHEF_id_CHEF_X
Apr 9, 2012 12:45:18 PM org.apache.solr.core.JmxMonitoredMap
INFO: No JMX servers found, not exposing Solr information with JMX.
Apr 9, 2012 12:45:18 PM org.apache.solr.core.RequestHandlers
initHandlersFromConfig
INFO: created standard: solr.SearchHandler
Apr 9, 2012 12:45:18 PM org.apache.solr.core.RequestHandlers
initHandlersFromConfig
INFO: created /update: solr.XmlUpdateRequestHandler
Apr 9, 2012 12:45:18 PM org.apache.solr.core.RequestHandlers
initHandlersFromConfig
INFO: created /update/javabin: solr.BinaryUpdateRequestHandler
Apr 9, 2012 12:45:18 PM org.apache.solr.core.RequestHandlers
initHandlersFromConfig
INFO: created /analysis/document: solr.DocumentAnalysisRequestHandler
Apr 9, 2012 12:45:18 PM org.apache.solr.core.RequestHandlers
initHandlersFromConfig
INFO: created /analysis/field: solr.FieldAnalysisRequestHandler
Apr 9, 2012 12:45:18 PM org.apache.solr.core.RequestHandlers
initHandlersFromConfig
INFO: adding lazy requestHandler: solr.CSVRequestHandler
Apr 9, 2012 12:45:18 PM org.apache.solr.core.RequestHandlers
initHandlersFromConfig
INFO: created /update/csv: solr.CSVRequestHandler
Apr 9, 2012 12:45:18 PM org.apache.solr.core.RequestHandlers
initHandlersFromConfig
INFO: created /admin/: org.apache.solr.handler.admin.AdminHandlers
Apr 9, 2012 12:45:18 PM org.apache.solr.core.RequestHandlers
initHandlersFromConfig
INFO: created /admin/ping: PingRequestHandler
Apr 9, 2012 12:45:18 PM org.apache.solr.core.RequestHandlers
initHandlersFromConfig
INFO: created /debug/dump: solr.DumpRequestHandler
Apr 9, 2012 12:45:18 PM org.apache.solr.search.SolrIndexSearcher
INFO: Opening Searcher@64a7c45e main
Apr 9, 2012 12:45:18 PM
org.apache.solr.update.DirectUpdateHandler2$CommitTracker
INFO: AutoCommit: if uncommited for 10000ms; if 100 uncommited docs
Apr 9, 2012 12:45:18 PM org.apache.solr.handler.component.SearchHandler inform
INFO: Adding component:org.apache.solr.handler.component.QueryComponent@1dc18a4c
Apr 9, 2012 12:45:18 PM org.apache.solr.handler.component.SearchHandler inform
INFO: Adding component:org.apache.solr.handler.component.FacetComponent@d5e92d7
Apr 9, 2012 12:45:18 PM org.apache.solr.handler.component.SearchHandler inform
INFO: Adding component:org.apache.solr.handler.component.MoreLikeThisComponent@3bfa681c
Apr 9, 2012 12:45:18 PM org.apache.solr.handler.component.SearchHandler inform
INFO: Adding component:org.apache.solr.handler.component.HighlightComponent@34c92507
Apr 9, 2012 12:45:18 PM org.apache.solr.handler.component.SearchHandler inform
INFO: Adding component:org.apache.solr.handler.component.StatsComponent@19e09a4
Apr 9, 2012 12:45:18 PM org.apache.solr.handler.component.SearchHandler inform
INFO: Adding debug
component:org.apache.solr.handler.component.DebugComponent@2e8aeed0
Apr 9, 2012 12:45:18 PM org.apache.solr.core.SolrCore registerSearcher
INFO: Registered new searcher Searcher@64a7c45e main
Apr 9, 2012 12:45:18 PM org.apache.solr.core.CoreContainer register
INFO: registering core:
Apr 9, 2012 12:45:18 PM org.apache.solr.servlet.SolrDispatchFilter init
INFO: user.dir=/var/lib/chef/solr/solr-jetty
Apr 9, 2012 12:45:18 PM org.apache.solr.servlet.SolrDispatchFilter init
INFO: SolrDispatchFilter.init() done
Apr 9, 2012 12:45:18 PM org.apache.solr.servlet.SolrServlet init
INFO: SolrServlet.init()
Apr 9, 2012 12:45:18 PM org.apache.solr.core.SolrResourceLoader locateSolrHome
INFO: No /solr/home in JNDI
Apr 9, 2012 12:45:18 PM org.apache.solr.core.SolrResourceLoader locateSolrHome
INFO: using system property solr.solr.home: /var/lib/chef/solr
Apr 9, 2012 12:45:18 PM org.apache.solr.servlet.SolrServlet init
INFO: SolrServlet.init() done
Apr 9, 2012 12:45:18 PM org.apache.solr.core.SolrResourceLoader locateSolrHome
INFO: No /solr/home in JNDI
Apr 9, 2012 12:45:18 PM org.apache.solr.core.SolrResourceLoader locateSolrHome
INFO: using system property solr.solr.home: /var/lib/chef/solr
Apr 9, 2012 12:45:18 PM org.apache.solr.servlet.SolrUpdateServlet init
INFO: SolrUpdateServlet.init() done
13144 [main] WARN org.mortbay.log - failed
org.mortbay.jetty.NCSARequestLog@28ae4646: java.io.IOException: Cannot
write log directory /var/log/chef
13144 [main] WARN org.mortbay.log - failed RequestLogHandler@4987b287:
java.io.IOException: Cannot write log directory /var/log/chef
13144 [main] WARN org.mortbay.log - failed HandlerCollection@6bd9e2c7:
java.io.IOException: Cannot write log directory /var/log/chef
13144 [main] WARN org.mortbay.log - Error starting handlers
java.io.IOException: Cannot write log directory /var/log/chef
at org.mortbay.util.RolloverFileOutputStream.setFile(RolloverFileOutputStream.java:217)
at org.mortbay.util.RolloverFileOutputStream.(RolloverFileOutputStream.java:164)
at org.mortbay.jetty.NCSARequestLog.doStart(NCSARequestLog.java:428)
at org.mortbay.component.AbstractLifeCycle.start(AbstractLifeCycle.java:50)
at org.mortbay.jetty.handler.RequestLogHandler.doStart(RequestLogHandler.java:117)
at org.mortbay.component.AbstractLifeCycle.start(AbstractLifeCycle.java:50)
at org.mortbay.jetty.handler.HandlerCollection.doStart(HandlerCollection.java:152)
at org.mortbay.component.AbstractLifeCycle.start(AbstractLifeCycle.java:50)
at org.mortbay.jetty.handler.HandlerWrapper.doStart(HandlerWrapper.java:130)
at org.mortbay.jetty.Server.doStart(Server.java:224)
at org.mortbay.component.AbstractLifeCycle.start(AbstractLifeCycle.java:50)
at org.mortbay.xml.XmlConfiguration.main(XmlConfiguration.java:985)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:616)
at org.mortbay.start.Main.invokeMain(Main.java:194)
at org.mortbay.start.Main.start(Main.java:534)
at org.mortbay.start.Main.start(Main.java:441)
at org.mortbay.start.Main.main(Main.java:119)
13164 [main] INFO org.mortbay.log - Started SocketConnector@127.0.0.1:8983

On Mon, Apr 9, 2012 at 2:04 PM, Bryan McLellan btm@loftninjas.org wrote:

On Mon, Apr 9, 2012 at 12:36 PM, Paul Welch pwelch2004@gmail.com wrote:

If im not mistaken it looks like an issue talking to Solr. However, I
am not sure why it would work on initial install but stop working
later...

Anything interesting in the solr log? Usually /var/log/chef/solr.log.

Bryan

--
Cheers,

Peter Donald

StephenKing · April 11, 2012, 4:50pm

Hi Peter,

that's a problem when you run chef-client and chef-server on the same host and was fixed with the latest release of the chef-client cookbook.

However, as we haven't deployed our chef server through a chef recipe, the fix didn't help us and I removed the check for the chef-server recipe for us.

Yours
Steffen

On 10.04.2012, at 01:11, Peter Donald wrote:

Hi,

I believe it is actually the lograte script that is causing the
problem - I think it may be something you need to edit in
/etc/logrotate.d/chef-solr but I don't have access to the config at
the moment. For a long time I just ran a cron script that enforced the
correct permissions and bounced the solr server when necessary

On Tue, Apr 10, 2012 at 5:21 AM, kallen@groknaut.net wrote:

hi. i thought i'd update subject in case it helps get more eyeballs
on this. the details are right here:

On Mon, 09 Apr 2012, kallen@groknaut.net wrote:

i suspect the following 2 dirs have the wrong permissions: /var/run/chef
and /var/log/chef. wrong in that they are root:root owned. if you chown
them to chef:chef, restart chef-solr, it should fix this.

i keep running into this problem where chef-solr dies for whatever reason,
and for reasons i haven't figured out yet, these 2 dirs get root:root
pwned.

anyone know why these bad perms keep getting laid down?

i'm about to cron a babysitter script to restart chef-solr and keep
these dirs chowned properly :<

(yes, the chef-server recipe i run on my chef server managers proper
perms on these dirs, but something else flips them back to root:root)

kallen

On Mon, 09 Apr 2012, Paul Welch wrote:

Output from my /var/log/chef/solr.log:

[Mon, 09 Apr 2012 12:45:04 -0400] INFO: About to change privilege to chef:chef
[Mon, 09 Apr 2012 12:45:04 -0400] INFO: Daemonizing..
[Mon, 09 Apr 2012 12:45:04 -0400] INFO: Forked, in 895. Priveleges: 107 115
[Mon, 09 Apr 2012 12:45:04 -0400] INFO: Starting Solr with java
-Xmx256M -Xms256M -Dsolr.data.dir=/var/cache/chef/solr/data
-Dsolr.solr.home=/var/lib/chef/solr
-DSTART=/var/lib/chef/solr/solr-jetty/etc/start.config -jar
/var/lib/chef/solr/solr-jetty/start.jar
1 [main] INFO org.mortbay.log - Logging to
org.slf4j.impl.SimpleLogger(org.mortbay.log) via
org.mortbay.log.Slf4jLog
196 [main] INFO org.mortbay.log - jetty-6.1.22
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in
[jar:file:/usr/share/java/slf4j-simple-1.5.10.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in
[jar:file:/var/lib/chef/solr/solr-jetty/webapps/solr/WEB-INF/lib/slf4j-jdk14.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See SLF4J Error Codes for an explanation.
Apr 9, 2012 12:45:17 PM org.apache.solr.core.SolrResourceLoader locateSolrHome
INFO: No /solr/home in JNDI
Apr 9, 2012 12:45:17 PM org.apache.solr.core.SolrResourceLoader locateSolrHome
INFO: using system property solr.solr.home: /var/lib/chef/solr
Apr 9, 2012 12:45:17 PM org.apache.solr.core.SolrResourceLoader
INFO: Solr home set to '/var/lib/chef/solr/'
Apr 9, 2012 12:45:17 PM org.apache.solr.servlet.SolrDispatchFilter init
INFO: SolrDispatchFilter.init()
Apr 9, 2012 12:45:17 PM org.apache.solr.core.SolrResourceLoader locateSolrHome
INFO: No /solr/home in JNDI
Apr 9, 2012 12:45:17 PM org.apache.solr.core.SolrResourceLoader locateSolrHome
INFO: using system property solr.solr.home: /var/lib/chef/solr
Apr 9, 2012 12:45:17 PM org.apache.solr.core.CoreContainer$Initializer
initialize
INFO: looking for solr.xml: /var/lib/chef/solr/solr.xml
Apr 9, 2012 12:45:17 PM org.apache.solr.core.SolrResourceLoader
INFO: Solr home set to '/var/lib/chef/solr/'
Apr 9, 2012 12:45:17 PM org.apache.solr.core.SolrConfig
INFO: Loaded SolrConfig: solrconfig.xml
Apr 9, 2012 12:45:17 PM org.apache.solr.core.SolrCore
INFO: Opening new SolrCore at /var/lib/chef/solr/,
dataDir=/var/cache/chef/solr/data/
Apr 9, 2012 12:45:17 PM org.apache.solr.schema.IndexSchema readSchema
INFO: Reading Solr Schema
Apr 9, 2012 12:45:17 PM org.apache.solr.schema.IndexSchema readSchema
INFO: Schema name=chef
Apr 9, 2012 12:45:17 PM org.apache.solr.util.plugin.AbstractPluginLoader load
INFO: created string: org.apache.solr.schema.StrField
Apr 9, 2012 12:45:17 PM org.apache.solr.util.plugin.AbstractPluginLoader load
INFO: created boolean: org.apache.solr.schema.BoolField
Apr 9, 2012 12:45:17 PM org.apache.solr.util.plugin.AbstractPluginLoader load
INFO: created integer: org.apache.solr.schema.IntField
Apr 9, 2012 12:45:17 PM org.apache.solr.util.plugin.AbstractPluginLoader load
INFO: created long: org.apache.solr.schema.LongField
Apr 9, 2012 12:45:17 PM org.apache.solr.util.plugin.AbstractPluginLoader load
INFO: created float: org.apache.solr.schema.FloatField
Apr 9, 2012 12:45:17 PM org.apache.solr.util.plugin.AbstractPluginLoader load
INFO: created double: org.apache.solr.schema.DoubleField
Apr 9, 2012 12:45:18 PM org.apache.solr.util.plugin.AbstractPluginLoader load
INFO: created sint: org.apache.solr.schema.SortableIntField
Apr 9, 2012 12:45:18 PM org.apache.solr.util.plugin.AbstractPluginLoader load
INFO: created slong: org.apache.solr.schema.SortableLongField
Apr 9, 2012 12:45:18 PM org.apache.solr.util.plugin.AbstractPluginLoader load
INFO: created sfloat: org.apache.solr.schema.SortableFloatField
Apr 9, 2012 12:45:18 PM org.apache.solr.util.plugin.AbstractPluginLoader load
INFO: created sdouble: org.apache.solr.schema.SortableDoubleField
Apr 9, 2012 12:45:18 PM org.apache.solr.util.plugin.AbstractPluginLoader load
INFO: created stuff: org.apache.solr.schema.TextField
Apr 9, 2012 12:45:18 PM org.apache.solr.util.plugin.AbstractPluginLoader load
INFO: created date: org.apache.solr.schema.DateField
Apr 9, 2012 12:45:18 PM org.apache.solr.schema.IndexSchema readSchema
INFO: default search field is content
Apr 9, 2012 12:45:18 PM org.apache.solr.schema.IndexSchema readSchema
INFO: query parser default operator is OR
Apr 9, 2012 12:45:18 PM org.apache.solr.schema.IndexSchema readSchema
INFO: unique key field: X_CHEF_id_CHEF_X
Apr 9, 2012 12:45:18 PM org.apache.solr.core.JmxMonitoredMap
INFO: No JMX servers found, not exposing Solr information with JMX.
Apr 9, 2012 12:45:18 PM org.apache.solr.core.RequestHandlers
initHandlersFromConfig
INFO: created standard: solr.SearchHandler
Apr 9, 2012 12:45:18 PM org.apache.solr.core.RequestHandlers
initHandlersFromConfig
INFO: created /update: solr.XmlUpdateRequestHandler
Apr 9, 2012 12:45:18 PM org.apache.solr.core.RequestHandlers
initHandlersFromConfig
INFO: created /update/javabin: solr.BinaryUpdateRequestHandler
Apr 9, 2012 12:45:18 PM org.apache.solr.core.RequestHandlers
initHandlersFromConfig
INFO: created /analysis/document: solr.DocumentAnalysisRequestHandler
Apr 9, 2012 12:45:18 PM org.apache.solr.core.RequestHandlers
initHandlersFromConfig
INFO: created /analysis/field: solr.FieldAnalysisRequestHandler
Apr 9, 2012 12:45:18 PM org.apache.solr.core.RequestHandlers
initHandlersFromConfig
INFO: adding lazy requestHandler: solr.CSVRequestHandler
Apr 9, 2012 12:45:18 PM org.apache.solr.core.RequestHandlers
initHandlersFromConfig
INFO: created /update/csv: solr.CSVRequestHandler
Apr 9, 2012 12:45:18 PM org.apache.solr.core.RequestHandlers
initHandlersFromConfig
INFO: created /admin/: org.apache.solr.handler.admin.AdminHandlers
Apr 9, 2012 12:45:18 PM org.apache.solr.core.RequestHandlers
initHandlersFromConfig
INFO: created /admin/ping: PingRequestHandler
Apr 9, 2012 12:45:18 PM org.apache.solr.core.RequestHandlers
initHandlersFromConfig
INFO: created /debug/dump: solr.DumpRequestHandler
Apr 9, 2012 12:45:18 PM org.apache.solr.search.SolrIndexSearcher
INFO: Opening Searcher@64a7c45e main
Apr 9, 2012 12:45:18 PM
org.apache.solr.update.DirectUpdateHandler2$CommitTracker
INFO: AutoCommit: if uncommited for 10000ms; if 100 uncommited docs
Apr 9, 2012 12:45:18 PM org.apache.solr.handler.component.SearchHandler inform
INFO: Adding component:org.apache.solr.handler.component.QueryComponent@1dc18a4c
Apr 9, 2012 12:45:18 PM org.apache.solr.handler.component.SearchHandler inform
INFO: Adding component:org.apache.solr.handler.component.FacetComponent@d5e92d7
Apr 9, 2012 12:45:18 PM org.apache.solr.handler.component.SearchHandler inform
INFO: Adding component:org.apache.solr.handler.component.MoreLikeThisComponent@3bfa681c
Apr 9, 2012 12:45:18 PM org.apache.solr.handler.component.SearchHandler inform
INFO: Adding component:org.apache.solr.handler.component.HighlightComponent@34c92507
Apr 9, 2012 12:45:18 PM org.apache.solr.handler.component.SearchHandler inform
INFO: Adding component:org.apache.solr.handler.component.StatsComponent@19e09a4
Apr 9, 2012 12:45:18 PM org.apache.solr.handler.component.SearchHandler inform
INFO: Adding debug
component:org.apache.solr.handler.component.DebugComponent@2e8aeed0
Apr 9, 2012 12:45:18 PM org.apache.solr.core.SolrCore registerSearcher
INFO: Registered new searcher Searcher@64a7c45e main
Apr 9, 2012 12:45:18 PM org.apache.solr.core.CoreContainer register
INFO: registering core:
Apr 9, 2012 12:45:18 PM org.apache.solr.servlet.SolrDispatchFilter init
INFO: user.dir=/var/lib/chef/solr/solr-jetty
Apr 9, 2012 12:45:18 PM org.apache.solr.servlet.SolrDispatchFilter init
INFO: SolrDispatchFilter.init() done
Apr 9, 2012 12:45:18 PM org.apache.solr.servlet.SolrServlet init
INFO: SolrServlet.init()
Apr 9, 2012 12:45:18 PM org.apache.solr.core.SolrResourceLoader locateSolrHome
INFO: No /solr/home in JNDI
Apr 9, 2012 12:45:18 PM org.apache.solr.core.SolrResourceLoader locateSolrHome
INFO: using system property solr.solr.home: /var/lib/chef/solr
Apr 9, 2012 12:45:18 PM org.apache.solr.servlet.SolrServlet init
INFO: SolrServlet.init() done
Apr 9, 2012 12:45:18 PM org.apache.solr.core.SolrResourceLoader locateSolrHome
INFO: No /solr/home in JNDI
Apr 9, 2012 12:45:18 PM org.apache.solr.core.SolrResourceLoader locateSolrHome
INFO: using system property solr.solr.home: /var/lib/chef/solr
Apr 9, 2012 12:45:18 PM org.apache.solr.servlet.SolrUpdateServlet init
INFO: SolrUpdateServlet.init() done
13144 [main] WARN org.mortbay.log - failed
org.mortbay.jetty.NCSARequestLog@28ae4646: java.io.IOException: Cannot
write log directory /var/log/chef
13144 [main] WARN org.mortbay.log - failed RequestLogHandler@4987b287:
java.io.IOException: Cannot write log directory /var/log/chef
13144 [main] WARN org.mortbay.log - failed HandlerCollection@6bd9e2c7:
java.io.IOException: Cannot write log directory /var/log/chef
13144 [main] WARN org.mortbay.log - Error starting handlers
java.io.IOException: Cannot write log directory /var/log/chef
at org.mortbay.util.RolloverFileOutputStream.setFile(RolloverFileOutputStream.java:217)
at org.mortbay.util.RolloverFileOutputStream.(RolloverFileOutputStream.java:164)
at org.mortbay.jetty.NCSARequestLog.doStart(NCSARequestLog.java:428)
at org.mortbay.component.AbstractLifeCycle.start(AbstractLifeCycle.java:50)
at org.mortbay.jetty.handler.RequestLogHandler.doStart(RequestLogHandler.java:117)
at org.mortbay.component.AbstractLifeCycle.start(AbstractLifeCycle.java:50)
at org.mortbay.jetty.handler.HandlerCollection.doStart(HandlerCollection.java:152)
at org.mortbay.component.AbstractLifeCycle.start(AbstractLifeCycle.java:50)
at org.mortbay.jetty.handler.HandlerWrapper.doStart(HandlerWrapper.java:130)
at org.mortbay.jetty.Server.doStart(Server.java:224)
at org.mortbay.component.AbstractLifeCycle.start(AbstractLifeCycle.java:50)
at org.mortbay.xml.XmlConfiguration.main(XmlConfiguration.java:985)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:616)
at org.mortbay.start.Main.invokeMain(Main.java:194)
at org.mortbay.start.Main.start(Main.java:534)
at org.mortbay.start.Main.start(Main.java:441)
at org.mortbay.start.Main.main(Main.java:119)
13164 [main] INFO org.mortbay.log - Started SocketConnector@127.0.0.1:8983

On Mon, Apr 9, 2012 at 2:04 PM, Bryan McLellan btm@loftninjas.org wrote:

On Mon, Apr 9, 2012 at 12:36 PM, Paul Welch pwelch2004@gmail.com wrote:

If im not mistaken it looks like an issue talking to Solr. However, I
am not sure why it would work on initial install but stop working
later...

Anything interesting in the solr log? Usually /var/log/chef/solr.log.

Bryan

--
Cheers,

Peter Donald

Paul_Welch · April 11, 2012, 7:35pm

Steffen,

Thank you for posting this. This seems to have been the issue on my system.

On Wed, Apr 11, 2012 at 12:50 PM, Steffen Gebert st+opscode@st-g.de wrote:

Hi Peter,

that's a problem when you run chef-client and chef-server on the same host and was fixed with the latest release of the chef-client cookbook.

Sets permissions for /var directories properly if run on chef-server.… · chef-boneyard/chef-client@5c9bf4f · GitHub

However, as we haven't deployed our chef server through a chef recipe, the fix didn't help us and I removed the check for the chef-server recipe for us.

Yours
Steffen

On 10.04.2012, at 01:11, Peter Donald wrote:

Hi,

I believe it is actually the lograte script that is causing the
problem - I think it may be something you need to edit in
/etc/logrotate.d/chef-solr but I don't have access to the config at
the moment. For a long time I just ran a cron script that enforced the
correct permissions and bounced the solr server when necessary

On Tue, Apr 10, 2012 at 5:21 AM, kallen@groknaut.net wrote:

hi. i thought i'd update subject in case it helps get more eyeballs
on this. the details are right here:

On Mon, 09 Apr 2012, kallen@groknaut.net wrote:

i suspect the following 2 dirs have the wrong permissions: /var/run/chef
and /var/log/chef. wrong in that they are root:root owned. if you chown
them to chef:chef, restart chef-solr, it should fix this.

i keep running into this problem where chef-solr dies for whatever reason,
and for reasons i haven't figured out yet, these 2 dirs get root:root
pwned.

anyone know why these bad perms keep getting laid down?

i'm about to cron a babysitter script to restart chef-solr and keep
these dirs chowned properly :<

(yes, the chef-server recipe i run on my chef server managers proper
perms on these dirs, but something else flips them back to root:root)

kallen

On Mon, 09 Apr 2012, Paul Welch wrote:

Output from my /var/log/chef/solr.log:

[Mon, 09 Apr 2012 12:45:04 -0400] INFO: About to change privilege to chef:chef
[Mon, 09 Apr 2012 12:45:04 -0400] INFO: Daemonizing..
[Mon, 09 Apr 2012 12:45:04 -0400] INFO: Forked, in 895. Priveleges: 107 115
[Mon, 09 Apr 2012 12:45:04 -0400] INFO: Starting Solr with java
-Xmx256M -Xms256M -Dsolr.data.dir=/var/cache/chef/solr/data
-Dsolr.solr.home=/var/lib/chef/solr
-DSTART=/var/lib/chef/solr/solr-jetty/etc/start.config -jar
/var/lib/chef/solr/solr-jetty/start.jar
1 [main] INFO org.mortbay.log - Logging to
org.slf4j.impl.SimpleLogger(org.mortbay.log) via
org.mortbay.log.Slf4jLog
196 [main] INFO org.mortbay.log - jetty-6.1.22
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in
[jar:file:/usr/share/java/slf4j-simple-1.5.10.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in
[jar:file:/var/lib/chef/solr/solr-jetty/webapps/solr/WEB-INF/lib/slf4j-jdk14.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See SLF4J Error Codes for an explanation.
Apr 9, 2012 12:45:17 PM org.apache.solr.core.SolrResourceLoader locateSolrHome
INFO: No /solr/home in JNDI
Apr 9, 2012 12:45:17 PM org.apache.solr.core.SolrResourceLoader locateSolrHome
INFO: using system property solr.solr.home: /var/lib/chef/solr
Apr 9, 2012 12:45:17 PM org.apache.solr.core.SolrResourceLoader
INFO: Solr home set to '/var/lib/chef/solr/'
Apr 9, 2012 12:45:17 PM org.apache.solr.servlet.SolrDispatchFilter init
INFO: SolrDispatchFilter.init()
Apr 9, 2012 12:45:17 PM org.apache.solr.core.SolrResourceLoader locateSolrHome
INFO: No /solr/home in JNDI
Apr 9, 2012 12:45:17 PM org.apache.solr.core.SolrResourceLoader locateSolrHome
INFO: using system property solr.solr.home: /var/lib/chef/solr
Apr 9, 2012 12:45:17 PM org.apache.solr.core.CoreContainer$Initializer
initialize
INFO: looking for solr.xml: /var/lib/chef/solr/solr.xml
Apr 9, 2012 12:45:17 PM org.apache.solr.core.SolrResourceLoader
INFO: Solr home set to '/var/lib/chef/solr/'
Apr 9, 2012 12:45:17 PM org.apache.solr.core.SolrConfig
INFO: Loaded SolrConfig: solrconfig.xml
Apr 9, 2012 12:45:17 PM org.apache.solr.core.SolrCore
INFO: Opening new SolrCore at /var/lib/chef/solr/,
dataDir=/var/cache/chef/solr/data/
Apr 9, 2012 12:45:17 PM org.apache.solr.schema.IndexSchema readSchema
INFO: Reading Solr Schema
Apr 9, 2012 12:45:17 PM org.apache.solr.schema.IndexSchema readSchema
INFO: Schema name=chef
Apr 9, 2012 12:45:17 PM org.apache.solr.util.plugin.AbstractPluginLoader load
INFO: created string: org.apache.solr.schema.StrField
Apr 9, 2012 12:45:17 PM org.apache.solr.util.plugin.AbstractPluginLoader load
INFO: created boolean: org.apache.solr.schema.BoolField
Apr 9, 2012 12:45:17 PM org.apache.solr.util.plugin.AbstractPluginLoader load
INFO: created integer: org.apache.solr.schema.IntField
Apr 9, 2012 12:45:17 PM org.apache.solr.util.plugin.AbstractPluginLoader load
INFO: created long: org.apache.solr.schema.LongField
Apr 9, 2012 12:45:17 PM org.apache.solr.util.plugin.AbstractPluginLoader load
INFO: created float: org.apache.solr.schema.FloatField
Apr 9, 2012 12:45:17 PM org.apache.solr.util.plugin.AbstractPluginLoader load
INFO: created double: org.apache.solr.schema.DoubleField
Apr 9, 2012 12:45:18 PM org.apache.solr.util.plugin.AbstractPluginLoader load
INFO: created sint: org.apache.solr.schema.SortableIntField
Apr 9, 2012 12:45:18 PM org.apache.solr.util.plugin.AbstractPluginLoader load
INFO: created slong: org.apache.solr.schema.SortableLongField
Apr 9, 2012 12:45:18 PM org.apache.solr.util.plugin.AbstractPluginLoader load
INFO: created sfloat: org.apache.solr.schema.SortableFloatField
Apr 9, 2012 12:45:18 PM org.apache.solr.util.plugin.AbstractPluginLoader load
INFO: created sdouble: org.apache.solr.schema.SortableDoubleField
Apr 9, 2012 12:45:18 PM org.apache.solr.util.plugin.AbstractPluginLoader load
INFO: created stuff: org.apache.solr.schema.TextField
Apr 9, 2012 12:45:18 PM org.apache.solr.util.plugin.AbstractPluginLoader load
INFO: created date: org.apache.solr.schema.DateField
Apr 9, 2012 12:45:18 PM org.apache.solr.schema.IndexSchema readSchema
INFO: default search field is content
Apr 9, 2012 12:45:18 PM org.apache.solr.schema.IndexSchema readSchema
INFO: query parser default operator is OR
Apr 9, 2012 12:45:18 PM org.apache.solr.schema.IndexSchema readSchema
INFO: unique key field: X_CHEF_id_CHEF_X
Apr 9, 2012 12:45:18 PM org.apache.solr.core.JmxMonitoredMap
INFO: No JMX servers found, not exposing Solr information with JMX.
Apr 9, 2012 12:45:18 PM org.apache.solr.core.RequestHandlers
initHandlersFromConfig
INFO: created standard: solr.SearchHandler
Apr 9, 2012 12:45:18 PM org.apache.solr.core.RequestHandlers
initHandlersFromConfig
INFO: created /update: solr.XmlUpdateRequestHandler
Apr 9, 2012 12:45:18 PM org.apache.solr.core.RequestHandlers
initHandlersFromConfig
INFO: created /update/javabin: solr.BinaryUpdateRequestHandler
Apr 9, 2012 12:45:18 PM org.apache.solr.core.RequestHandlers
initHandlersFromConfig
INFO: created /analysis/document: solr.DocumentAnalysisRequestHandler
Apr 9, 2012 12:45:18 PM org.apache.solr.core.RequestHandlers
initHandlersFromConfig
INFO: created /analysis/field: solr.FieldAnalysisRequestHandler
Apr 9, 2012 12:45:18 PM org.apache.solr.core.RequestHandlers
initHandlersFromConfig
INFO: adding lazy requestHandler: solr.CSVRequestHandler
Apr 9, 2012 12:45:18 PM org.apache.solr.core.RequestHandlers
initHandlersFromConfig
INFO: created /update/csv: solr.CSVRequestHandler
Apr 9, 2012 12:45:18 PM org.apache.solr.core.RequestHandlers
initHandlersFromConfig
INFO: created /admin/: org.apache.solr.handler.admin.AdminHandlers
Apr 9, 2012 12:45:18 PM org.apache.solr.core.RequestHandlers
initHandlersFromConfig
INFO: created /admin/ping: PingRequestHandler
Apr 9, 2012 12:45:18 PM org.apache.solr.core.RequestHandlers
initHandlersFromConfig
INFO: created /debug/dump: solr.DumpRequestHandler
Apr 9, 2012 12:45:18 PM org.apache.solr.search.SolrIndexSearcher
INFO: Opening Searcher@64a7c45e main
Apr 9, 2012 12:45:18 PM
org.apache.solr.update.DirectUpdateHandler2$CommitTracker
INFO: AutoCommit: if uncommited for 10000ms; if 100 uncommited docs
Apr 9, 2012 12:45:18 PM org.apache.solr.handler.component.SearchHandler inform
INFO: Adding component:org.apache.solr.handler.component.QueryComponent@1dc18a4c
Apr 9, 2012 12:45:18 PM org.apache.solr.handler.component.SearchHandler inform
INFO: Adding component:org.apache.solr.handler.component.FacetComponent@d5e92d7
Apr 9, 2012 12:45:18 PM org.apache.solr.handler.component.SearchHandler inform
INFO: Adding component:org.apache.solr.handler.component.MoreLikeThisComponent@3bfa681c
Apr 9, 2012 12:45:18 PM org.apache.solr.handler.component.SearchHandler inform
INFO: Adding component:org.apache.solr.handler.component.HighlightComponent@34c92507
Apr 9, 2012 12:45:18 PM org.apache.solr.handler.component.SearchHandler inform
INFO: Adding component:org.apache.solr.handler.component.StatsComponent@19e09a4
Apr 9, 2012 12:45:18 PM org.apache.solr.handler.component.SearchHandler inform
INFO: Adding debug
component:org.apache.solr.handler.component.DebugComponent@2e8aeed0
Apr 9, 2012 12:45:18 PM org.apache.solr.core.SolrCore registerSearcher
INFO: Registered new searcher Searcher@64a7c45e main
Apr 9, 2012 12:45:18 PM org.apache.solr.core.CoreContainer register
INFO: registering core:
Apr 9, 2012 12:45:18 PM org.apache.solr.servlet.SolrDispatchFilter init
INFO: user.dir=/var/lib/chef/solr/solr-jetty
Apr 9, 2012 12:45:18 PM org.apache.solr.servlet.SolrDispatchFilter init
INFO: SolrDispatchFilter.init() done
Apr 9, 2012 12:45:18 PM org.apache.solr.servlet.SolrServlet init
INFO: SolrServlet.init()
Apr 9, 2012 12:45:18 PM org.apache.solr.core.SolrResourceLoader locateSolrHome
INFO: No /solr/home in JNDI
Apr 9, 2012 12:45:18 PM org.apache.solr.core.SolrResourceLoader locateSolrHome
INFO: using system property solr.solr.home: /var/lib/chef/solr
Apr 9, 2012 12:45:18 PM org.apache.solr.servlet.SolrServlet init
INFO: SolrServlet.init() done
Apr 9, 2012 12:45:18 PM org.apache.solr.core.SolrResourceLoader locateSolrHome
INFO: No /solr/home in JNDI
Apr 9, 2012 12:45:18 PM org.apache.solr.core.SolrResourceLoader locateSolrHome
INFO: using system property solr.solr.home: /var/lib/chef/solr
Apr 9, 2012 12:45:18 PM org.apache.solr.servlet.SolrUpdateServlet init
INFO: SolrUpdateServlet.init() done
13144 [main] WARN org.mortbay.log - failed
org.mortbay.jetty.NCSARequestLog@28ae4646: java.io.IOException: Cannot
write log directory /var/log/chef
13144 [main] WARN org.mortbay.log - failed RequestLogHandler@4987b287:
java.io.IOException: Cannot write log directory /var/log/chef
13144 [main] WARN org.mortbay.log - failed HandlerCollection@6bd9e2c7:
java.io.IOException: Cannot write log directory /var/log/chef
13144 [main] WARN org.mortbay.log - Error starting handlers
java.io.IOException: Cannot write log directory /var/log/chef
at org.mortbay.util.RolloverFileOutputStream.setFile(RolloverFileOutputStream.java:217)
at org.mortbay.util.RolloverFileOutputStream.(RolloverFileOutputStream.java:164)
at org.mortbay.jetty.NCSARequestLog.doStart(NCSARequestLog.java:428)
at org.mortbay.component.AbstractLifeCycle.start(AbstractLifeCycle.java:50)
at org.mortbay.jetty.handler.RequestLogHandler.doStart(RequestLogHandler.java:117)
at org.mortbay.component.AbstractLifeCycle.start(AbstractLifeCycle.java:50)
at org.mortbay.jetty.handler.HandlerCollection.doStart(HandlerCollection.java:152)
at org.mortbay.component.AbstractLifeCycle.start(AbstractLifeCycle.java:50)
at org.mortbay.jetty.handler.HandlerWrapper.doStart(HandlerWrapper.java:130)
at org.mortbay.jetty.Server.doStart(Server.java:224)
at org.mortbay.component.AbstractLifeCycle.start(AbstractLifeCycle.java:50)
at org.mortbay.xml.XmlConfiguration.main(XmlConfiguration.java:985)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:616)
at org.mortbay.start.Main.invokeMain(Main.java:194)
at org.mortbay.start.Main.start(Main.java:534)
at org.mortbay.start.Main.start(Main.java:441)
at org.mortbay.start.Main.main(Main.java:119)
13164 [main] INFO org.mortbay.log - Started SocketConnector@127.0.0.1:8983

On Mon, Apr 9, 2012 at 2:04 PM, Bryan McLellan btm@loftninjas.org wrote:

On Mon, Apr 9, 2012 at 12:36 PM, Paul Welch pwelch2004@gmail.com wrote:

If im not mistaken it looks like an issue talking to Solr. However, I
am not sure why it would work on initial install but stop working
later...

Anything interesting in the solr log? Usually /var/log/chef/solr.log.

Bryan

--
Cheers,

Peter Donald

--
Paul Welch
pwelch2004@gmail.com
+1.352.327.8087

Topic		Replies	Views
Knife search ... always fails with a Server Error Chef Infra (archive)	6	403	May 13, 2011
Problem with solr Chef Infra (archive)	1	411	October 11, 2010
Knife status Internal error 500 Chef Infra (archive)	4	1359	June 5, 2018
Search sometimes returns no result Chef Infra (archive)	0	364	January 19, 2011
Chef Search Broken Chef Infra (archive)	5	802	December 5, 2012

Search returns error

Related topics