Segmentation fault in gecode

I upgraded my Chef server to 0.10, and now getting segfault in gecode. Ruby
server goes down when client sends /environments/_default/cookbook_versions
request.

Server log snippet: http://pastie.org/1869858
Client log snippet: http://pastie.org/1868940

Any ideas what’s happening? The system is Ubuntu 10.10, installed Gecode 3.5.0
using source tarball and manual build.

Alex

On Thu, May 5, 2011 at 4:25 PM, AlexS vodkin40@hotmail.com wrote:

Any ideas what's happening? The system is Ubuntu 10.10, installed Gecode 3.5.0
using source tarball and manual build.

Is Chef installed using gems? Can you provide the output of 'gem list'
as well please?

Bryan

List of installed gems: http://pastie.org/1869952

From: btm@loftninjas.org
Date: Thu, 5 May 2011 16:27:27 -0700
To: chef@lists.opscode.com
Subject: [chef] Re: Segmentation fault in gecode

On Thu, May 5, 2011 at 4:25 PM, AlexS vodkin40@hotmail.com wrote:

Any ideas what's happening? The system is Ubuntu 10.10, installed Gecode 3.5.0
using source tarball and manual build.

Is Chef installed using gems? Can you provide the output of 'gem list'
as well please?

Bryan

One tactic would be edit ext/dep_gecode/dep_selector_to_gecode.cpp and
un-comment the #define DEBUG line, and recompile/install. You'll get a whole
pile of debug output that would be very helpful.

On Thu, May 5, 2011 at 4:55 PM, vodkin40 vodkin40@hotmail.com wrote:

List of installed gems: http://pastie.org/1869952

From: btm@loftninjas.org
Date: Thu, 5 May 2011 16:27:27 -0700
To: chef@lists.opscode.com
Subject: [chef] Re: Segmentation fault in gecode

On Thu, May 5, 2011 at 4:25 PM, AlexS vodkin40@hotmail.com wrote:

Any ideas what's happening? The system is Ubuntu 10.10, installed
Gecode 3.5.0
using source tarball and manual build.

Is Chef installed using gems? Can you provide the output of 'gem list'
as well please?

Bryan

Mark, can you provide more detailed instructions how to "recompile/install" dep_selector? I'm not an expert in gem. I tried to modify the .cpp file as you prescribed, but when I run "sudo gem install dep_selector", gem restores the original version of the file.

Date: Thu, 5 May 2011 17:33:09 -0700
From: mark@opscode.com
To: chef@lists.opscode.com
Subject: [chef] Re: RE: Re: Segmentation fault in gecode

One tactic would be edit ext/dep_gecode/dep_selector_to_gecode.cpp and un-comment the #define DEBUG line, and recompile/install. You'll get a whole pile of debug output that would be very helpful.

On Thu, May 5, 2011 at 4:55 PM, vodkin40 vodkin40@hotmail.com wrote:

List of installed gems: http://pastie.org/1869952

From: btm@loftninjas.org
Date: Thu, 5 May 2011 16:27:27 -0700

To: chef@lists.opscode.com
Subject: [chef] Re: Segmentation fault in gecode

On Thu, May 5, 2011 at 4:25 PM, AlexS vodkin40@hotmail.com wrote:

Any ideas what's happening? The system is Ubuntu 10.10, installed Gecode 3.5.0
using source tarball and manual build.

Is Chef installed using gems? Can you provide the output of 'gem list'

as well please?

Bryan

Sorry about the somewhat terse instructions. I knew it might be a pain to
make the change at the c code level, but I wanted to give you what I could
while I added a debug flag at the ruby layer. I've done so and uploaded
version 0.0.8 of the gem.

If you install the new gem, and and change the variable DebugLogsOn to true,
you will quite verbose debug information, and I should be able to recreate
the inputs (and hopefully the bug) from that.

Use
% gem which dep_selector
to find the path of the gem. On my mac, I get
/Library/Ruby/Gems/1.8/gems/dep_selector-0.0.8/lib/dep_selector.rb

Edit the file /dep_selector-0.0.8/lib/dep_selector/gecode_wrapper.rb
On line 29, change the assignment of DebugLogsOn to true

Restart your server and run the test case.

I'd love it if you could send me the logs of the failure, starting at the
text "Creating VersionProblem with args" and ending with the crash.

Thanks!

On Fri, May 6, 2011 at 11:33 AM, vodkin40 vodkin40@hotmail.com wrote:

Mark, can you provide more detailed instructions how to
"recompile/install" dep_selector? I'm not an expert in gem. I tried to
modify the .cpp file as you prescribed, but when I run "sudo gem install
dep_selector", gem restores the original version of the file.


Date: Thu, 5 May 2011 17:33:09 -0700
From: mark@opscode.com

To: chef@lists.opscode.com
Subject: [chef] Re: RE: Re: Segmentation fault in gecode

One tactic would be edit ext/dep_gecode/dep_selector_to_gecode.cpp and
un-comment the #define DEBUG line, and recompile/install. You'll get a whole
pile of debug output that would be very helpful.

On Thu, May 5, 2011 at 4:55 PM, vodkin40 vodkin40@hotmail.com wrote:

List of installed gems: http://pastie.org/1869952

From: btm@loftninjas.org
Date: Thu, 5 May 2011 16:27:27 -0700
To: chef@lists.opscode.com
Subject: [chef] Re: Segmentation fault in gecode

On Thu, May 5, 2011 at 4:25 PM, AlexS vodkin40@hotmail.com wrote:

Any ideas what's happening? The system is Ubuntu 10.10, installed
Gecode 3.5.0
using source tarball and manual build.

Is Chef installed using gems? Can you provide the output of 'gem list'
as well please?

Bryan

I'm ok with changing C code, wasn't clear how to reinstall the native extension.
I followed your instructions, not much information in log, so I also attached gdb callstack
http://pastie.org/1882344

Date: Fri, 6 May 2011 15:05:13 -0700
From: mark@opscode.com
To: chef@lists.opscode.com
Subject: [chef] Re: RE: Re: RE: Re: Segmentation fault in gecode

Sorry about the somewhat terse instructions. I knew it might be a pain to make the change at the c code level, but I
wanted to give you what I could while I added a debug flag at the ruby
layer. I've done so and uploaded version 0.0.8 of the gem.

If you install the new gem, and and change the variable DebugLogsOn to true, you will quite verbose debug information, and I should be able to recreate the inputs (and hopefully the bug) from that.

Use
% gem which dep_selector
to find the path of the gem. On my mac, I get
/Library/Ruby/Gems/1.8/gems/dep_selector-0.0.8/lib/dep_selector.rb

Edit the file /dep_selector-0.0.8/lib/dep_selector/gecode_wrapper.rb

On line 29, change the assignment of DebugLogsOn to true

Restart your server and run the test case.

I'd love it if you could send me the logs of the failure, starting at the text "Creating VersionProblem with args" and ending with the crash.

Thanks!

On Fri, May 6, 2011 at 11:33 AM, vodkin40 vodkin40@hotmail.com wrote:

Mark, can you provide more detailed instructions how to "recompile/install" dep_selector? I'm not an expert in gem. I tried to modify the .cpp file as you prescribed, but when I run "sudo gem install dep_selector", gem restores the original version of the file.

Date: Thu, 5 May 2011 17:33:09 -0700
From: mark@opscode.com
To: chef@lists.opscode.com

Subject: [chef] Re: RE: Re: Segmentation fault in gecode

One tactic would be edit ext/dep_gecode/dep_selector_to_gecode.cpp and un-comment the #define DEBUG line, and recompile/install. You'll get a whole pile of debug output that would be very helpful.

On Thu, May 5, 2011 at 4:55 PM, vodkin40 vodkin40@hotmail.com wrote:

List of installed gems: http://pastie.org/1869952

From: btm@loftninjas.org
Date: Thu, 5 May 2011 16:27:27 -0700

To: chef@lists.opscode.com
Subject: [chef] Re: Segmentation fault in gecode

On Thu, May 5, 2011 at 4:25 PM, AlexS vodkin40@hotmail.com wrote:

Any ideas what's happening? The system is Ubuntu 10.10, installed Gecode 3.5.0
using source tarball and manual build.

Is Chef installed using gems? Can you provide the output of 'gem list'

as well please?

Bryan