Re: Re: Re: chef 10.12 slower?


#1

There’s a bug for this (don’t have the link but it was filed recently)…it’s only omnibus and only on platforms where omnibus has the newer version of rubygems

Sent from my phone… Excuse horrible formatting.

John Alberts john.m.alberts@gmail.com wrote:

Sorry about that. I forgot to mention these are omnibus installer
installations. Wow, what a difference then between the two projects, a
7.5x increase in just the initial startup time.

On Mon, Aug 6, 2012 at 3:23 PM, Bryan McLellan btm@loftninjas.org wrote:

On Mon, Aug 6, 2012 at 1:15 PM, John Alberts john.m.alberts@gmail.com
wrote:

Anyone else notice chef 10.12 release being significantly slow just on
startup compared to 10.10?

Most of the 10.12.0 packages were built with the new ruby omnibus
project whereas 0.10.10 was mostly the clojure omnibus project, so
there could be significant differences there.

Bryan


John Alberts


#2

Looks like this already filed as a bug here:
http://tickets.opscode.com/browse/CHEF-3295. Thanks for pointing that out
and I guess I should have searched JIRA first. :slight_smile:

John

On Mon, Aug 6, 2012 at 3:59 PM, Phil Dibowitz phil@ipom.com wrote:

There’s a bug for this (don’t have the link but it was filed
recently)…it’s only omnibus and only on platforms where omnibus has the
newer version of rubygems

Sent from my phone… Excuse horrible formatting.

John Alberts john.m.alberts@gmail.com wrote:

Sorry about that. I forgot to mention these are omnibus installer
installations. Wow, what a difference then between the two projects, a
7.5x increase in just the initial startup time.

On Mon, Aug 6, 2012 at 3:23 PM, Bryan McLellan btm@loftninjas.org
wrote:

On Mon, Aug 6, 2012 at 1:15 PM, John Alberts john.m.alberts@gmail.com
wrote:

Anyone else notice chef 10.12 release being significantly slow just on
startup compared to 10.10?

Most of the 10.12.0 packages were built with the new ruby omnibus
project whereas 0.10.10 was mostly the clojure omnibus project, so
there could be significant differences there.

Bryan


John Alberts


John Alberts


#3

Yes, I can verify this. I also confirmed it was Ruby 1.9.2 by switching
out to 1.9.3. For me it wasn’t a big deal so I just decided to wait until
Ruby gets bumped…

–Charlie

On Mon, Aug 6, 2012 at 4:05 PM, John Alberts john.m.alberts@gmail.comwrote:

Looks like this already filed as a bug here:
http://tickets.opscode.com/browse/CHEF-3295. Thanks for pointing that
out and I guess I should have searched JIRA first. :slight_smile:

John

On Mon, Aug 6, 2012 at 3:59 PM, Phil Dibowitz phil@ipom.com wrote:

There’s a bug for this (don’t have the link but it was filed
recently)…it’s only omnibus and only on platforms where omnibus has the
newer version of rubygems

Sent from my phone… Excuse horrible formatting.

John Alberts john.m.alberts@gmail.com wrote:

Sorry about that. I forgot to mention these are omnibus installer
installations. Wow, what a difference then between the two projects, a
7.5x increase in just the initial startup time.

On Mon, Aug 6, 2012 at 3:23 PM, Bryan McLellan btm@loftninjas.org
wrote:

On Mon, Aug 6, 2012 at 1:15 PM, John Alberts <john.m.alberts@gmail.com

wrote:

Anyone else notice chef 10.12 release being significantly slow just
on

startup compared to 10.10?

Most of the 10.12.0 packages were built with the new ruby omnibus
project whereas 0.10.10 was mostly the clojure omnibus project, so
there could be significant differences there.

Bryan


John Alberts


John Alberts


Charles Sullivan
charlie.sullivan@gmail.com


#4

FWIW, seems related to https://github.com/rubygems/rubygems/issues/73

Would be great to see this resolved. Very irritating.

KC

On Mon, Aug 6, 2012 at 2:20 PM, Charles Sullivan
charlie.sullivan@gmail.com wrote:

Yes, I can verify this. I also confirmed it was Ruby 1.9.2 by switching out
to 1.9.3. For me it wasn’t a big deal so I just decided to wait until Ruby
gets bumped…

–Charlie

On Mon, Aug 6, 2012 at 4:05 PM, John Alberts john.m.alberts@gmail.com
wrote:

Looks like this already filed as a bug here:
http://tickets.opscode.com/browse/CHEF-3295. Thanks for pointing that out
and I guess I should have searched JIRA first. :slight_smile:

John

On Mon, Aug 6, 2012 at 3:59 PM, Phil Dibowitz phil@ipom.com wrote:

There’s a bug for this (don’t have the link but it was filed
recently)…it’s only omnibus and only on platforms where omnibus has the
newer version of rubygems

Sent from my phone… Excuse horrible formatting.

John Alberts john.m.alberts@gmail.com wrote:

Sorry about that. I forgot to mention these are omnibus installer
installations. Wow, what a difference then between the two projects, a
7.5x increase in just the initial startup time.

On Mon, Aug 6, 2012 at 3:23 PM, Bryan McLellan btm@loftninjas.org
wrote:

On Mon, Aug 6, 2012 at 1:15 PM, John Alberts
john.m.alberts@gmail.com
wrote:

Anyone else notice chef 10.12 release being significantly slow just
on
startup compared to 10.10?

Most of the 10.12.0 packages were built with the new ruby omnibus
project whereas 0.10.10 was mostly the clojure omnibus project, so
there could be significant differences there.

Bryan


John Alberts


John Alberts


Charles Sullivan
charlie.sullivan@gmail.com


#5

Hi,

I confirm that with ruby 1.9.2 (from Omnibus or not) chef-client launch
times are 20 times higher (from 20 to 30 seconds on a typical ubuntu 12.04
m1.small on EC2).
Solved by migrating to ruby 1.9.3 where needed, and I’ll stay with Ruby
1.8.7 where I can (launch times usually under 2 seconds).

Cheers,
Stef

On Mon, Aug 6, 2012 at 11:40 PM, KC Braunschweig
kcbraunschweig@gmail.comwrote:

FWIW, seems related to https://github.com/rubygems/rubygems/issues/73

Would be great to see this resolved. Very irritating.

KC

On Mon, Aug 6, 2012 at 2:20 PM, Charles Sullivan
charlie.sullivan@gmail.com wrote:

Yes, I can verify this. I also confirmed it was Ruby 1.9.2 by switching
out
to 1.9.3. For me it wasn’t a big deal so I just decided to wait until
Ruby
gets bumped…

–Charlie

On Mon, Aug 6, 2012 at 4:05 PM, John Alberts john.m.alberts@gmail.com
wrote:

Looks like this already filed as a bug here:
http://tickets.opscode.com/browse/CHEF-3295. Thanks for pointing that
out

and I guess I should have searched JIRA first. :slight_smile:

John

On Mon, Aug 6, 2012 at 3:59 PM, Phil Dibowitz phil@ipom.com wrote:

There’s a bug for this (don’t have the link but it was filed
recently)…it’s only omnibus and only on platforms where omnibus has
the

newer version of rubygems

Sent from my phone… Excuse horrible formatting.

John Alberts john.m.alberts@gmail.com wrote:

Sorry about that. I forgot to mention these are omnibus installer
installations. Wow, what a difference then between the two projects,
a

7.5x increase in just the initial startup time.

On Mon, Aug 6, 2012 at 3:23 PM, Bryan McLellan btm@loftninjas.org
wrote:

On Mon, Aug 6, 2012 at 1:15 PM, John Alberts
john.m.alberts@gmail.com
wrote:

Anyone else notice chef 10.12 release being significantly slow
just

on
startup compared to 10.10?

Most of the 10.12.0 packages were built with the new ruby omnibus
project whereas 0.10.10 was mostly the clojure omnibus project, so
there could be significant differences there.

Bryan


John Alberts


John Alberts


Charles Sullivan
charlie.sullivan@gmail.com


Stephane Jourdan sjourdan@greenalto.com
Green Alto (La Fabrique)
10, Rue Chaptal / 34000 Montpellier, FR
+33(0)484-252-190 / +33(0)684-531-618


#6

How do you update the ruby for an Omnibus installed chef-client?

On Tue, Aug 7, 2012 at 9:26 AM, Stéphane Jourdan sjourdan@greenalto.comwrote:

Hi,

I confirm that with ruby 1.9.2 (from Omnibus or not) chef-client launch
times are 20 times higher (from 20 to 30 seconds on a typical ubuntu 12.04
m1.small on EC2).
Solved by migrating to ruby 1.9.3 where needed, and I’ll stay with Ruby
1.8.7 where I can (launch times usually under 2 seconds).

Cheers,
Stef

On Mon, Aug 6, 2012 at 11:40 PM, KC Braunschweig <kcbraunschweig@gmail.com

wrote:

FWIW, seems related to https://github.com/rubygems/rubygems/issues/73

Would be great to see this resolved. Very irritating.

KC

On Mon, Aug 6, 2012 at 2:20 PM, Charles Sullivan
charlie.sullivan@gmail.com wrote:

Yes, I can verify this. I also confirmed it was Ruby 1.9.2 by
switching out
to 1.9.3. For me it wasn’t a big deal so I just decided to wait until
Ruby
gets bumped…

–Charlie

On Mon, Aug 6, 2012 at 4:05 PM, John Alberts john.m.alberts@gmail.com
wrote:

Looks like this already filed as a bug here:
http://tickets.opscode.com/browse/CHEF-3295. Thanks for pointing
that out

and I guess I should have searched JIRA first. :slight_smile:

John

On Mon, Aug 6, 2012 at 3:59 PM, Phil Dibowitz phil@ipom.com wrote:

There’s a bug for this (don’t have the link but it was filed
recently)…it’s only omnibus and only on platforms where omnibus has
the

newer version of rubygems

Sent from my phone… Excuse horrible formatting.

John Alberts john.m.alberts@gmail.com wrote:

Sorry about that. I forgot to mention these are omnibus installer
installations. Wow, what a difference then between the two
projects, a

7.5x increase in just the initial startup time.

On Mon, Aug 6, 2012 at 3:23 PM, Bryan McLellan btm@loftninjas.org
wrote:

On Mon, Aug 6, 2012 at 1:15 PM, John Alberts
john.m.alberts@gmail.com
wrote:

Anyone else notice chef 10.12 release being significantly slow
just

on
startup compared to 10.10?

Most of the 10.12.0 packages were built with the new ruby omnibus
project whereas 0.10.10 was mostly the clojure omnibus project, so
there could be significant differences there.

Bryan


John Alberts


John Alberts


Charles Sullivan
charlie.sullivan@gmail.com


Stephane Jourdan sjourdan@greenalto.com
Green Alto (La Fabrique)
10, Rue Chaptal / 34000 Montpellier, FR
+33(0)484-252-190 / +33(0)684-531-618


John Alberts


#7

Ohai!

On Aug 6, 2012, at 3:05 PM, John Alberts john.m.alberts@gmail.com wrote:

Looks like this already filed as a bug here: http://tickets.opscode.com/browse/CHEF-3295. Thanks for pointing that out and I guess I should have searched JIRA first. :slight_smile:

It’s not a particularly intuitive thing to search for - I found that ticket because I knew the topic precisely, and I had seen that ticket before :-).

I created a pull request that updates both Ruby and RubyGems to the latest current versions. This also relates to CHEF-2871, which was specific about updating to Ruby 1.9.3.

You may see some improvement by simply updating the RubyGems version on a system. You can do that with this:

% sudo /opt/chef/embedded/bin/gem update --system

To illustrate that this may positively affect the performance on its own, an isolated example (my 2 core, 8G Ubuntu 12.04 system):

% /opt/chef/embedded/bin/gem --version
1.8.12

% time chef-client --help
real 0m13.034s
user 0m11.881s
sys 0m0.408s

% sudo /opt/chef/embedded/bin/gem update --system
…RubyGems 1.8.24 installed…

% /opt/chef/embedded/bin/gem --version
1.8.24

% time chef-client --help
real 0m2.286s
user 0m1.912s
sys 0m0.296s


#8

On Tue, Aug 7, 2012 at 12:04 PM, Joshua Timberman joshua@opscode.comwrote:

You may see some improvement by simply updating the RubyGems version on a
system.

Wow, that did it. Updated from rubygems 1.8.12 to 1.8.24 and running
chef-client -h went from 10.1s to 1.6s! :slight_smile:
Thank you.


John Alberts


#9

On Tue, Aug 7, 2012 at 7:11 PM, John Alberts john.m.alberts@gmail.com wrote:

On Tue, Aug 7, 2012 at 12:04 PM, Joshua Timberman joshua@opscode.com
wrote:

You may see some improvement by simply updating the RubyGems version on a
system.

Wow, that did it. Updated from rubygems 1.8.12 to 1.8.24 and running
chef-client -h went from 10.1s to 1.6s! :slight_smile:

Another data point: this speeds up even ruby 1.9.3 tremendously.
On a (rather old, Atom-based, slow server) chef-client -h went from 34s to 9s

Andrea


#10

On Wed, Aug 8, 2012 at 2:59 AM, Andrea Campi
andrea.campi@zephirworks.com wrote:

Wow, that did it. Updated from rubygems 1.8.12 to 1.8.24 and running
chef-client -h went from 10.1s to 1.6s! :slight_smile:

Another data point: this speeds up even ruby 1.9.3 tremendously.
On a (rather old, Atom-based, slow server) chef-client -h went from 34s to 9s

FYI, the Chef 10.14.0 Omnibus release is planned to be built on Ruby
1.9.3-p194 and Rubygems 1.8.24. A release candidate should be
available on Monday.

http://tickets.opscode.com/browse/CHEF-3295

Bryan