Custom cookbook

Chef Infra (archive)
1

Hello,

I am having a hard time uploading a cookbook larger than typical cookbooks.
This is a POC cookbook and the vendor was able to upload to chef hosted;
however, I cannot upload to my chef server.

Note: I've updated the /var/opt/opscode/nginx/etc/nginx.conf file and

edited the line for client_max_body_size 2048M;

Also restarted nginx service via chef-server-ctl restart.

Everytime I try to upload the cookbook, I get the following error:

knife cookbook upload dcos

Uploading dcos [0.1.0]
ERROR: Failed to upload
/root/chef/cookbooks/dcos/files/default/bootstrap.tar.xz
(dd69f42f36246af0bfc3dfad0f5d1195) to
https://chef04.theorchard.local:443/bookshelf/organization-436175e59363fc55b3620eecfe443b82/checksum-dd69f42f36246af0bfc3dfad0f5d1195?AWSAccessKeyId=23c9de96b156f0c1a59234ed809e60cafb7a3e5e764&Expires=1437423489325&Signature=toghY/CTHQUHWFbd5TJcOPaIJBE%3D
: 413 "Request Entity Too Large"

413 Request Entity Too Large

413 Request Entity Too Large

openresty/1.7.10.1 *ERROR:* Request Entity Too Large

Any insight would be greatly appreciated.

Thanks,

--
Nikhil Shah • System Administrator
nshah@theorchard.com • p. (+1) 212 308-5648

THE ORCHARD Distribution Done Right
23 E 4th St Fl 3, New York, NY 10003

Follow us: The Daily Rind http://www.dailyrindblog.com/ • Facebook
http://www.facebook.com/theorchard • Twitter
http://www.twitter.com/orchtweets • YouTube
http://www.youtube.com/user/theorchard • LinkedIn
http://www.linkedin.com/company/the-orchard

Privileged And Confidential Communication. This electronic transmission,
and any documents attached hereto, (a) are protected by the Electronic
Communications Privacy Act (18 USC §§ 2510-2521), (b) may contain
confidential and/or legally privileged information, and (c) are for the
sole use of the intended recipient named above. If you have received this
electronic message in error, please notify the sender and delete the
electronic message. Any disclosure, copying, distribution, or use of the
contents of the information received in error is strictly prohibited.

2

You'll want to modify

nginx['client_max_body_size']

in chef-server.rb, and then reconifigure Chef Server. If you modify
the nginx.conf directly, it will get overwritten on a reconfigure.

See https://docs.chef.io/config_rb_server_optional_settings.html

regards,
Julian

On Tue, Jul 21, 2015 at 10:27 AM, Nikhil Shah nshah@theorchard.com wrote:

Hello,

I am having a hard time uploading a cookbook larger than typical cookbooks.
This is a POC cookbook and the vendor was able to upload to chef hosted;
however, I cannot upload to my chef server.

Note: I've updated the /var/opt/opscode/nginx/etc/nginx.conf file and
edited the line for client_max_body_size 2048M;

Also restarted nginx service via chef-server-ctl restart.

Everytime I try to upload the cookbook, I get the following error:

knife cookbook upload dcos
Uploading dcos [0.1.0]
ERROR: Failed to upload
/root/chef/cookbooks/dcos/files/default/bootstrap.tar.xz
(dd69f42f36246af0bfc3dfad0f5d1195) to
https://chef04.theorchard.local:443/bookshelf/organization-436175e59363fc55b3620eecfe443b82/checksum-dd69f42f36246af0bfc3dfad0f5d1195?AWSAccessKeyId=23c9de96b156f0c1a59234ed809e60cafb7a3e5e764&Expires=1437423489325&Signature=toghY/CTHQUHWFbd5TJcOPaIJBE%3D
: 413 "Request Entity Too Large"

413 Request Entity Too Large

413 Request Entity Too Large

openresty/1.7.10.1 ERROR: Request Entity Too Large

Any insight would be greatly appreciated.

Thanks,

--
Nikhil Shah • System Administrator
nshah@theorchard.com • p. (+1) 212 308-5648

THE ORCHARD Distribution Done Right
23 E 4th St Fl 3, New York, NY 10003
www.theorchard.com

Follow us: The Daily Rind • Facebook • Twitter • YouTube • LinkedIn

Privileged And Confidential Communication. This electronic transmission, and
any documents attached hereto, (a) are protected by the Electronic
Communications Privacy Act (18 USC §§ 2510-2521), (b) may contain
confidential and/or legally privileged information, and (c) are for the sole
use of the intended recipient named above. If you have received this
electronic message in error, please notify the sender and delete the
electronic message. Any disclosure, copying, distribution, or use of the
contents of the information received in error is strictly prohibited.

--
[ Julian C. Dunn jdunn@aquezada.com * Sorry, I'm ]
[ WWW: http://www.aquezada.com/staff/julian * only Web 1.0 ]
[ gopher://sdf.org/1/users/keymaker/ * compliant! ]
[ PGP: 91B3 7A9D 683C 7C16 715F 442C 6065 D533 FDC2 05B9 ]

3

Uploading large binary files to the Chef server is "Bad, Mkay(tm)"

I'd look for an httpd server to host bootstrap.tar.xz, and use remote_file

-s

On Tue, Jul 21, 2015 at 10:27 AM, Nikhil Shah nshah@theorchard.com wrote:

Hello,

I am having a hard time uploading a cookbook larger than typical cookbooks.
This is a POC cookbook and the vendor was able to upload to chef hosted;
however, I cannot upload to my chef server.

Note: I've updated the /var/opt/opscode/nginx/etc/nginx.conf file and
edited the line for client_max_body_size 2048M;

Also restarted nginx service via chef-server-ctl restart.

Everytime I try to upload the cookbook, I get the following error:

knife cookbook upload dcos
Uploading dcos [0.1.0]
ERROR: Failed to upload
/root/chef/cookbooks/dcos/files/default/bootstrap.tar.xz
(dd69f42f36246af0bfc3dfad0f5d1195) to
https://chef04.theorchard.local:443/bookshelf/organization-436175e59363fc55b3620eecfe443b82/checksum-dd69f42f36246af0bfc3dfad0f5d1195?AWSAccessKeyId=23c9de96b156f0c1a59234ed809e60cafb7a3e5e764&Expires=1437423489325&Signature=toghY/CTHQUHWFbd5TJcOPaIJBE%3D
: 413 "Request Entity Too Large"

413 Request Entity Too Large

413 Request Entity Too Large

openresty/1.7.10.1 ERROR: Request Entity Too Large

Any insight would be greatly appreciated.

Thanks,

--
Nikhil Shah • System Administrator
nshah@theorchard.com • p. (+1) 212 308-5648

THE ORCHARD Distribution Done Right
23 E 4th St Fl 3, New York, NY 10003
www.theorchard.com

Follow us: The Daily Rind • Facebook • Twitter • YouTube • LinkedIn

Privileged And Confidential Communication. This electronic transmission, and
any documents attached hereto, (a) are protected by the Electronic
Communications Privacy Act (18 USC §§ 2510-2521), (b) may contain
confidential and/or legally privileged information, and (c) are for the sole
use of the intended recipient named above. If you have received this
electronic message in error, please notify the sender and delete the
electronic message. Any disclosure, copying, distribution, or use of the
contents of the information received in error is strictly prohibited.

4

+1
this will be an enormous performance pain. use s3 or something similar, a
file server for all your installers, large files etc. i use remote_file and
s3_file ,

even if you make chefserver work for those large files, your client runs
gonna impact, as these large files will be served in compressed forms,
decompressing them will be cpu intensive, same with checksum computing..

On Tue, Jul 21, 2015 at 9:35 AM, Sean OMeara someara@chef.io wrote:

Uploading large binary files to the Chef server is "Bad, Mkay(tm)"

I'd look for an httpd server to host bootstrap.tar.xz, and use remote_file

-s

On Tue, Jul 21, 2015 at 10:27 AM, Nikhil Shah nshah@theorchard.com
wrote:

Hello,

I am having a hard time uploading a cookbook larger than typical
cookbooks.
This is a POC cookbook and the vendor was able to upload to chef hosted;
however, I cannot upload to my chef server.

Note: I've updated the /var/opt/opscode/nginx/etc/nginx.conf file and
edited the line for client_max_body_size 2048M;

Also restarted nginx service via chef-server-ctl restart.

Everytime I try to upload the cookbook, I get the following error:

knife cookbook upload dcos
Uploading dcos [0.1.0]
ERROR: Failed to upload
/root/chef/cookbooks/dcos/files/default/bootstrap.tar.xz
(dd69f42f36246af0bfc3dfad0f5d1195) to

https://chef04.theorchard.local:443/bookshelf/organization-436175e59363fc55b3620eecfe443b82/checksum-dd69f42f36246af0bfc3dfad0f5d1195?AWSAccessKeyId=23c9de96b156f0c1a59234ed809e60cafb7a3e5e764&Expires=1437423489325&Signature=toghY/CTHQUHWFbd5TJcOPaIJBE%3D

: 413 "Request Entity Too Large"

413 Request Entity Too Large

413 Request Entity Too Large

openresty/1.7.10.1 ERROR: Request Entity Too Large

Any insight would be greatly appreciated.

Thanks,

--
Nikhil Shah • System Administrator
nshah@theorchard.com • p. (+1) 212 308-5648

THE ORCHARD Distribution Done Right
23 E 4th St Fl 3, New York, NY 10003
www.theorchard.com

Follow us: The Daily Rind • Facebook • Twitter • YouTube • LinkedIn

Privileged And Confidential Communication. This electronic transmission,
and
any documents attached hereto, (a) are protected by the Electronic
Communications Privacy Act (18 USC §§ 2510-2521), (b) may contain
confidential and/or legally privileged information, and (c) are for the
sole
use of the intended recipient named above. If you have received this
electronic message in error, please notify the sender and delete the
electronic message. Any disclosure, copying, distribution, or use of the
contents of the information received in error is strictly prohibited.

5

Thanks guys, I ended up taking Sean's advise and hosting the package on a
remote webserver and editing my recipe to use remote_file instead.

On Tue, Jul 21, 2015 at 1:24 PM, Ranjib Dey dey.ranjib@gmail.com wrote:

+1
this will be an enormous performance pain. use s3 or something similar, a
file server for all your installers, large files etc. i use remote_file and
s3_file ,

even if you make chefserver work for those large files, your client runs
gonna impact, as these large files will be served in compressed forms,
decompressing them will be cpu intensive, same with checksum computing..

On Tue, Jul 21, 2015 at 9:35 AM, Sean OMeara someara@chef.io wrote:

Uploading large binary files to the Chef server is "Bad, Mkay(tm)"

I'd look for an httpd server to host bootstrap.tar.xz, and use remote_file

-s

On Tue, Jul 21, 2015 at 10:27 AM, Nikhil Shah nshah@theorchard.com
wrote:

Hello,

I am having a hard time uploading a cookbook larger than typical
cookbooks.
This is a POC cookbook and the vendor was able to upload to chef hosted;
however, I cannot upload to my chef server.

Note: I've updated the /var/opt/opscode/nginx/etc/nginx.conf file and
edited the line for client_max_body_size 2048M;

Also restarted nginx service via chef-server-ctl restart.

Everytime I try to upload the cookbook, I get the following error:

knife cookbook upload dcos
Uploading dcos [0.1.0]
ERROR: Failed to upload
/root/chef/cookbooks/dcos/files/default/bootstrap.tar.xz
(dd69f42f36246af0bfc3dfad0f5d1195) to

https://chef04.theorchard.local:443/bookshelf/organization-436175e59363fc55b3620eecfe443b82/checksum-dd69f42f36246af0bfc3dfad0f5d1195?AWSAccessKeyId=23c9de96b156f0c1a59234ed809e60cafb7a3e5e764&Expires=1437423489325&Signature=toghY/CTHQUHWFbd5TJcOPaIJBE%3D

: 413 "Request Entity Too Large"

413 Request Entity Too Large

413 Request Entity Too Large

openresty/1.7.10.1 ERROR: Request Entity Too Large

Any insight would be greatly appreciated.

Thanks,

--
Nikhil Shah • System Administrator
nshah@theorchard.com • p. (+1) 212 308-5648

THE ORCHARD Distribution Done Right
23 E 4th St Fl 3, New York, NY 10003
www.theorchard.com

Follow us: The Daily Rind • Facebook • Twitter • YouTube • LinkedIn

Privileged And Confidential Communication. This electronic
transmission, and
any documents attached hereto, (a) are protected by the Electronic
Communications Privacy Act (18 USC §§ 2510-2521), (b) may contain
confidential and/or legally privileged information, and (c) are for the
sole
use of the intended recipient named above. If you have received this
electronic message in error, please notify the sender and delete the
electronic message. Any disclosure, copying, distribution, or use of the
contents of the information received in error is strictly prohibited.

--
Nikhil Shah • System Administrator
nshah@theorchard.com • p. (+1) 212 308-5648

THE ORCHARD Distribution Done Right
23 E 4th St Fl 3, New York, NY 10003

Follow us: The Daily Rind http://www.dailyrindblog.com/ • Facebook
http://www.facebook.com/theorchard • Twitter
http://www.twitter.com/orchtweets • YouTube
http://www.youtube.com/user/theorchard • LinkedIn
http://www.linkedin.com/company/the-orchard

Privileged And Confidential Communication. This electronic transmission,
and any documents attached hereto, (a) are protected by the Electronic
Communications Privacy Act (18 USC §§ 2510-2521), (b) may contain
confidential and/or legally privileged information, and (c) are for the
sole use of the intended recipient named above. If you have received this
electronic message in error, please notify the sender and delete the
electronic message. Any disclosure, copying, distribution, or use of the
contents of the information received in error is strictly prohibited.