On-Prem Builder Issues

js2 · October 3, 2018, 12:30pm

We are trying to deploy a new on-prem builder and are running into a few issues - that we have resolved or just moved past but the scripts/files need to be updated. Everything on github I’ll submit issues for but what is the best way to get the missing package included in the latest tar ball.

https://s3-us-west-2.amazonaws.com/habitat-on-prem-builder-bootstrap/LATEST.tar.gz
Is missing the package below and stopped the upload process.
core-dsc-core-0.1.0-20180531140858-x86_64-windows.hart
It was trying to upload core-sqlserver-ha-ag package when it couldn’t find the dependency above.
core-sqlserver-ha-ag-0.1.0-20180604150248-x86_64-windows.hart

github.com

habitat-sh/on-prem-builder/blob/master/bldr.env.sample#L6


#!/bin/bash


# The endpoint, key and secret for your Minio instance (see README)
# Change these before the first install if needed
export MINIO_ENDPOINT=http://localhost:9000
export MINIO_BUCKET=habitat-builder-artifact-store.local
export MINIO_ACCESS_KEY=depot
export MINIO_SECRET_KEY=password


# Modify these as needed for the on-premise OAuth2 provider.
# The variables below are configured for GitHub by default,
# but appropriate values for Bitbucket, GitLab, Azure AD and Okta
# are also included as comments.


# Whether SSL is enabled for the on-prem depot
export APP_SSL_ENABLED=false

habitat-builder-artifact-store - now uses .default vs .local
export MINIO_BUCKET=habitat-builder-artifact-store.local

github.com

habitat-sh/on-prem-builder/blob/master/scripts/provision.sh#L58


  ANALYTICS_COMPANY_ID=""
  ANALYTICS_COMPANY_NAME=""
fi


mkdir -p /hab/svc/builder-minio
cat <<EOT > /hab/svc/builder-minio/user.toml
key_id = "depot"
secret_key = "password"
EOT


mkdir -p /hab/svc/builder-api
cat <<EOT > /hab/svc/builder-api/user.toml
log_level="info"
jobsrv_enabled = false


[api]
features_enabled = ""
targets = ["x86_64-linux", "x86_64-linux-kernel2", "x86_64-windows"]


[depot]
jobsrv_enabled = false

Is missing a section for

[datastore]
password = "<%= @password %>"

github.com

habitat-sh/on-prem-builder/blob/master/scripts/provision.sh#L267


125,
126,
127
]


[datastore]
password = "$PGPASSWORD"
EOT
}


start_api() {
sudo -E hab svc load "${BLDR_ORIGIN}/builder-api" --bind router:builder-router.default --bind memcached:builder-memcached.default --channel "${BLDR_CHANNEL}" --force
}


start_api_proxy() {
sudo -E hab svc load "${BLDR_ORIGIN}/builder-api-proxy" --bind http:builder-api.default --channel "${BLDR_CHANNEL}" --force
}


start_datastore() {
sudo -E hab svc load "${BLDR_ORIGIN}/builder-datastore" --channel "${BLDR_CHANNEL}" --force
}

Is missing a bind --bind datastore:builder-datastore.default

start_api() {
  sudo -E hab svc load "${BLDR_ORIGIN}/builder-api" --bind router:builder-router.default --bind memcached:builder-memcached.default --channel "${BLDR_CHANNEL}" --force
}

elliott-davis · October 3, 2018, 1:00pm

TL;DR that bootstrap file is sometimes wrong and we’re looking into ways to make it better. The easiest way to get the dependent hart on your local depot is to download it locally (by installing from upstream) and then upload the cached hart from /hab/cache/artifacts/<PKG> to your local depot

Salim_Alam · October 3, 2018, 5:18pm

Yes looks like the minio bucket config is broken - will issue a couple of PRs to fix that: 1) set the default config in builder-minio to habitat-builder-artifact-store.local; 2) set the bucket config in provision.sh correctly

Salim_Alam · October 3, 2018, 5:24pm

PR to fix the bucket config (merged) - https://github.com/habitat-sh/on-prem-builder/pull/103

Topic		Replies	Views
On-Premise Habitat Depot Packages Migration Habitat Announcements	0	559	June 19, 2018
On-prem builder upstream_depot seems to not be working Habitat Help	8	665	June 22, 2018
On-prem builder core origin package download failure Habitat Help	19	849	June 26, 2018
On-prem builder api port not binding Habitat Help builder	3	680	May 7, 2020
Cannot download packages from on-prem builder Habitat Help	7	941	August 13, 2018

On-Prem Builder Issues

Related topics