Michael Sauter michaelsauter

ODS Pipeline Introduction

Moved to https://github.com/michaelsauter/ods-pipeline/wiki so that it can be split up into multiple documents ...

✂️ Get rid of that boilerplate!

From:

def final projectId = 'foo'
def final componentId = 'bar'
def final credentialsId = "${projectId}-cd-cd-user-with-password"
def dockerRegistry
node {
  dockerRegistry = env.DOCKER_REGISTRY
}

Work Packages for OpenDevStack 3.0

Release timeline: May 2020. Theme: Quality

Shared Library Testing

Owner(s): ? / Size: M / Benefit: Reliable pipelines, more confidence in changes / Ticket(s): #149, #146

Write automated tests for the shared library. Could be a mixed of tests with mocks and E2E tests. Run e.g. in Travis or Github Actions.

Project Provisioning Testing

Interview Task

Objective

As a Farmera developer, synchronize temperature data reliably from an external vendor, myfarm.io, with Farmera. What kind of concepts / entities do you need to implement in our service? How will you do the interaction with myfarm.io? If you need more information about the API, please ask.

API Documentation myfarm.io

Example request

curl 'https://api.myfarm.io/devices/123/temperature?start=2019-01-06T00%3A00%3A00Z&amp;end=2019-01-09T00%3A00%3A00Z&amp;groupBy=FIFTEEN_MINUTES' -i -u 'user:secret' -X GET

Encrypt file:

gpg --encrypt --armor --recipient email@example.com file

Decrypt file:

gpg --decrypt file

	{"level":"info","logger":"tekton","caller":"controller/controller.go:436","msg":"Reconcile failed. Time taken: 10.692465ms","knative.dev/traceid":"686039a6-50ca-4c45-888d-c2d5574bb1d1","knative.dev/key":"unitt-dev/build-and-deploy-run-6xqb9"}
	{"level":"info","logger":"tekton.event-broadcaster","caller":"record/event.go:274","msg":"Event(v1.ObjectReference{Kind:\"PipelineRun\", Namespace:\"unitt-dev\", Name:\"build-and-deploy-run-6xqb9\", UID:\"f9649a7f-4121-49ec-ae62-e686564cf75b\", APIVersion:\"tekton.dev/v1beta1\", ResourceVersion:\"297003666\", FieldPath:\"\"}): type: 'Warning' reason: 'InternalError' 1 error occurred:\n\t* failed to delete StatefulSet affinity-assistant-402a8246ef: statefulsets.apps \"affinity-assistant-402a8246ef\" not found\n\n"}
	{"level":"warn","logger":"tekton","caller":"artifacts/artifacts_storage.go:201","msg":"the configmap has no data","knative.dev/traceid":"890f787f-b29f-46e3-960f-436bac4599dc","knative.dev/key":"unitt-dev/build-and-deploy-run-8sxp8"}
	{"level":"error","logger":"t

	odsComponentPipeline(
	imageStreamTag: 'ods/jenkins-agent-base:3.x'
	) {
	odsComponentStageImportOpenShiftImageOrElse(context) {
	stage('Build') {
	sh './gradlew build'
	}
	odsComponentStageBuildOpenShiftImage(context)
	}

	import org.ods.service.ServiceRegistry
	import org.ods.util.GitUtil
	import org.ods.util.Project

	def runOnAgentPod(Project project, boolean condition, Closure block) {
	if (condition) {
	def git = ServiceRegistry.instance.get(GitUtil)
	dir(env.WORKSPACE) {
	stash(name: 'wholeWorkspace', includes: '*/,**/.git', useDefaultExcludes: false)
	}

	# Update local repo
	git fetch origin --prune

	# Merged branches at least 2 months old
	for branch in `git branch -r --merged \| grep -v HEAD`; do echo -e `git show --format="%ci %cr %an" $branch \| head -n 1` \\t$branch; done \| grep "months" \| awk '{print $(NF)}' \| sed -e "s/^origin\///" \| xargs git push origin --delete --dry-run

	# All branches at least a year old
	for branch in `git branch -r \| grep -v HEAD`; do echo -e `git show --format="%ci %cr %an" $branch \| head -n 1` \\t$branch; done \| grep "1 year" \| awk '{print $(NF)}' \| sed -e "s/^origin\///" \| xargs git push origin --delete --dry-run

	check:
	@terraform version \| grep "Terraform v0\.8\.[0-9]*" >/dev/null; case $$? in \
	1) echo You need Terraform version 0.8.x!; exit 1;; \
	esac

	config: check
	@terraform remote config -backend=s3 -backend-config="bucket=xxx-terraform-state" -backend-config="key=yyy/terraform.tfstate" -backend-config="region=eu-central-1"

	plan: config
	@terraform plan -out terraform.tfplan