Andrew Turner ajturner

Auto-deploying built products to gh-pages with GitHub Actions

This is a set up for projects which want to check in only their source files, but have their gh-pages branch automatically updated with some compiled output every time they push.

A file below this one contains the steps for doing this with Travis CI. However, these days I recommend GitHub Actions, for the following reasons:

It is much easier and requires less steps, because you are already authenticated with GitHub, so you don't need to share secret keys across services like you do when coordinate Travis CI and GitHub.
It is free, with no quotas.
Anecdotally, builds are much faster with GitHub Actions than with Travis CI, especially in terms of time spent waiting for a builder.

Description

This simple script will take a picture of a whiteboard and use parts of the ImageMagick library with sane defaults to clean it up tremendously.

The script is here:

#!/bin/bash
convert "$1" -morphology Convolve DoG:15,100,0 -negate -normalize -blur 0x1 -channel RBG -level 60%,91%,0.1 "$2"

Results

Leaflet - 34.23k - http://leafletjs.com/download.html
Esri Leaflet 47.15k - https://github.com/Esri/esri-leaflet/blob/master/dist/esri-leaflet.js
Mapbox 58.64k - http://www.mapbox.com/mapbox.js/api/v1.3.1/
OpenLayers 3 85.53k - http://ol3js.org/
CartoDB 150.25k - http://developers.cartodb.com/documentation/cartodb-js.html#sec-1
OpenLayers 2 187.78k - http://openlayers.org/api/OpenLayers.js
Esri Compact 204.54k (no Dijit theme) - http://js.arcgis.com/3.6compact/
Esri Standard 325.43k (Claro Dijit theme)- http://js.arcgis.com/3.6/

The command I used to estimate the size once gzipped is gzip -c filename.min.js | wc -c. Every library except open layers includes it CSS in the total size. Esri Standard includes the Claro widget theme but compact does not.

What is this? It's about 7 years of OpenStreetMap growth. Each step in the animation is 72 days, and the colors alternate between red and blue. The data is from Latest Weekly Changesets from planet.openstreetmap.org, processed into an SQLite database with sometimemachine. The points being drawn are the centers of the bounding boxes of changesets. There are 13,098,655 changesets in the database. The script to generate the visualization is below, and the rest of the make steps are

gm mogrify -format gif *.png
gifsicle --loop -d20 *.gif > ../animation.gif

Requiring gifsicle and graphicsmagick.

Fast growth in rectangular areas (like the DRC) is typically because of imports to the OSM data from other open datasources. The d

Locate the section for your github remote in the .git/config file. It looks like this:

[remote "origin"]
	fetch = +refs/heads/*:refs/remotes/origin/*
	url = git@github.com:joyent/node.git

Now add the line fetch = +refs/pull/*/head:refs/remotes/origin/pr/* to this section. Obviously, change the github url to match your project's URL. It ends up looking like this:

	import base64 as b64
	import numpy as np
	import cv2
	import matplotlib.pyplot as plt
	from ipywidgets import interact, interactive, fixed
	from IPython.display import Image, display
	import ipywidgets as widgets
	from itertools import tee, izip

	WINDOW_SIZE = 41 # size of window to use when computing averages. Endpoint images outside

	<!DOCTYPE html>
	<html lang="en">
	<head>
	<title>Portal Pagnation</title>
	<meta charset="utf-8">
	<meta name="viewport" content="width=device-width, initial-scale=1">
	<link rel="stylesheet" href="http://maxcdn.bootstrapcdn.com/bootstrap/3.3.5/css/bootstrap.min.css">

	<script src="https://ajax.googleapis.com/ajax/libs/jquery/1.11.3/jquery.min.js"></script>
	<script src="http://maxcdn.bootstrapcdn.com/bootstrap/3.3.5/js/bootstrap.min.js"></script>

	#!/bin/bash


	#### SETUP
	# 1.) Create a simple point layer
	curl -X POST -d '{"layer":"geom","lat":"lat","lon":"lon"}' --header "Content-Type:application/json" http://localhost:7474/db/data/ext/SpatialPlugin/graphdb/addSimplePointLayer

	# 2.) Add a spatial index
	curl -X POST -d '{"name":"geom","config":{"provider":"spatial","geometry_type":"point","lat":"lat","lon":"lon"}}' --header "Content-Type:application/json" http://localhost:7474/db/data/index/node/

	import os, urllib, urllib2, datetime, arcpy, json


	## ============================================================================== ##
	## function to update a field - basically converts longs to dates for date fields ##
	## since json has dates as a long (milliseconds since unix epoch) and geodb wants ##
	## a proper date, not a long.
	## ============================================================================== ##
	def updateValue(row,field_to_update,value):
	outputfield=next((f for f in fields if f.name ==field_to_update),None) #find the output field

	var gpio = require("gpio")
	var gpio22, intervalTimer

	// Flashing lights if LED connected to GPIO22
	gpio22 = gpio.export(22, {
	ready: blinkLED
	})

	function blinkLED() {
	intervalTimer = setInterval(function() {