Paul Smith paulsmith

Purpose

Bootstrap knowledge of LLMs ASAP. With a bias/focus to GPT.

Avoid being a link dump. Try to provide only valuable well tuned information.

Prelude

Neural network links before starting with transformers.

When to use generics

aka generic guidelines

It's late 2021, and Go is about to add "generics" (i.e., type parameters for types and functions) to upcoming release version 1.18.

Here is some guidance for Go programmers, cribbed from a talk by Ian Lance Taylor.

First, write Go programs by writing code, not by defining types.

Intel 4004, first microprocessor: http://www.computerhistory.org/collections/catalog/102658187
Intel 8008: http://www.computerhistory.org/collections/catalog/102657982
Intel 8080: http://www.computerhistory.org/collections/catalog/102658123
Z80: http://www.computerhistory.org/collections/catalog/102658073
Federico Faggin, SGT inventor, chip designer for 4004, Z80: http://www.computerhistory.org/collections/catalog/102658025
Bill Mensch, chip designer on 6800/6502/65C02/65816: http://www.computerhistory.org/collections/catalog/102739969
Motorolla 68000: http://www.computerhistory.org/collections/catalog/102658109
3dfx, Voodoo, the seminal GPU: http://www.computerhistory.org/collections/catalog/102746834
LSI Logic, EDA/fabless innovator: http://www.computerhistory.org/collections/catalog/102746194
VLSI Technologies, EDA/fabless innovator: http://www.computerhistory.org/collections/catalog/102746456

My family attended a Quaker meeting in Frederick, Maryland when I was growing up, and many of its members were closely associated with a food co-op there. We would volunteer to run the register or stock shelves and do other admin jobs. I remember the strange smell of bulk food items like spices and grains mixing together. I remember the "weird" items that were like items you'd get in regular grocery stores, but were weird because instead of chocolate the candy bars were made with carob. I remember that the co-op was a strong component of the identity of the people who worked, volunteered, and shopped there, including the Quakers and my family.

Adapt this recipe to make it vegetarian and in a rice cooker:

Ignore the chicken part (unless you want to make chicken)
In a rice cooker (at least 6c), in this order add:
- Sliced butter (or non-dairy fat)
- Turmeric and cumin
- We also add Aleppo pepper and urfa biber for extra seasoning
- Broth and rice (we use brown), salt and pepper
- I add a can of chick peas
Cook like you would rice (just turn it on)

	/**
	* 8x8 monochrome bitmap fonts for rendering
	* Author: Daniel Hepper <daniel@hepper.net>
	*
	* License: Public Domain
	*
	* Based on:
	* // Summary: font8x8.h
	* // 8x8 monochrome bitmap fonts for rendering
	* //

	enum Kind {
	File,
	Directory,
	}

	struct Entry {
	name: String,
	kind: Kind,
	size: usize,
	parent: Option<usize>,

	paul@pumpkin:/tmp/SQLite-cf538e27$ python3.7 -c 'import sqlite3; print(sqlite3.connect(":memory").execute("select sqlite_version()").fetchone())'
	('3.27.2',)
	paul@pumpkin:/tmp/SQLite-cf538e27$ ldd /usr/lib/python3.7/lib-dynload/_sqlite3.cpython-37m-x86_64-linux-gnu.so
	linux-vdso.so.1 (0x00007ffff752e000)
	libsqlite3.so.0 => /usr/lib/x86_64-linux-gnu/libsqlite3.so.0 (0x00007f89e005b000)
	libpthread.so.0 => /lib/x86_64-linux-gnu/libpthread.so.0 (0x00007f89e003a000)
	libc.so.6 => /lib/x86_64-linux-gnu/libc.so.6 (0x00007f89dfe79000)
	libm.so.6 => /lib/x86_64-linux-gnu/libm.so.6 (0x00007f89dfcf6000)
	libdl.so.2 => /lib/x86_64-linux-gnu/libdl.so.2 (0x00007f89dfcf1000)
	/lib64/ld-linux-x86-64.so.2 (0x00007f89e01da000)

	/* decodes next unicode code point in utf-8-encoded buffer. returns number of bytes
	read so stream can be advanced, -1 if invalid utf-8 sequence. */
	size_t decode_next_utf8(const unsigned char str, size_t len, int cp)
	{
	*cp = 0;
	if (*str <= 0x7f) {
	cp = (int)str;
	return 1;
	} else if (((*str & 0xe0) == 0xc0) && len > 1) {
	if ((*(str+1) & 0xc0) != 0x80) {