Skip to content

Instantly share code, notes, and snippets.

@wrobstory

wrobstory/lessons.md

Last active July 18, 2016 22:57
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save wrobstory/0aaa13e7885b3e31844966338dc3156d to your computer and use it in GitHub Desktop.
Save wrobstory/0aaa13e7885b3e31844966338dc3156d to your computer and use it in GitHub Desktop.
Download ZIP
Lessons Learned
Raw
lessons.md
  • Always include the timestamp when a field was written
  • If Elasticsearch drops an index, it will keep writing data dynamically. This is very bad.
  • Using one library for critical API logic (like reading from Kafka) lets you update all of your various consuming services with a version bump.
  • ALWAYS use the ESCAPE option when unloading from Redshift.
  • Immutable append-only tables always and forever. It's so hard to reason about tables with updates.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment