Hiking at Pinnacles National Park

We spent the day after Thanksgiving at Pinnacles National Park. The weather was crisp and cool, with very light traffic, probably because everyone else was busy shopping.

We did a 5 mile hike via the reservoir to Scout's peak and back to the visitor's center.

I would love doing this hike again, but probably not during the warmer part of the year. It was great to see 23 million year old lava formations but scary to know that it's so close to the Bay Area.

Fall 2015 tech reading

Java:

• Large HashMap overview: JDK, FastUtil, Goldman Sachs, HPPC, Koloboke, Trove - January 2015 version  - Java Performance Tuning Guide
• Taming GC Pauses for Humongous Java Heaps in Spark Graph Computing-(E…
• JVM Mechanics by Douglas Hawkins as Presented at Silicon Valley Java User Group by Azul Systems on Vimeo
• Nitsan Wakart on Illusion of Execution
• java - HttpClientError: The target server failed to respond - Stack Overflow
• Exceptions & Streams
• Java 8 allows to cast to a pair of interfaces
• jdk 8 frame pointer - Google Search
• spinn3r/noxy
• Parallec.io: Fast parallel async HTTP/SSH/TCP/Ping client java library.

System:

• New ScyllaDB benchmarks - Google Groups
• Reducing system jitter - LMAX Exchange Opinions
• Technical Itch: Reducing system jitter - part 2
• Linux Page Cache - Google Groups
• Gc-and-pagescan-attacks-by-linux
• The real problem is not tinygram prevention
• The story of one latency spike
• mmap(2)
• Someday Never Comes: Debugging tip: How to simulate a slow hardisk
• Project Clearwater » Adventures in debugging: etcd, HTTP pipelining, and file descriptor leaks

Big systems:

• Cassandra and security
• It's All Relative: Why Bios Settings matter (and not size)!
• One Trillion Edges: Graph Processing at Facebook-Scale
• MySQL vs something else. Evaluating alternative databases, Mark Callaghan (Facebook) on Vimeo
• Hardening cassandra for compliance or paranoia
• Counters At Scale - A Cautionary Tale
• Spark Dev Ops Training
• Copycat - Progressive, feature-complete implementation of the Raft consensus algorithm for Java 8
• Cassandra Summit 2015 - Scylla • 1 Million CQL operations per server
• Cassandra Summit 2015 - DataStax • Extreme Cassandra Optimization - The Sequel
• DataStax: Extreme Cassandra Optimization: The Sequel
• SmartStack: Service Discovery in the Cloud - Airbnb Engineering
• Blog | InMobi Technology | Real-Time Stream Processing at InMobi- Part 4
• Mac Browning - Bringing Consul to Production
• Experiences with AWS immutable deploys and job processing
• Faster, Cheaper and Safer: Secure Microservice Architectures using Docker

Misc:

• Frame of Reference and Roaring Bitmaps | Elastic
• Secondary indexing with Redis – Redis
• Nuts and bolts: our routing algorithm
• Short history of routes computation

Until next time!

Late summer 2015 tech reading

This should keep you busy for a few weekends.

(Once again, thanks to all the people who shared some of these originally on Twitter, Google+, HackerNews and other sources)

Java/Performance:

• http://epickrram.blogspot.co.uk/2015/08/jvm-guaranteed-safepoints.html
• https://github.com/RichardWarburton/honest-profiler
• OpenJDK profiler
• http://www.evanjones.ca/jvm-mmap-pause.html
• http://www.slideshare.net/RafaelWinterhalter/an-introduction-to-jvm-performance
• Unsafe update
• A Toolkit to Measure Basic System Performance & OS Jitter
• (http://highscalability.com/blog/2015/5/27/a-toolkit-to-measure-basic-system-performance-and-os-jitter.html)
• A good off-heap library/framework
• GC, safepoints & IOs
• Unsafe vs array memory traversal throughput
• ConcurrentHashMap on large heaps >= 15GB
• Order book/matching algorithms which are used by Equities exchanges
• How to solve very unstable latencies when using NIC?
• Memory barriers - multiple reader threads and one single writer to multiple (long) counters
• Memory barriers -Stricter read ordering
• Kernel bypass

Java Bytecode Notes:

• http://cory.li/bytecode-hacking/
• http://www.ibm.com/developerworks/library/it-haggar_bytecode/
• http://stackoverflow.com/questions/4761681/avoiding-getfield-opcode
• http://blog.jamesdbloom.com/JVMInternals.html
• http://arhipov.blogspot.com/2011/01/java-bytecode-fundamentals.html

Java 8/Lambdas:

• Older ones - 1 and 2
• http://www.slideshare.net/RichardWarburton/pragmatic-functional-refactoring-with-java-8-1-44946879
• http://mail.openjdk.java.net/pipermail/hotspot-compiler-dev/2015-April/017649.html
• http://jpbempel.blogspot.gr/2012/10/virtual-call-911.html
• https://github.com/benjiman/lambda-type-references
• http://benjiweber.co.uk/blog/2015/08/24/optionally-typechecked-statemachines/
• Serializable Lamdas and types
• Java 8 and type erasure

Tech Vids:

• Gil Tene: "Faster Java Objects"
• JVMLS 2015 - New Bytecodes, New Objects
• JVMLS 2015 - Jinq: LINQ-style Queries in Java
• JVMLS 2015 - Compilers are Databases
• JVMLS 2015 - The future is native
• JVMLS 2015 - Adventures on the Road to Valhalla
• JVMLS 2015 - VM Design Choices
• Charles Nutter: "Beyond JVM: How the platform is evolving for new languages and features"
• Rob Pike Go
• When the OS gets in the way" by Mark Price

Data:

• https://eng.uber.com/mezzanine-migration/
• https://blogs.apache.org/hbase/entry/medium_data_and_universal_data
• Building a Data Warehouse for Business Analytics using Spark SQL
• Gorilla: A Fast, Scalable, In-Memory Time Series Database
• InfluxDB storage engine

Misc:

• http://georgestocker.com/2014/04/15/how-to-destroy-programmer-productivity/

Some old notes on SQL Cubes and Rollups:

• http://www.depesz.com/2015/05/24/waiting-for-9-5-support-grouping-sets-cube-and-rollup/
• http://thegridman.com/coherence/oracle-coherence-pivot-table-queries/
• Old paper from LinkedIn http://sna-projects.com/sna/images/avatara-sam-sig.ppt
• Druid does something like this but the dimensions are not adhoc
• How SQL Server does it:
  • http://blogs.msdn.com/b/craigfr/archive/2008/03/31/ranking-functions-rank-dense-rank-and-ntile.aspx
  • http://blogs.msdn.com/b/craigfr/archive/2008/01/18/partial-aggregation.aspx
  • http://blogs.msdn.com/b/craigfr/archive/2007/09/27/aggregation-with-cube.aspx
  • http://blogs.msdn.com/b/craigfr/archive/2007/09/21/aggregation-with-rollup.aspx
  • http://blogs.msdn.com/b/craigfr/archive/2007/07/03/the-pivot-operator.aspx
  • http://blogs.msdn.com/b/craigfr/archive/2006/09/20/hash-aggregate.aspx
  • http://blogs.msdn.com/b/craigfr/archive/2006/09/13/752728.aspx

Until next time!