Spring 2023 tech reading

Hi there! Here's some tech reading as you welcome the Spring season (As usual, a hat tip to Hacker News and Twitter feeds, which are my usual sources).

Tag(s)	Link
architecture	Economies of Speed • Dave Farley • GOTO 2022 - YouTube
architecture	I Made Everything Loosely Coupled. Does My App Fall Apart? • Gregor Hohpe • GOTO 2022 - YouTube
architecture	Types Of Technical Debt And How To Manage Them - YouTube
data	Apache Iceberg: An Architectural Look Under the Covers - YouTube
data	Colin McCabe Updates on Apache Kafka KRaft Mode
data	Exploring the TPC-DS Benchmark Queries with Malloy
data	High-speed Database Throughput Using Apache Arrow Flight SQL - P99 CONF
data	Lightweight Compression in DuckDB - DuckDB
data	PostgreSQL Unlogged Tables - Look Ma, No WAL!
data	Sanket Verma - The Beauty of Zarr | PyData Global 2022 - YouTube
data	Shredding Deeply Nested JSON, One Vector at a Time - DuckDB
data	Understanding Probabilistic Data Structures with 112,092 UFO Sightings by Guy Royse - YouTube
data	pandas 2.0 and the Arrow revolution (part I)
data,system	Building Efficient Multi-Threaded Filters for Faster SQL Queries - YouTube
data,system	Validating Apache Pulsar’s Behavior Under Failure Conditions - Pulsar Summit SF 2022 - YouTube
go,system	Taming Go's Memory Usage — and Avoiding a Rust Rewrite - YouTube
inspire	Saving the Planet, One Byte at a Time by Sofia Larsson - YouTube
inspire	Understanding the role of a principal engineer - YouTube
java	Accelerating vector operations on the JVM using the new jdk.incubator.vector module - Alex Klibisz
java	Cloud-Native Dev Tools: Bringing the cloud back to earth by Grace Jansen - YouTube
java	Firefox Profiler beyond the web | Mostly nerdless
java	Foreign Function and Memory API by Per Minborg - YouTube
java	GeeCON Prague 2022: Jaroslav Tulach - Admire Kotlin. Adhere to Java - YouTube
java	How to Run a Java Application with CRaC in a Docker Container
java	How to fast generate your API Test with OpenAPI Tools and Rest-Assured by Elias Nogueira - YouTube
java	How to write fast Java code – thinking about memory by Anders Peterson - YouTube
java	JParse: The most efficient JSON parser for the JVM yet! | LinkedIn
java	Java Matrix Benchmark – oj! Algorithms
java	LP, QP & MIP on the JVM – oj! Algorithms
java	Leveraging the Modern JVM: How JVM Languages Benefit from Loom, Panama, and More by Charles Nutter - YouTube
java	Performance Testing Java Applications by Pratik Patel - YouTube
java	Welcome to the Jungle - A safari through the JVM landscape by Gerrit Grunwald - YouTube
java	What good are Record Patterns in Java? An example based on Spark's Catalyst Optimizer and it's Tree Rewriting Rules
java	ZGC - Java’s Highly Scalable Low-Latency Garbage Collector - YouTube
java,web	Dynamite Duo: GWT Boot and Spring Boot | by Dr. Lofi Dewanto | Geek Culture | Feb, 2023 | Medium
k8s	FinOps Observability: Monitoring Kubernetes Cost with OpenCost - YouTube
k8s,observability	Why Kubernetes Freedom Requires Chaos Engineering to Shine in Production - YouTube
k8s,security	OWASP Kubernetes Top 10 – Sysdig
k8s,security	Tutorial: Hands-on Hacking Kubernetes and Ways to Prevent It - Eric Smalling, Snyk - YouTube
kotlin,concurrent	The resulting LPRQ (P = Portable) algorithm elegantly simulates CAS2 via a sequence of Compare-and-Set instructions
life,inspire	I'm just trying to keep my head above water - Chris Klug - NDC Oslo 2022 - YouTube
ml	ElasticON EMEA: The Search for Relevance with Vector Search - YouTube
rust	Confessions of a Rusty Java developer by Alex Snaps - YouTube
rust,system	FOSDEM 2023 - Building an actor library for Quickwit's indexing pipeline.
security	How We Extended Teleport Seamlessly to Our 100's of Clusters - YouTube
security	Lateral movement detection with LATMA (LATeral Movement Analyzer) | Gal Sadeh (Silverfort) - YouTube
security	Managing Dropwizard with Teleport - YouTube
system	A New IO Scheduler Algorithm for Mixed Workloads - YouTube
system	Optimizing Servers for High-Throughput and Low-Latency at Dropbox - YouTube
system	P99 Pursuit: 8 Years of Battling P99 Latency - YouTube
system	Square Engineering's "Fail Fast, Retry Soon" Performance Optimization Technique - YouTube
system	The technology behind GitHub’s new code search | The GitHub Blog
system	Why User-Mode Threads Are Good for Performance - YouTube
system	Wish you were here: stories of building a remote development IDE - Matt Ellis - NDC Sydney 2022 - YouTube
system	cachegrand: A Take on High Performance Caching - YouTube
zig	When Zig is safer and faster than Rust

Until next time!

In-memory DB tables, shared nothing, time series, low latency and others

Some useful articles I read in the past few weeks.

Big data, shared nothing, distributed SQL, in-memory SQL:

• Realtime hadoop usage at Facebook
• Teradata
• Teradata Shared Nothing storage
• Teradata compared with Oracle Exadata
• Slightly dated but comparison doc between Teradata and Oracle
• Apache Derby's tuning docs
• MySQL's in-memory DB options
• Heap tables
• NDB storage

New age time series databases:

• Lumberyard
• OpenTSDB

Very good and detailed accounts of low latency Java based servers:

• DSL for High Frequency Trading
• LMAX
• LMAX Disruptor

Disk I/O and time related notes.

Programming and Java:

• The Principles of Good Programming
• JVM Bytecode for Dummies
• Data Structure Visualizations
• Java Concurrent Animated

Until next time,
Ashwin.

More Spring reading

Hi folks, here's a nice, juicy reading list for that rainy Saturday afternoon. Well... it has stopped raining here but that should not stop you from reading!

Java

• Difference between Linearizability and Serializability - Stack Overflow
• How deep volatile publication guarantees? - Stack Overflow
• What it Takes to Write the Fastest Java Connection Pool – Java, SQL and jOOQ (Follow the links on pool sizing)
• REST API testing using Hoverfly, REST Assured and WireMock
• Incremental Compilation, the Java Library Plugin, and other performance features in Gradle 3.4
• About Pool Sizing · brettwooldridge/HikariCP Wiki
• smacke/jaydio: A Java library to perform direct I/O in Linux, bypassing file page cache.
• CHAMP algorithm is current state of the art for immutable/persistent collections · Issue #6 · Kotlin/kotlinx.collections.immutable
• austinv11/Long-Map-Benchmarks: Benchmarking the best way to store long, Object value pairs in a map.
• Advance Programs and Tricks in Java: Reading text from Images using Java
• Parameters method should be invoked after BeforeClass/ClassRules · Issue #527 · junit-team/junit4
• RFR 9: 8165641 : Deprecate Object.finalize
• java - Is there anything wrong with using I/O + ManagedBlocker in Java8 parallelStream()? - Stack Overflow
• Turbo Charge CPU Utilization in Fork/Join Using the ManagedBlocker by Heinz Kabutz - YouTube
• nomemory/mockneat: MockNeat is a Java 8+ library that facilitates the generation of arbitrary data for your applications.
• [HDFS-8562] HDFS Performance is impacted by FileInputStream Finalizer - ASF JIRA
• java.lang.reflect.TypeVariable getBounds is not thread safe - vmlens
• Memory aligned to 64-bytes PooledByteBufAllocator - Google Groups
• Buffer allocation and leak detection in Netty // Speaker Deck
• How Lambdas And Anonymous Inner Classes Work - DZone Java
• java - Why can we not use default methods in lambda expressions? - Stack Overflow
• Invokedynamic - Java’s Secret Weapon
• All about java.util.Date | Jon Skeet's coding blog

Slightly more hard core Java

• 10 Things You Didn’t Know About Java – Java, SQL and jOOQ.
• Psychosomatic, Lobotomy, Saw: Java Flame Graphs Introduction: Fire For Everyone!
• The Art of JVM Profiling
• The 6 Memory Metrics You Should Track in Your Java Benchmarks | cruftex.net
• Aleksey Shipilёv jvm-anatomy-park
• 2017_Vectorization_in_HotSpot_JVM.pdf
• Speedup Your Java Apps with Hardware Counters
• JUnit 5 by Marc Philipp - YouTube

Java in the future

• Your next JVM: Panama, Valhalla, Metropolis by John Rose - YouTube
• java - newInstance vs new in jdk-9/jdk-8 and jmh - Stack Overflow
• Java Platform, Standard Edition Oracle JDK 9 Migration Guide, Release 9
• 55 New Features in JDK 9
• JDK 9 rampdown and a plea for mercy

A little bit of non-Java

• New Features in C# 7.0 | .NET Blog
• Why Kotlin Sucks
• talk: Mid-stack inlining in the Go compiler (external) - Google Slides
• Changes I would make to Go - sitr.us
• We should not count on using go plugins · Issue #563 · docker/containerd

Kubernetes

• Setting up a Highly Available Kubernetes Cluster with private networking on AWS using Kops
• Zero to Kubernetes CI/CD in 5 minutes with Jenkins and Helm - YouTube

Systems, data stores and more

• How Tarantool works with memory
• Exploring Performance of etcd, Zookeeper and Consul Consistent Key-value Datastores
• etcd/data_model.md at master · coreos/etcd
• Strong consistency models
• What No One Tells You About Writing a Streaming App: Spark Summit talk by Mark Grover & Ted Malaska - YouTube
• Moving from Hazelcast to Redis
• In search of a simple consensus algorithm
• Mastering Spark Unit Testing (Ted Malaska) - YouTube
• Announcing FOSSA Public Beta & Funding – FOSSA – Medium
• ScyllaDB: Achieving No-compromise Performance
• Stitch Fix Algorithms Tour
• Learning Machine Learning on the cheap: Persistent AWS Spot Instances – Slav – Medium
• Comparing The Performance Of Synchronous Versus Asynchronous Network IO
• The Verification of a Distributed System by Caitie McCaffrey - YouTube
• Elasticsearch Search Improvements: Range Fields, Removing _all Field, and more | Elastic
• Redis Pub/Sub under the hood - Making Pusher
• donnemartin/system-design-primer: Learn how to design large-scale systems. Prep for the system design interview.
• The million dollar engineering problem · Segment Blog
• Radix Trees, Transactions, and MemDB // Speaker Deck
• Fewer mallocs in curl | daniel.haxx.se
• HTTP/2 Two Years Later by Jesse McConnell and Simone Bordet - YouTube
• How fast can you count lines? – Daniel Lemire's blog
• How many floating-point numbers are in the interval [0,1]? – Daniel Lemire's blog
• Jez Humble: Continuous Delivery Sounds Great But It Won’t Work Here [Keynote] on Vimeo
• Index 1,600,000,000 Keys with Automata and Rust - Andrew Gallant's Blog

Time series

• Beringei: A high-performance time series storage engine | Engineering Blog | Facebook Code
• InfluxData | Storage Engine - Floats uses Facebook Gorilla paper
• Storage | Prometheus uses Facebook Gorilla paper
• prometheus/varbit.go at 127332c56f85b71af24cb87bea1fe7a72e60899a · prometheus/prometheus

Some fun stuff

• Clean Code Cheat Sheet
• Best Project Portfolio Management (PPM) Software in 2017 | G2 Crowd
• From spreadsheets to Airtable – Arnaud Porterie
• Add support for MacBook Touch Bar (Magic Toolbar) : IDEA-163208
• Anbox - Android in a Box | Personal notes
• Lukas Eder on Twitter: "Don't argue with the good-code-doesnt-need-comments police. Just add labels. They're code, not comments https://t.co/hDZkife3sR"
• What makes a good team member - How can you tell a good drummer and a bad drummer apart?

Until next time! Ashwin.

Spring 2021 tech reading

Hi there! Here's some tech reading for you to enjoy (As usual, a hat tip to Youtube, Hacker News and Twitter feeds, which are my usual sources).

Tag(s)	Link
data	Building a Scalable ML Feature Store with Redis
data	David Crawshaw SQLite and Go - YouTube
data	Fluent Bit updates and Stream Processing - YouTube
data	How ClickHouse saved our data | Mux blog
gitops	Argo: Real Enterprise-scale with Kubernetes - YouTube
java	12 recipes for using the Optional class as it’s meant to be used
java	A Java Fork-Join Calamity
java	A Journey With MPS in FinTech: One Year Later, by Tom Beadman - YouTube
java	A practical look at JEP-389 in JDK16 with libsodium • Brice Dutheil
java	Best practices: Java memory arguments for Containers – GC easy – Universal Java GC Log Analyser
java	Building kubectl plugins with Quarkus | DevNation Tech Talk - YouTube
java	Cédric Champeau's blog: The problem with Gradle: really?
java	Do Loom’s Claims Stack Up? Part 1: Millions of Threads? – Webtide
java	Enhanced Streams Processing with Kotlin’s Sequence Interface
java	GraalVM 21.0: Introducing a New Way to Run Java | by Oleg Šelajev | graalvm | Jan, 2021 | Medium
java	GraphQL Java and Threads
java	Improving G1 out-of-the-box performance
java	Java 8 LTS to the Latest - a Performance & Responsiveness Perspective - YouTube
java	Java on Truffle — Going Fully Metacircular | by Oleg Šelajev | graalvm | Jan, 2021 | Medium
java	Jetty 10 and 11 Have Arrived! – Webtide
java	No Free Lunch? Memory Allocation in the JVM - YouTube
java	Object Pooling, Benchmarks, and Another Way – Webtide
java	Programming the GPU in Java
java	Talking to Postgres Through Java 16 Unix-Domain Socket Channels - Gunnar Morling
java	Towards Continuous Performance Regression Testing - Gunnar Morling
java	Transparent Heterogeneous Computing for Java via TornadoVM - YouTube
java	Troubleshooting Native Memory Leaks in Java Applications | Poonam Bajaj's Blog
java,k8s	Writing Kubernetes Sample Controller in Java | by Rohan Kumar | Feb, 2021 | ITNEXT
java,k8s	Your own Kubernetes controller - Improving and deploying
java,test	Don't be mocked by your Mocks: Listening to your Tests - YouTube
k8s	Reducing your Kubernetes Cloud Spend - YouTube
k8s	Scaling Kubernetes to 7,500 Nodes
k8s	Webinar: The top 7 most-useful Kubernetes APIs for comprehensive cloud-native observability - YouTube
misc	GOTO 2020 • Prioritizing Technical Debt as if Time and Money Matters • Adam Tornhill - YouTube
misc	How to green the world's deserts and reverse climate change | Allan Savory - YouTube
misc	K8s - The water isn’t fine
misc	Modern web architectures
misc	Regreening the desert with John D. Liu | VPRO Documentary | 2012 - YouTube
misc	Restoring the ancient Caledonian Forest Alan Watson Featherstone TEDxFindhorn - YouTube
misc	That's a lot of YAML
misc	The Few, the Tired, the Open Source Coders | WIRED
rust	Deis Labs - Still Rusting - One Year Later
rust	Esteban Kuber working full-time on the compiler at AWS : rust
rust	Rust Foundation - Hello World!
rust	rust in curl with hyper | daniel.haxx.se
security	Summit Route - AWS Security Maturity Roadmap 2021
system	Building a gRPC Client Standard to Boost Reliability and Velocity
system	Fast Incremental Builds with Speculation and Cancellation
system	Scaling Cache Infrastructure at Pinterest - Pinterest Tech Stack
system	Writing a Fast JSON Parser | Chad Austin

Until next time!

Here's another reason why using an RDBMS in StreamCruncher was not a bad design decision at all. RDBMSes (what's the plural of RDBMS?) have attained a status (in Middleware) that is unequalled by any other technology. We trust RDBMS to store our Bank balances, a nation's entire Census data, Criminal records and the list goes on and on. So, when such a technology is always within easy reach, common sense tells us that it should not just be used, but embraced...Ok, enough of that and moving to the point ...

Many people who are familiar with ESP and CEP, when they learn that StreamCruncher uses an RDBMS underneath, probably wince at the mere mention of a Database. To them Databases are good but not good enough for Stream Processing. To many RDBMS is the anti-thesis of Stream Processing. Why? They begin to express vehemently about the "presumed" drawbacks of such an architecture. They start lecturing about Performance. Speed. "Sub-millisecond latency cannot not be achieved in regular RDBMS".. and so on.

Well, they're not entirely true. Even if you ignore the fact that StreamCruncher already supports several Embedded, In-Memory, Real-time Databases that are routinely used in Telecom (the DBs), there is a classic solution for regular RDBMS that will make them as good as any In-Memory Database. The biggest hurdle is the Hard disk - Persistence. Databases are meant to store data for posterity. But storing data to the Disk also adds a lot of latency. All other things offered by the Database like concurrency, scalability etc are very much required for Event Processing. Persistence is not required for Event Stream Processing. So, a regular Enterprise class Database can still be used as the base for StreamCruncher, which provides a solid/robust foundation on which to perform ESP/CEP - all this by creating the Database Tablespace on what is called a RAMDisk. Which is just a soft-drive, where a portion of the Physical Memory/RAM is turned into a Storage Drive (like C:\ or /usr/home/myname). This acts as any other Drive where files can be created etc but everything gets wiped out when the Machine is rebooted. This technique is not something new, but fits perfectly well in the context of StreamCruncher. RAMDrives can be created for almost any Operating System. A simple search on the Internet reveals several products and techniques for creating RAM Drives.

So, all the licensing costs that a Company has incurred on acquiring and maintaining these "Big Daddy" Databases can still be leveraged for Event Stream Processing. In the end, StreamCruncher gets to use a time tested Database that Developers have been using in their other regular Projects and can rely on the stability of such DBs. The important Sorting, Pre-Filtering, Joining and other CPU-intensive operations happen in the Database Engine, which is in Native code. And of course the Developers' familiarity with such Databases also plays a crucial role in adoption and integration with other parts of the project.

Fall 2016 tech reading

It's almost the end of the year, so here's another big list to go through while you wait at the airport on your way to your vacation.

Java

• Introduction to writing custom collectors in Java 8 | NoBlogDefFound
• Graal & Truffle — Medium
• Why are Java 8 lambdas invoked using invokedynamic? - Stack Overflow
• Vector API for Java - YouTube
• Valhalla Backport - YouTube
• Going Native - YouTube
• Shenandoah GC: Java Without The Garbage Collection Hiccups (Christine Flood) - YouTube
• multithreading - Java thread executing remainder opearation blocks all other threads - Stack Overflow
• Java 8 Migration: A Funny Thing Happened on the Way to Java 8
• How will Java lambda functions be compiled? - Stack Overflow
• Charles Nutter on Twitter: "Idea: a library that generates classes with N fields and uses Unsafe to treat them like a fixed-size array w/o array overhead."
• multithreading - Concurrent byte array access in Java with as few locks as possible - Stack Overflow
• java - How to dynamically generate a stack frame with debug log information - Stack Overflow
• JUnit 5 User Guide
• JITWatch Escape Analysis Report - YouTube
• Down the Rabbit Hole: An Adventure in JVM Wonderland - Lambda and others
• Java Method Reference Evaluation | Kynosarges Weblog
• Squeezing blood from a stone: small-memory JVM techniques for microservice sidecars
• The Java memory model made easy : Rafael Winterhalter on Vimeo
• Inside Java 9 - Version Schema, Multi-Release JARs, and More
• Quincy Larson on Twitter: "Garbage collection is hard"
• Updated 2016 version: A JVM Does That??? by Dr Cliff Click - YouTube
• Updated 2016 version: A Crash Course in Modern Hardware by Cliff Click - YouTube
• Java Language and Platform Futures: A Sneak Peek by Brian Goetz - YouTube

Streaming JSON and JAX-RS streaming

• What is the purpose of asynchronous JAX-RS - Stack Overflow
• Jersey Chapter 11. Asynchronous Services and Clients
• Jersey - StreamingOutput as Response entity - Stack Overflow
• JacksonStreamingApi - FasterXML Wiki
• Jackson Streaming Api Example - WebSystique
• Parsing a large JSON file efficiently & easily - NGData

Java Strings

• How the JVM compares your strings using the craziest x86 instruction you've never heard of · Jackson Davis
• A Tale of Two String Representations // Speaker Deck
• protobuf/RopeByteString.java at master · google/protobuf
• Import immutable ByteString from protobuf · Issue #1281 · google/guava
• Okio ByteString

Data - Small and Big

• PostgreSQL’s Powerful New Join Type: LATERAL | Heap Blog
• Jaco Labs: Analyzing Funnels Using Solr + Cassandra
• Why Uber Engineering Switched from Postgres to MySQL - Uber Engineering Blog
• Benchmarking the cost of primitive operations on the JVM - Grey Panther's Place
• vroyer/elassandra: Elassandra = cassandra + elasticsearch
• Anchormen/sql4es: sql4es: JDBC driver for Elasticsearch
• Object storage with Cassandra and Pithos | Exoscale blog
• Scaling Cassandra up and down into containers with ZFS | DataStax Academy: Free Cassandra Tutorials and Training
• Standard Deviations on Cassandra - Rolling Your Own Aggregate Function StreamSets
• Cold Storage That Isn't Glacial (Joshua Hollander, Protectwise) | Cassandra Summit 2016 - YouTube
• Elassandra: Elasticsearch as C* Secondary Index (R. Trouville, V. Royer, Independent) C* Summit 2016 - YouTube
• Performance evaluation of ten embedded key-value (K-V) store Java libraries
• Cassandra Development
• MyRocks: A space- and write-optimized MySQL database | Engineering Blog | Facebook Code
• What's new in Elasticsearch 5.0

Channels and Actors

• Select· quux00/go-lightly Wiki
• Parallel Universe - Quasar channels
• java - Is there anything wrong with using I/O + ManagedBlocker in Java8 parallelStream()? - Stack Overflow
• CppCon 2016: John Bandela “Channels - An alternative to callbacks and futures" - YouTube
• Kotlin Coroutines - YouTube
• QuestDB:Blog: The art of thread messaging
• Netty based frameworks comparison - Florin Dragu's blog
• Performance of Microservices frameworks
• Ethan Petuchowski's answer to How is Spark built on top of the Akka toolkit? - Quora
• Spark RPC

Golang

• Go lang faking generics - GopherCon 2016: Keith Randall - Inside the Map Implementation - YouTube
• Proposal: Eliminate STW stack re-scanning
• Typed vs untyped nil means that, in practice, all functions must return an error... | Hacker News
• Golang UK Conf. 2016 - Jennie Lees - Managing and Scaling Real Time Data Pipelines using Go - So simple channels are not sufficient
• Golang UK Conference 2016 - Bryan Boreham - An Actor Model in Go - If channels are so good, why need actors
• Golang UK Conference 2016 - Mat Ryer - Idiomatic Go Tricks - In other words poor man's OOP
• How to optimize Go for really high performance - by Björn Rabenstein - Memory pools and local variables escaping heap

Graphs

• Applying Graph Theory to Infrastructure as Code - YouTube
• Hard core multicore with TestNG « Otaku, Cedric's blog
• The Kobalt diaries: Parallel builds « Otaku, Cedric's blog
• jgrapht/TransitiveReduction.java at master · jgrapht/jgrapht

Misc Science/Tech

• From ZeroMQ documentation on multithreading
• ripgrep is faster than {grep, ag, git grep, ucg, pt, sift} - Andrew Gallant's Blog
• Preemptive scheduling of Erlang NIFs
• load balancing - consistent hashing vs. rendezvous (HRW) hashing - what are the tradeoffs? - Stack Overflow
• Smaller and faster data compression with Zstandard | Engineering Blog | Facebook Code
• 360 video stabilization: A new algorithm for smoother 360 video viewing | Engineering Blog | Facebook Code

Misc - Fun, Tidbits

• ulimit osx el capitan
• Slow Login Times on El Capitan :osx
• yEd Live
• yhatt/marp: Markdown presentation writer, powered by Electron.
• Fare Hacking on BART • Stephen Brennan
• How To Save The Princess In 8 Programming Languages
• Mario Fusco on Twitter: "Duck typing: dynamic mechanism"
• Naresh Jain on Twitter: "This nails the Dark side of Collaboration. Dedicated to all the #Agile & #Scrum extremists #LessCollaboration"
• The Silver Bullet Syndrome : Hadi Hariri on Vimeo
• A Docker Fork: Talk of a Split Is Now on the Table - The New Stack
• Why Not to Trust Statistics | Math with Bad Drawings
• Bogdan Botezatu on Twitter: "Happy 25th birthday, #Linux! Here's your cake, go ahead and compile it yourself"
• How do I commit case-sensitive only filename changes in Git? - Stack Overflow

Happy holidays!

Spring 2020 tech reading

In these strange and scary times, I hope you are all staying safe, indoors. Here's some tech reading to help you take your mind off the world's suffering. As usual, a hat tip to Hacker News and Twitter feeds, which are my usual sources.

Tag(s)	Link
data	10 Things I Hate About PostgreSQL - Rick Branson - Medium
data	Apache Pulsar 101: architecture, concepts & benchmarks by Quentin Adam & Steven Le Roux - YouTube
data	ClickHouse Cost-Efficiency in Action: Analyzing 500 Billion Rows on an Intel NUC — Altinity
data	Dr etcd; or; How I Learned to Stop Worrying and Love the Datastore - Nick Young, VMware - YouTube
data	Encryption at Rest in Dgraph and Badger - Dgraph Blog
data	Event-Driven Java Applications with Redis 5.0 Streams
data	Gunnar Morling — Practical change data streaming use cases with Apache Kafka and Debezium - YouTube
data	Matthew Seal: Data and ETL with Notebooks in Papermill | PyData LA 2019 - YouTube
data	NSDI '20 - Building An Elastic Query Engine on Disaggregated Storage - YouTube
data	Powering Pinterest ads analytics with Apache Druid - Pinterest Engineering Blog - Medium
data	Rearchitecting CouchDB Secondary Indexes on Top of FoundationDB - Garren Smith, Red Comet Labs - YouTube
data	Running Cassandra Cluster on Kubernetes in the Cloud presented by IBM | DataStax Accelerate 2019 - YouTube
data	So You Want to Geo-Partition Your Data... - Deepthi Sigireddi & Jiten Vaidya, Planetscale, Inc. - YouTube
data	Statistical Aspects of Distributed Tracing | Splunk - YouTube
data	Stream Processing Meetup: High-performance data replication at Salesforce with Mirus - YouTube
data	What does In-Sync Replicas in Apache Kafka Really Mean? - CloudKarafka, Apache Kafka Message streaming as a Service
data	[Uber Seattle] When Apache Pulsar Meets Apache Flink - YouTube
fun	A good Hacker News comment on tech interviews.
fun	An Illustrated Guide to Some Useful Command Line Tools - WezM.net by Wesley Moore
fun	GOTO 2019 • Moving Fast At Scale • Randy Shoup - YouTube
fun	GOTO 2019 • Think like a Hacker • Matt Brunt - YouTube
fun	How a Web Request Works, Down to the Atom - YouTube
fun	My tools are going Rusty
fun	The Art of Code Comments - Sarah Drasner | JSConf Hawaii 2020 - YouTube
fun,docker	(20) Julia Evans on Twitter: "containers aren't magic https://t.co/SB2LoD6wDm" / Twitter
fun,leadership,manager	What Makes Developers Unhappy - YouTube
golang	amos - I want off Mr. Golang's Wild Ride
golang	simdjson-go: Parsing gigabyes of JSON per second in Go
java	A first look into ZGC
java	Andrei Pangin - Memory Footprint of a Java Process on Vimeo
java	BlackAlps 2019: Fuzzing Java Code With The Help Of JQF - Tobias Ospelt - YouTube
java	Build Great Native CLI Apps in Java with Graalvm and Picocli
java	Build Images with Confidence and Ease with Cloud Native Buildpacks - YouTube
java	Burr Sutter — Java scaled to zero - YouTube
java	Charlie Gracie: Current state of JVM Escape Analysis and downstream optimizations - YouTube
java	Claes Redestad: Heap Archiving - YouTube
java	CronScheduler: a reliable Java scheduler for external interactions
java	JVM Garbage Collectors Benchmarks Report 19.12 – Ionuț Baloșin
java	Java 14 Arrives with a Host of New Features | Java Magazine
java	Kubernetes Native Spring apps on Quarkus by Georgios Andrianakis - YouTube
java	Local development with Testcontainers · A guy with 'Ego' in his name
java	Modern garbage collection: Part 2 - Mike’s blog
java	Observable microservices with MicroProfile OpenTracing and looking beyond to OpenTelemetry - YouTube
java	Principles to Handle Thousands of Connections in Java Using Netty - DZone Performance
java	Quarkus - Getting started with Reactive
java	Quarkus and Eclipse OpenJ9: Exceptional Performance across Platforms – Eclipse OpenJ9 Blog
java	RoaringBitmap Performance Tricks | Richard Startin’s Blog
java	Sebastian Daschner — Striving towards more productive development workflows - YouTube
java	SmoothieMap 2: the lowest memory hash table - Roman Leventov - Medium
java	The Cost of TLS in Java and Solutions
java	Thomas Wuerthinger — Maximizing performance with GraalVM - YouTube
java	Tiebreaker regarding Java HashMap, TreeNode and TieBreakOrder - Development notes by Yaroslav Yermilov
java	Tricks of the Trade: Tuning JVM Memory for Large-scale Services | Uber Engineering Blog
java	Turning Dropwizard Performance up to Eleven
java	Unleashing the scripting powers of Java - @maxandersen
java	Why libraries like Guava need more than POMs
java,k8s	Lessons Learned Implementing Microservices in Kubernetes
java,security	JWT: The Complete Guide to JSON Web Tokens
java,security	Secure Server-to-Server Communication with Spring Boot and OAuth 2.0 | Okta Developer
java,testing	JQF: Coverage-Guided Property-Based Testing in Java - jqf-issta19.pdf
javascript	dotJS 2019 - Vladimir Agafonkin - Fast by default: algorithmic performance optimization in practice - YouTube
k8s	How Fluentd collects Kubernetes metadata
k8s	PromCon EU 2019: Fun and Profit with Alertmanager - YouTube
k8s	Resiliency Patterns in Kubernetes - Ravi Hari & Lakshminarayanan S, Intuit - YouTube
k8s	Running kubectl Commands From Within a Pod – Thomas Stringer – Software Engineer
k8s	Useful Interactive Terminal and Graphical UI Tools for Kubernetes
k8s	Vault '20 - Understanding Kubernetes Storage: Getting in Deep by Writing a CSI Driver - YouTube
rust	Considering Rust - YouTube
rust	Polonius: Either Borrower or Lender Be, but Responsibly - Niko Matsakis - YouTube
rust	Rust Async and the Terrible, Horrible, No Good, Very Bad Day
rust	Specs and Legion, two very different approaches to ECS
rust	The Rust Compilation Model Calamity | TiDB
rust	Why Discord is switching from Go to Rust - Discord Blog
system	AWS re:Invent 2019: Firecracker open-source innovation (OPN402) - YouTube
system	Andrew Newdigate - Dealing with Metrics at Scale at GitLab - YouTube
system	Beating Textbook Algorithms in String Search - Wix Engineering - Medium
system	Beyond Getting Started: Using OpenTelemetry to Its Full Potential - Sergey Kanzhelev & Morgan McLean - (a.k.a stuff that AppDynamics has been doing for 10+ years)
system	HAProxyConf 2019 - Building a Service Mesh at Criteo with Consul and HAProxy by Pierre Souchay - YouTube
system	HAProxyConf 2019 - HAProxy Load Balancing at Vimeo by Andrew Rodland - YouTube
system	HAProxyConf 2019 - How OUI.sncf Built Its CDN with HAProxy by Antonin Mellier and Nicolas Besin - YouTube
system	HAProxyConf 2019 - Inside the GitHub Load Balancer with Joe Williams - YouTube
system	HAProxyConf 2019 - Inspect, Control, Report: HAProxy as the SRE's Door Man by Daniel Schneller - YouTube
system	HAProxyConf 2019 - Moving Yammer to the Cloud with Tobias Haag - YouTube
system	Is lock-free logging safe?
system	Jepsen: etcd 3.4.3
system	Jessica Tai - How to Tame Your Microservices: Evolving Airbnb’s Architecture - YouTube
system	Kafka Needs No Keeper - YouTube
system	PromCon EU 2019: Practical Capacity Planning Using Prometheus - YouTube
system	Queues Don't Fix Overload
system	Running Massively Parallel Deep-learning Inference Pipelines on Kub... Suneeta Mall & Martin Abeleda - YouTube
system	What’s New in Linkerd 2.7 - YouTube
system	distri Unix package manager - Zürich Go Meetup - YouTube
testing	FuzzFactory: Domain-Specific Fuzzing with Waypoints - YouTube
testing	Pact tests: how we split up the monolithic deploy by Phil Hardwick - YouTube

Until next time! Ashwin Jayaprakash.

Summer 2016 tech reading

Hi there! Summer is here and almost gone. So here's a gigantic list of my favorite, recent articles, which I should've shared sooner.

Java

• Introduction to writing custom collectors in Java 8 | NoBlogDefFound
• 5 Essentials for a Java 8 Tech Stack — Medium
• Philly ETE 2015 7 - Let’s Get to the Rapids: Java 8 Stream Performance - - YouTube
• CON7066 Effective Java Streams - YouTube
• Scala is not dead, but...
• Java A’s new Local-Variable Type Inference | Java, SQL and jOOQ.
• 2016 Will be the Year Remembered as When Java Finally Had Window Functions! | Java, SQL and jOOQ.
• Arrays of Wisdom of the Ancients
• Method Naming Conventions (The Java™ Tutorials Date-Time Overview)
• It's not too late for access control
• java - Do any JVM's JIT compilers generate code that uses vectorized floating point instructions? - Stack Overflow
• (Sort of nice) Gang of Four Patterns in a Functional Light: Part 1 | Voxxed
• java - Slow compilation with jOOQ 3.6+, plain SQL, and the javac compiler - Stack Overflow
• Anatomy of a memory leak - debugging native memory leaks in the JVM
• Psychosomatic, Lobotomy, Saw: GC 'Nepotism' And Linked Queues
• Java crumbs » Blog Archive » How to specify thread-pool for Java 8 parallel streams
• Type Inference in Java (JEP 286) can be disastrous
• JEP 285: Spin-Wait Hints
• JSR-166 Concurrency for Java discussions | About putOrdered and its meaning
• Outofmemoryerror what is the cost of java objects
• Mario Fusco on Twitter: "That's what Java devs do in checked exceptions catch blocks and why I believe they are just useless verbosity https://t.co/52bYuaZRWL"
• How Functional Programming will (Finally) do Away With the GoF Patterns | Java, SQL and jOOQ.

Other languages

• So You Wanna Go Fast? – Brave New Geek
• Pony - A new, race-free, safe & fast actor programming language - YouTube
• State and future of Heka
• After a year of using NodeJS in production | Geek for Brains
• Extreme Cleverness: Functional Data Structures in Scala - Daniel Spiewak - YouTube
• Go and Quasar: a comparison of style and performance
• (Golang to Python) 1.3 aka "And Now for Something Completely Different" asciinema blog
• Paradigms of Rust for the Go developer
• Writing an OS in Rust
• Performance of trait methods | The Scala Programming Language
• Hacker news Go and Java 20 yrs ago

Reactive programming

• Java 8 Stream API and RxJava Comparison
• JEP 266: More Concurrency Updates
• concurrency-interest jdk9 Candidate classes Flow and SubmissionPublisher
• JSR166 Flow and SubmissionPublisher
• Why we chose Akka for our Cloud Device solution - King Tech Blog
• New Concurrency Models on the JVM: Fibres, Verticles, Agents and Actors. by Lutz Huehnken - YouTube
• Quasar vs Akka

Persistent data structures

• Persistent data structure - Wikipedia, the free encyclopedia
• 3 Things Java Programmers Can Steal from Clojure | LispCast
• Clojure differences between Ref, Var, Agent, Atom, with examples - Stack Overflow
• polymatheia - Understanding Clojure's Persistent Vector, pt. 2
• Jay Fields' Thoughts: Clojure: State Management
• Understanding Clojure's PersistentHashMap (deftwice...)
• javaslang/HashArrayMappedTrie.java at javaslang/javaslang
• hrldcpr/pcollections: A Persistent Java Collections Library
• andrewoma/dexx: Persistent (immutable) collections for Java and Kotlin
• michaelwoerister/rs-persistent-datastructures: A Persistent Map Implementation based on Hash Array Mapped Tries

CRDT

• CRDTs for fun and eventual profit
• scala-exchange-2013-crdt.pdf
• Reconciling Eventually-Consistent Data with CRDTs | SkillsCast | 3rd December 2013
• Fun with CRDTs | Richard Dallaway
• Readings in conflict-free replicated data types
• Peter Alvaro on Distributed Programming, CRDTs, LDFI
• ajantis/java-crdt: Collection of common Conflict-free Replicated Data Types in Java
• jboner/akka-crdt: Server-managed CRDTs based on Akka
• dclements/riak-java-crdt: Java CRDT Library with a focus on supporting Riak.
• Dmitry Ivanov & Nami Naserazad - Practical Demystification of CRDT (Lambda Days 2016) - YouTube

Data

• Elasticon - TAP(ping) Out Security Threats at FireEye
• History of massive-scale sorting experiments at Google | Google Cloud Big Data Blog — Google Cloud Platform
• Comparison of Apache Stream Processing Frameworks: Part 2
• rqlite - replicated SQLite with new Raft consensus and API - Vallified
• Dropbox's MagicPocket
• MLLeap, or How to Productionize Data Science Workflows Using Spark - YouTube
• Spark @ DataXu: Multi Model Machine Learning for Real Time Bidding Over Display Ads - YouTube
• Introduction To The Apache Cassandra 3.x Storage Engine
• Good notes on setting up security - Hardening cassandra for compliance or paranoia
• Inside Apache SystemML - YouTube
• Elastic Cloud Outage: Root Cause and Impact Analysis | Elastic
• DIY Jepsen Testing CockroachDB | Blog | Cockroach Labs
• Jepsen: VoltDB 6.3
• CAP Twelve Years Later: How the "Rules" Have Changed
• [CASSANDRA-10994] Move away from SEDA to TPC, stage 1 - ASF JIRA
• Cassandra SASI Index Technical Deep Dive | DOAN DuyHai's blog
• The Linux Scheduler: a Decade of Wasted Cores | the morning paper
• PostgreSQL Scalability: Towards Millions TPS - Alexander Korotkov's blog
• An Overview of Apache Streaming Technologies | Databaseline
• Flink vs. Spark
• Top 5 mistakes when writing Spark applications

Systems and other computer science-y stuff

• Relating Service Utilisation to Latency – Rob Harrop
• Server Utilization: Joel On Queuing
• Ridesharing Algorithms in TransLoc OnDemand — TransLoc TechLog
• On intel x86 processors do you have branch predictions on fixed loops ? - Google Groups
• How Three Fundamental Data Structures Impact Storage and Retrieval - DZone Database
• Psychosomatic, Lobotomy, Saw: Fixing Coordinated Omission in Cassandra Stress
• Erasure Coding: Backblaze Open Sources Reed-Solomon Code
• Who Needs Git When You Got ZFS? — Zef.me
• Making sense of Memory Barriers - Google Groups
• Reducing latency spikes by tuning the CPU scheduler
• Storage Service Response Time | Guesstimate
• Netty @Apple: Large Scale Deployment/Connectivity
• Salmon Run: Elasticsearch based Image Search using RGB Signatures
• Sysdig | How we found a bug in Amazon ELB
• The revenge of the listening sockets

Fun/General

• Classic Programmer Paintings
• SmashingConf San Francisco 2016 - Jeff Atwood on Vimeo
• Is group chat making you sweat? — Signal v. Noise
• Actually, Slack really sucks — The Startup — Medium
• I bought my boss two copies of The Mythical Man Month
• Sam Stephenson on Twitter: "12 years of progress? https://t.co/uOQ7ine7LV"
• brucesnyder on Twitter: "Software architecture as pasta https://t.co/X3sJATeysv"
• basarat on Twitter: "MicroServices : converting a single server problem into a distributed transaction problem"
• Ordre Spontané: Brandolini’s law
• You Suck at Excel with Joel Spolsky - YouTube
• Jetbrains: The unicorn Silicon Valley doesn't like to talk about

Until next time! Ashwin.

In-memory Derby DB

Heard from David Van Couvering that Derby 10.5 will support In-memory databases. I was looking for this feature some 3 years ago in Derby - old mailing list archive. There was a prototype of some sort, but was kinda flaky. I'm very excited that 10.5 will have this built-in.

Hopefully this will ship with a future version of JDK6. Imagine what amazing things you'll be able to do then. This along with Map-Reduce in JDK7...ahh..shweet. (Geek alert!)

Fall 2022 tech reading

Hi there! Here's some tech reading for you (As usual, a hat tip to HackerNews, Twitter, Youtube and Reddit - my usual sources).

Tag(s)	Link
business	Live from SaaStr Annual 2022: Founder Confidential with HubSpot's Founders and SaaStr's CEO - YouTube
ci-cd,java,k8s	From PR to Artifactory in 60 Secs! Adobe Service Runtime Java Libraries Release Pi... Anirudh Mathad - YouTube
ci-cd,k8s	Argo Rollouts at Scale: How We Brought Automated Rollback to 2100+ Micro-serv... Joseph Pallamidessi - YouTube
ci-cd,k8s	Harder, Better, Faster, Stronger Pipelines @ Adobe - Larisa Andreea Danaila & Ionut Maxim Margelatu - YouTube
ci-cd,k8s	Large Scale Batch Processing with Argo Work... Rakesh Subramanian Suresh & Saravanan Balasubramanian - YouTube
cloud,security	Azure Security Best practices - Part 1 - YouTube
cloud,security	The Many Ways to Manage Access to an EC2 Instance
cloud,security	You Need To Learn These New Cloud Security Tools Right Now! - YouTube
data	A Database Without Dynamic Memory Allocation | TigerBeetle
data	Diving into Delta Lake 2.0 - YouTube
data	DuckDB - Querying Postgres Tables Directly From DuckDB
data	Dynamic workflow orchestration with Apache Airflow and CrateDB by Marija Selakovic - YouTube
data	Evaluating Distributed Databases for Large-Scale Social Network Apps: TAO, TAO Bench, and TiDB - YouTube
data	Pinot's new multi-stage query engine (Rong Rong, StarTree, Siddharth Teotia, LinkedIn) RTA Summit 22 - YouTube
data	Redpanda vs Apache Kafka: A performance comparison (2022 update)
ebpf	BTFGen: one Step Closer to Truly Portable eBPF Programs -Mauricio Vásquez Bernal Rafael David Tinoco - YouTube
ebpf	Falco's Discovery of the Modern eBPF World - Andrea Terzolo & Jason Dellaluce - YouTube
fun	New little song: "The Re-Org Rag (I'm My Own VP)"
golang	Causal's 1000x Spreadsheet; Performance beyond profiling - Angad Nadkarni - YouTube
java	A 1.5MB Java Container App? Yes you can! by Shaun Smith - YouTube
java	Database Hacking 101: Building fast bulk import in Java + C by Vlad Ilyushchenko - YouTube
java	FOSDEM 2022 - An Infallible Process to Fix Production Java Apps
java	Google's Journey from Java to Kotlin for Server Side Programming by James Ward , Brad Hawkes , John - YouTube
java	Great Time at JavaZone 2022 - DEV Community 👩‍💻👨‍💻
java	Helidon Níma — Helidon on Virtual Threads | by Tomas Langer | Helidon | Sep, 2022 | Medium
java	Java 19 Overview - YouTube
java	Java Next - From Amber to Loom, from Panama to Valhalla | Nicolai Parlog (EN) - YouTube
java	Java™ 18 & 19 What's new and noteworthy? by Piotr Przybyl - YouTube
java	Lightning Fast Java Application Startup Using Checkpoint/Restore with Eclipse OpenJ9 - YouTube
java	Loom in the Java Ecosystem - Inside Java Newscast #34 - YouTube
java	Moving Java Forward with Java 19 - YouTube
java	No more Xmx! Adaptable Heap Sizing for Containerized Java Applications by Jonathan Joo - YouTube
java	Optimizing Apache JVMs for Apache Kafka - YouTube
java	Picnic loves Error Prone: producing high-quality and consistent Java code | by Rick Ossendrijver | Oct, 2022 | Picnic Engineering
java	Quarkus Insights #101: Quarkiverse Extension Spotlight: Quarkus Loom spotlight - YouTube
java	The Age of Virtual Threads by Ron Pressler And Alan Bateman - YouTube
java	Virtual Threads: New Foundations for High-Scale Java Applications
java	Why don't you create your next application without a database? by Rudy De Busscher - YouTube
java	Write You An Actor System For Great Good! with JBang, JDK 19, records, pattern matching and virtual - YouTube
java	thread-ring with VThreads
java,ann	Javalin 5.0 stable is ready! - Javalin - A lightweight Java and Kotlin web framework
java,data	Warp 36 Java In Memory Data Processing Cluster | Markus Kett (EN) - YouTube
java,k8s	Bootiful Kubernetes Operators - Tiffany Jernigan & Josh Long, VMware - YouTube
java,k8s	Quarkus Insights #102: Quarkiverse Extension Spotlight: Operator SDK - YouTube
java,k8s	Serverless Integration with Camel Quarkus by Kevin Dubois - YouTube
java,rust	Java and Rust by Yishai Galatzer - YouTube
java,test	Fairies, Fakers and Factories: boost you tests with better test data by Jaap Coomans - YouTube
jvm	Integration test variants
jvm	Plugin and Play with Kotlin by Simone de Gijt - YouTube
jvm,data	FOSDEM 2022 - Code-first process modeling and analysis with kalasim
k8s	99% to 99.9% SLO: High Performance Kubernetes Control Plane at Pinterest - Pinterest Tech Stack
k8s	Helm vs Kustomize: the frenemies that soothe Kubernetes by Ana Maria Mihalceanu - YouTube
k8s	Let's kustomize our manifests with style! by Kevin Davin - YouTube
k8s	Remove your CPU Limits | by Shon Lev-Ran | Directeam
k8s,ebpf	eBPF and Cilium at Google - Purvi Desai - YouTube
k8s,security	7 tools to help you secure your Kubernetes cluster by Alain Regnier - YouTube
k8s,security	Kubernetes Security Guardrails - YouTube
k8s,security	The Practice of Securing Kubernetes by Ben Hirschberg - YouTube
k8s,security	gVisor+Falco-Strengthen K8s & container security without losing visibility - YouTube
life	Amanda Adams, CrowdStrike | CrowdStrike Fal.Con 2022 - YouTube
productivity	How I Have Time For Everything (From A Principal At Amazon) - YouTube
python	"Python Performance Matters" by Emery Berger (Strange Loop 2022) - YouTube
security	Adam Meyers, CrowdStrike | CrowdStrike Fal.Con 2022 - YouTube
security	Cyber Security Career Pathways | Marco Lancini's Blog
security	Exploring Runtime Security and Forensic using eBPF - Carolina Valencia, Aqua Security - YouTube
system	Datadog on gRPC - YouTube
system	Keynote: Quorum Queues: A Retrospective | Karl Nilsson | RabbitMQ Summit 2022 - YouTube
system	gRPC Cornerstone: HTTP2… or HTTP3? by Mykyta Protsenko , Alex Borysov - YouTube
system,golang	eBPF Superpowers for Go programmers - Liz Rice - YouTube
test,chaos	How did we organize our last ManoMano GameDay? | by Antoine Choimet | ManoMano Tech Team | Sep, 2022 | Medium | ManoMano Tech Team
ui	Modern frontends with Thymeleaf and htmx by Wim Deblauwe - YouTube

Until next time!