Trust Deterministic Execution to Scale & Simplify Your Systems • Frank Yu • YOW! 2023
This presentation was recorded at YOW! Australia 2023. #GOTOcon #YOW
Frank Yu - Director of Engineering at Coinbase @coinbase
RESOURCES
ABSTRACT
Make your mission critical business logic deterministic and fast! We discuss both intuitive and not-so-obvious architecture choices that can be made to dramatically scale and simplify systems with these properties.
We built our latency sensitive exchange around a blazing fast open source raft cluster. After some time in production, observations about the nature of our request and event messages coupled with some timely advice led us to upend our service topology.
Find out how re-running core logic at the edges of a system can:
• Decrease bandwidth usage and buffering across the system
• Protect against thundering herd problems by making network usage more predictable
• Simplify the logic of gateway and persistence services downstream from your core logic [...]
TIMECODES
00:00 Intro
01:05 About us & our problems
05:50 How can the system evolve safely & efficiently while performing?
09:45 Benefits of determinism
20:12 Can we optimize?
22:42 Replay logic to scale & stabilize
31:14 10 Challenges & consideration
38:02 Simplicity
38:53 Outro
Download slides and read the full abstract here:
RECOMMENDED BOOKS
Susanne Kaiser • Adaptive Systems With Domain-Driven Design, Wardley Mapping, and Team Topologies •
Eric Evans • Domain-Driven Design •
Matthew Skelton & Manuel Pais • Team Topologies •
Heidi Helfand • Dynamic Reteaming •
Vlad Khononov • Learning Domain-Driven Design •
Erik Schön • The Art of Strategy •
Thomas M. Siebel • Digital Transformation •
#SoftwareArchitecture #Coinbase #Latency #Determinism #RaftMonolith #Simplicity #FrankYu #YOWcon
Looking for a unique learning experience?
Attend the next GOTO conference near you! Get your ticket at
Sign up for updates and specials at
SUBSCRIBE TO OUR CHANNEL - new videos posted almost daily.
1 view
0
0
10 months ago 00:39:02 1
Trust Deterministic Execution to Scale & Simplify Your Systems • Frank Yu • YOW! 2023
1 year ago 00:04:13 1
Why you can’t trust timestamps of Windows system files
5 years ago 00:38:19 2
Shields UP #5 - RISC V Enclaves: A Clean Slate Approach to Linux Security
6 years ago 00:01:58 246
Automated Deep Reinforcement Learning Environment for Hardware of a Modular Legged Robot