DeepSeek doesn’t seem like a side project by some quants. Writing a correct distributed file system alone is a multi year project. Quite interesting.
Sunny Bains @TiDB
4,662 posts
Sunny Bains @TiDB
@sunbains
swe@PingCAP - The company behind TiDB. Oracle/MySQL/InnoDB team lead in a past life
- I don't understand the fascination with Docker, I've removed all Docker from my homelab and switched to VMs. Life is so much easier. Just login and do what I want.
- Key takeaway from Prof. Ousterhout’s talk yesterday, gRPC performance is underwhelming, adds too much of unnecessary processing overhead over an already bad situation due to TCP design short comings. From memory, someone correct me if I’m wrong, the proposed protocol to replace
- Postgres to TiDB talk by Atlassian. Postgres just doesn’t cut it where scale matters 🙂
- I think this is a great resource (book), it covers the more modern Linux kernels. Available as a PDF too. He also has YT videos accompanying the book. Operating Systems: A Linux Kernel-Oriented Approach - Smruti R. Sarangi cse.iitd.ac.in/~srsarangi/osb…
- When writing multi-threaded programs remember to test it on HW with multiple sockets. Performance drop due to shared state across sockets is quite depressing to watch. Modern CPUs have made it even more interesting with all kinds of Ln cache sharing combinations. I’ve seen
- I was browsing the code and docs, they have three (four) external dependencies. - FoundationDB (FS metadata) - Clickhouse - RocksDB (FS chunk server) - Zookeeper or etcd Not 100% sure but the chunk server idea seems like it’s inspired by PolarFS.DeepSeek doesn’t seem like a side project by some quants. Writing a correct distributed file system alone is a multi year project. Quite interesting. github.com/deepseek-ai/3FS
- Nice read. Data, Consensus, Execution: Three Scalability Bottlenecks for State Machine Replication
- Very nice article on a difficult topic. Found it while learning about Quint. Lessons from Writing a Compiler
- This was the book that introduced me to memory hierarchies and the importance of cache locality. I had bought it on a whim because it looked “advanced” 🙂. Analysis of Cache Performance for Operating Systems and Multiprogramming - Anant Agarwal
- I'm in awe of people who do this type of research, I wouldn't even know where to start.
- Shutting down a multi-threaded program gracefully, releasing all resources, ensuring the the final state is clean, is a project in itself.
- Replying to @iamatradernoob and @jorandirkgreefI was paid to work on databases and that’s how I learnt my chops. I have a habit of buying books that i find interesting while browsing in bookstores. 20-25 years ago there were lots of them. I had bought the G&R book a few years before I landed a job to write a storage engine
