Reflections Of The Void: optimization

Showing posts with label optimization. Show all posts

Tuesday, July 17, 2018

Atlantis : extremely useful framework for managing terraform script that is shared and used within a team and across teams. It streamlines your whole operation by deploying terraform on pull request merge. Making the whole operations integration seamless with your CI/CD.
Cloud Cost Optimization : Article expanding on Adrian Cockroft paper [ACM paper, Slide deck ] . It gives a good overview of the best practice out there for managing cloud cost and also skims on the many pitfalls of cost optimization. Like software development and the premature optimization fallacy, a lot of cloud customer spend way too much time trying to optimize cost early on with little to no effect. A good and quick read that can help you get in the right mindset when you need to set up a doctrine for controlling and improving your cloud cost management.
Old School NYC Union negotiation : Wowww this video could have been straight out of a Scorcese mafia movie. But no, this is real life negotiation of NYC union... Which seems to goes like this: rambling ... Somebody talk loud and make a point while pointing finger.... Back to everybody arguing and ambient rambling.

Stellar Consensus Protocol : from ripple for to full-blown rewrite. Stellar looks like an impressive protocol addressing many of the shortcoming and risk of Ripple. Also, the authors seem to be smart enough to avoid jumping to fast onto the smart contract aspect as it is a really tough nut to crack. Maybe, with all the mayhem surrounding cryptocurrency, the stellar approach seems to be rather measured. Worth keeping an eye on.
Optimizing web servers for high throughput and low latency : very good post on how to optimise your Linux system. A lot of it has already described many times, but it is never a bad thing to repeat them.
The performance impact of Meltdown patches on HPC FS (Lustre) : no surprise here, IO intensive applications are the one the most heavily impacted. However, I wasn't expecting 40% performance penalty and up to 45% for large folders.

Pocket Negotiator : this is a really cool negotiation software helping people in the actual negotiation process or prepare for a negotiation.
Software Optimization Guide for AMD Family 17h Processors : AMD optimisation guideline for its latest processors family.
Chip Hall of Fame : The stories of the greatest and most influential microchips in history—and the people who built them

Rethinking Memory System Design (along with Interconnects) : Presentation on the evolution of memory system , their challenge (rowhammer is looked at) and how Interconnects will play a major role in shaping the future of the technology. It seems that we are looking for a further integration of the interconnect and memory ( volatile or not) systems. However HW vendor need to remind themselves that now the protocol need to bridge many different layers and it needs to be allowed to be used across many scale. Silicon only is not an option anymore.
Fractal Merkle Tree Representation andTraversal : paper presenting a technique for traversal of Merkle trees which is structurally very simple and allows for various tradeoffs between storage and computation.
Readings in Database Systems, 5th Edition : the 5th edition of the redbook is out! A must read for anybody dealing with database and associated optimization.

Datavisualization.ch : Awesome collection of tools that the people behind Datavisualization.ch, work with on a daily basis and recommend warmly. This is not a list of everything out there, but instead a thoughtfully curated selection of our favorite tools that will make your life easier creating meaningful and beautiful data visualizations. Highly recommended!
The little book about OS development : ever wanted to make your own OS ? well this book will help you get kick started. And even if you don't want to build your own. This book will give you great insight on the nitty gritty detail of what make your OS tick ( and crash... )
ICPE 2015 : Technical Program and Conference Schedule, a year old but some nice paper and a lot of slide deck are available on the page. Checkout System-Level Characterization of Datacenter Applications paper or Adrian Cockroft presentation on cloud native optimization.

Today's links 20/07/2015: Optimization tools, lock-free queue, distributed system testing framework, functional programming guide

Google Optimization Tools : Google's software suite for combinatorial optimization
SnapQueue : Lock-Free Queue with Constant Time Snapshots
Conductor : A system for testing distributed systems across a network
mostly-adequate-guide : Mostly adequate guide to Functional programming (in javascript)

Today's links 11/02/2015: Test and optimization articles, scaling product team, PCIe vs Eth , Distributed Sys fallacies

100 Must-Read Articles on Testing and Optimization : data driven, big data, a/b testing etc.. The best articles from 2014
Scaling a product team : lesson learned from Intercom on how they scaled a product building team, and the nitty gritty involved in getting valuable product out the door as fast as possible.
Eight Fallacies of Distributed Computing : very good tech talk with real life encounter of the fallacies.
PCIe vs Ethernet : with the rise of Intel’s silicon photonics (SiPh) optical PCIe (OPCIe) and other PCIe fabric, is it time to fragment your datacenter and use fast PCIe rack fabric and Eth for cross rack one. To be honest time will tell as you already know the best technology doesn't always win.

Today a really cool programming language, code optimization, AWS profitability, Algorithms book and last but not least strategy

Commuter : an automated scalability testing tool that hunts down unnecessary sharing in your code. It try to identify shared cache lines within the code that can severely limit your software's ability to scale. [github]
No more hiding cloud revenue any longer for Amazon : For years, Amazon Web Services hid its revenue in the shadow of Amazon.com’s quarterly earnings statements. However, due to AWS growth and US accounting regulation it might need to finally disclose its profitability in more details.
Algoxy : Book of Elementary Algorithms and Data structures
Two very nice blog post from Simon Wardley - Playing chess with companies and Notes on organisation - Very good introduction on how to use Mapping to define and understand a Strategy as well as

Playing chess with Companies from Simon Wardley

Escher: A language for programming in metaphors. This is a really cool programming language with a lot of potential, but probably also to far reaching and complex for your average developer.