[Links of the Day] 28/11/2019 : Metrics Stream Processing Framework, SOPS'19, Distributed Transaction K/V

• Mantis : netflix metric stream processing framework. This seems to be a really powerful platform for realtime monitoring and especially contextual alerting and alerting on logs. What's impressive is the throughput it can churn through events...  [github]
• SOPS'19 : SOPS papers are in free open access, a lot of papers on security and formal verification of distributed this year. [Murat review Day0, Day1, Day2]
• Tikv : Distributed transactional key-value database.  [Github]

[Links of the Day] 08/11/2018 : large scale study of datacenter network reliability, What to measure in production, Failure Mode effect Analysis

• A Large Scale Study of Data Center Network Reliability : the authors study reliability within and between Facebook datacenters. One of the key findings is the growth in complexity, heterogeneity and interconnectedness of datacenter increase the rate of occurrence of unwanted behaviours. Moreover, this seems to be also a key potential limiting factor for world scale spanning infrastructure undergoing rapid organic growth.
• Understanding Production: What can you measure? : what do you need to monitor and measure in production. Very good summary of many blog post out there.
• Failure Mode Effects Analysis (FMEA) : once you start reaching a certain production scale and more stringent requirement kicks in ( unless you were unlucky enough to have them at the get-go). You might want to run a failure modes and effects analysis (FMEA) is a step-by-step approach for identifying all possible failures in a design, a manufacturing or assembly process, or a product or service. While it was mainly designed to address shortcomings in the manufacturing industry, it is still extremely useful for IT system analysis, especially when you want to prepare yourself pre-rollout of a chaos monkey like system.

Links of the day 18/12/2015 : #openstack LMA , Quantum computing #cloud and Google goes #SDN

• Purpose-built Global Network : How google moved to SDN and its implications.
• Qcware : quantum computing cloud 
• Logging, Monitoring, Alerting : openstack LMA stack . What i am not sure about is the scalability of the approach. 

Links of the day 09/12/2015 : Intel telemetry framework, log search system and DIGITAL!

• Snap : Telemetry framework by Intel. While this is yet another monitoring system it is a little bit different from what is out there. It offer a full secure clustering solution design to be not only scalable but also has a integrated flexible life-cycle management of its component. This might looks like a great framework for future telemetry systems and I can see it being adopted very quickly across the industry.
• Designing a search system for log data : 3 part post on how to design from the ground a system for analyzing  logs at large scale.
• Digital : because digital!

Links of the day 04/12/2015 : Sub-NUMA patent, Fabric Emulation for HP Machine, Performance monitoring toolkit

• Sub-NUMA : Numa is already hard to deploy and use efficiently, lets start bringing sub numa clustering. Sadly one of the consequence of the ever increasing core count. Rather than selling micro chip single core highly optimize CPU. Intel prefer to cram more feature into a larger package even if 50%+ of them are unused. Sometimes I really hope that ARM server will finally come to fruition and shake the whole damn market.
• Fabric attached memory : want to play with HP "the machine" and its new shiny fabric but can't get early access to it or you don't have the finance. Fear not ! here is the emulation toolkit of Fabric-Attached Memory for The Machine.
• LIKWID : Performance monitoring on Intel Haswell platforms easy to use but yet powerful performance tools for the GNU Linux operating system. Really cool set of tools for topology discovery , numa pinning, power monitoring etc... [github]

Links of the day 23/11/2015 : Machine learning book, Spotify monitoring , graph

• Heroic : How Spotify monitor its infrastructure. TL;DR: Cassandra for time series persistence, Kafka for transport and elastic search on top for presentation. Nice feature: you can federate cluster across zones or data-center making the overall system more robust. 
• Understanding Machine Learning - From Theory to Algorithms : Ebooks introducing machine learning, and the algorithmic paradigms it offers, in a principled way. The book provides a theoretical account of the fundamentals underlying machine learning and the mathematical derivations that transform these principles into practical algorithms.
• Plotly.js : want nice graph, get plotly.js. The core technology and JavaScript graphing library behind Plotly’s products (MIT license).
  

Links of the day 14 - 04 - 2015

Today's links 14/04/2015: @Intel Storage Accel Lib.,@netlix monitoring system, why opensource startups #fail

• Storage Acceleration Library : open source version of Intel library collection of low-level functions such as contains fast erasure codes that implement a general Reed-Solomon type encoding for blocks of data and expanded set of functions used for data protection, hashing, encryption, etc. [fancy video explaining it here]
• Netflix Built Its Own Monitoring System : Roy Rapoport shares some of the lessons Netflix learned building a monitoring system, the challenges, pitfalls and opportunities encountered along the way.
• Why opensource startup fail : a intersting perspective on opensource based startup and why often the lack of clear public engagment with the project you relies one leads to a death spiral.

Links of the day 15 - 12 - 2014

Today's links  15/12/2014 : Code Monkeys, Cache Monitoring, Distributed system design and Elliptic curve crypto for Rust

• Not Just Code Monkeys : Martin Fowler keynotes on the importance of building a healthy social environment where software development can thrive.
• Intel Cache Monitoring : enables threads, applications, VMs or any combination to be tracked simultaneously in a flexible manner to suit a wide variety of software usage models. with some really nice tools and especially KVM support 
• Introduction to Distributed System Design : Google Code University distributed system lecture and notes.
• Elliptic Curve Crypto : pure rust implementation , now you can have identity based crypto solution in pure rust.

Links of the day : 12 - 09 - 2014

Today's links 12/09/2014 : Lambda Calculus ,  Monitoring, #DeepLearning,  #BigData

• Lambda Calculus : Good intro in Lambda calculus and Functional programming.
• Deep Learning through Examples: Deep learning meetup talk / Screencast with Audio 9/11/14   
• Monit : small Open Source utility for managing and monitoring Unix systems. It conducts automatic maintenance and repair and can execute meaningful causal actions in error situations.
• KDD Retro: Google Knowledge Vault and Topic Modeling : Excellent Summary of KDD 2014 conference
• Also the all tutorials slides of KDD14 are here