Monday, February 23, 2015

Links of the day 23 - 02 - 2015

Today's links 23/02/2015: #Bitcoin K/V store, distributed systems, Job Titles and Latency visualization
  • Blockstore : experimental key-value store (for unique, global name registration and secure data storage) on top of Bitcoin. 
  • Highly Distributed Computations Without Synchronization : this article explore the basic building blocks for crafting deterministic applications that, when operating over data structures that guarantee convergence in the event of concurrent operations, guarantee convergence of the applications themselves. 
  • The Problem with Job Titles : interesting view on what job title really mean for different people. However this works both way, company misuse job title the same way employee misinterpret them. 
  • HdrHistogram : histogram designed for recoding histograms of value measurements in latency and performance sensitive applications. [github]

Friday, February 20, 2015

Links of the day 20 - 02 - 2015

Links of the day 20/02/2015:Probabilistic counters, Rack PCIe Fabric, Complex Networks robustness, High performance Network protocol
  • Characterizing Storage Workloads with Counter Stacks : Really great approach to use hyperloglog algorithm to characterize workloads. It allow the identification of working set sizes without the large memory overhead . The key advantage is it allow the generation of accurate MRC for large workload without the tremendous overhead which then can be used to tweak the cache size and for online placement decision.
  • Rack Level PCIe fabric : looks like the competition is heating up for the next gen rack level fabric. There is some really nice feature in there, advanced topology ( torus, 3D fat tree), support for native tcp/ip , rdma and native. And last but not least sharing of I/O by the assignment of the VFs of SR-IOV . Not to forget that most ops are sub micro seconds. Its nice to see the rack level fabric competition heating up.
  • Improving the Robustness of Complex Networks with Preserving Community Structure : 3-step strategy to improve the robustness of a network, while retaining its community structure, and also its degree distribution.
  • Trickles : Stateless High Performance Networking that relies on Transport continuations information within the packet for congestion control algorithm , effectively removing the state maintenance on both side. Creating a stateless protocol at the cost of periodical update signal.

Thursday, February 19, 2015

Links of the day 19 - 02 -2015:

Today's links 19/02/2015: Technical debt, #Microservices & µ²services, SSD
  • Technical debt financial metaphor : using finance term to describe technical debt, however I feel that we need to introduce the concept of refinancing, restructuring of technical debt. Without forgetting the bankruptcy option when there is really no other choice. 
  • Microservices - stress-free and without increased heart attack risk : a short explanation why µservice are always hard (yes, the title of the presentation is sort of an oxymoron) and what kind of architectural trade-off they are compared to monoliths.
  • What every programmer should know about solid-state drives : Part 6 summarizing the key information ( you can find link to the previous 5 parts in the page)
  • Micro Micro Services : proposed to push the concept of micro service one step further when you have a single container per request per service and not service alone. There is certain advantage however until the technology to make this approach seamless ( such as flash cloning etc..) it will remain a nice thought exercise ( follow up post here ) .


Wednesday, February 18, 2015

Links of the day 18 - 02 - 2015

Today's links 18/02/2015: Packet Sender and #Bigdata : Stream processing , Probabilistic methods, PCA
  • Stream Processing and Probabilistic Methods: great introduction on how you can leverage probabilistic methods ( hyperloglog, blom filter, etc..) to handle data at scale
  • Making sense of stream processing : excellent talk by Martin Kleppmann on how event streams can help make your application more scalable, more reliable and more maintainable. [transcript]
  • Packet Sender : open source utility to allow sending and receiving TCP and UDP packets. Really practical when you need to debug network protocols.
  • PCA : Principal component analysis (PCA) is a technique used to emphasize variation and bring out strong patterns in a dataset. It's often used to make data easy to explore and visualize.

Tuesday, February 17, 2015

Links of the day 17 - 02 - 2015

Today's links 17/2/2015: #Bigdata statistics theorems, teaching computer to make music, #Micorservices simulator
  • Central Limit Theorem : reminder on this crucial theorem for statistics, i.e. how to reason about sample and their impact on our results.
  • Teaching Computer to Write Its Own Music : a demonstration that computation could complement human creativity
  • Bayes Theorem : the benefit of integrating Bayesian techniques to analyse data vs pure frequentist based approach.
  • Spigo : Simulate Protocol Interactions in Go using nanoservice actors. Suitable for fairly large scale simulations, runs well up to 100,000 independent nanoservice actors. Two architectures are implemented. One creates a peer to peer social network (fsm and pirates). The other is based on NetflixOSS microservices in a more tree structured model.

Monday, February 16, 2015

Links of the day 16 - 02 - 2015

Today's links 16/02/2015: Memory Analysis, CPU instruction for NVM,SR-IOV and Linux kernel live patching
  • ANATOMY: an analytic model of memory system performance able to summarize key workload characteristics, namely row buffer hit rate, bank-level parallelism, and request spread which are used as inputs to the queuing model to estimate memory performance. [slides]
  • CLWB and PCOMMIT : a look at the new specific cpu instruction for NVM. The real benefit will start to appear when the dev willstart using them in application such as in-memory DB or persistence logging.
  • SR-IOV : Single-root I/O virtualization (SR-IOV) standard allows an I/O device to be shared by multiple Virtual Machines (VMs), without losing runtime performance. series of videos covering topics for your virtualization environment such as VXLAN Tunnel End Point (VTEP), live VM migration, and HPC clustering.
  • Live patching : kGraft and kpatch merged into a single patchset for kernel live patching .. 




Friday, February 13, 2015

Links of the day 13 - 02 - 2015

Today's links 13/02/2015: Scalable and resilience web site, CAP theorem, automated log analyzer and Exascale HPC challenges
  • Scalable and Resilient website : lessons learned from all the biggest sites on the internet about how to build scalable and resilient architectures. 
  • Perspectives on the CAP theorem : paper summary that show the CAP theorem in the broader context of a family of results in distributed computing theory that shows impossibility of guaranteeing both safety and liveness in an unreliable distributed system.
  • Sequence: Automated Analyzer for Reducing 100,000's of Log Messages to 10's of Patterns
  • Algorithmic and Software Challenges atExtreme Scales : presentation by Jack Dongarra  , quite redundant as the same theme are pretty common to all HPC exascale challenge : matrix operations optimizations, power, resilience, scalability, etc..
IBM Photonic 3D chip