Showing posts with label High Performance. Show all posts
Showing posts with label High Performance. Show all posts

Monday, July 04, 2016

[Links of the day] 04/07/2016 : eXpress Data path, Caching in future internet architectures, Kubernetes children's illustrated guide

  • Evaluating Caching Mechanisms In Future Internet Architectures : A look at future caching solution in an ever more mobile world. In this thesis, the author look at MobileFirst and named data networking strategy and the various trade-off and benefit for each caching approach. 
  • The Children's Illustrated Guide to Kubernetes : Well, I'm pretty sure that their is a good chunk of devops that suffer from the peter pan syndrome. I guess they will love this guide ! Also it is well written and easy to understand if this is your first exposure to Kubernetes 
  • eXpress Data Path : Facebook next gen high performance programmatic networking data path. This is an impressive piece of work and solution.  What is interesting is that they decided to go against the current trend. They do not use kernel bypass technique (DPDK , userspace verbs , etc..) but instead is directly integrated in the kernel fastpath.  Moreover, it is programmable , extensible ( without kernel reboot) , extend existing TCP/IP stack ( rather than replacing it ) , and high performance. With an added bonus : no need for specialized Hardware !!! 

Thursday, April 23, 2015

Links of the day 24 - 04 - 2015

Today's links 24/04/2015: iOS fail, Memory Snooping Protection in HW, NVMe/PCIe fabric for storage, High performance server application framework
  • Back to the Future With C++ and Seastar : Meetup notes on Seastar, open source server application framework written in C++ that presents a future/promise based API with 7 million requests per second served on a single machine. [slides]
  • No iOS zone:  PoC of attack : within WiFi hotspot range iOS devices are rendered unstable / unusable by constant reboots.
  • Cloud security reaches silicon : Hardware implementation of method for thwarting memory snooping or inference across VM attacks by disguising memory-access patterns
  • NVMe/PCIe as a Storage Interface : an very good overview of the market, future solution and form factors.

Monday, March 09, 2015

Links of the day 09 - 03 - 2015

After a brief hiatus ( still enjoying the snow in Chamonix until the 15th ) here is Todays' links 09/03/2015: real time stream engines, high performance networking framework, RLE lib
  • GearPump: Real-time Streaming Engine Using Akka [github] 
  • Seastar : Really interesting framework for high-performance server applications on modern hardware. It leverage DPDK and single threaded model to enable fast zero copy communication, however like any higly specific framework model there is a certain learning curve. Applications using Seastar can run on Linux or OSv. [github] 
  • TurboRLE : an Efficient and fastest Run Length Encoding library, nice real time stream engine using SQL semantics.
  • Pulsar : Ebay start moving more aggressively into the opensource ecosystem game [ source ]

Friday, February 20, 2015

Links of the day 20 - 02 - 2015

Links of the day 20/02/2015:Probabilistic counters, Rack PCIe Fabric, Complex Networks robustness, High performance Network protocol
  • Characterizing Storage Workloads with Counter Stacks : Really great approach to use hyperloglog algorithm to characterize workloads. It allow the identification of working set sizes without the large memory overhead . The key advantage is it allow the generation of accurate MRC for large workload without the tremendous overhead which then can be used to tweak the cache size and for online placement decision.
  • Rack Level PCIe fabric : looks like the competition is heating up for the next gen rack level fabric. There is some really nice feature in there, advanced topology ( torus, 3D fat tree), support for native tcp/ip , rdma and native. And last but not least sharing of I/O by the assignment of the VFs of SR-IOV . Not to forget that most ops are sub micro seconds. Its nice to see the rack level fabric competition heating up.
  • Improving the Robustness of Complex Networks with Preserving Community Structure : 3-step strategy to improve the robustness of a network, while retaining its community structure, and also its degree distribution.
  • Trickles : Stateless High Performance Networking that relies on Transport continuations information within the packet for congestion control algorithm , effectively removing the state maintenance on both side. Creating a stateless protocol at the cost of periodical update signal.

Tuesday, July 22, 2014

Links of the day - 22 - 07 - 2014 -


Ramcloud, High performance Messaging, Bitcoin and probabilistic programming and Thesis DB and Microservices, CockroachDB.


Finally for the courageous or suicidal : 
  • Deproulette : like chatroulette but for python installation package. Use at your own risk !