Thursday, May 09, 2019

[Links of the Day] 09/05/2019 : Algorithms discrimination, Generalised solution to distributed consensus, P2P Docker registry

  • Discrimination in the Age of Algorithms : Machine learning has a huge potential, both for good and evil. The most perfidious is discrimination from an opaque algorithm, as proving that the algorithm is discriminative becomes extremely hard post-hoc. 
  • A generalised solution to distributed consensus : this result will rapidly become the first thing taught in every single distributed systems class. And if this holds as a generalization of trustful distributed consensus as a field, then she has defined its Turing Machine equivalent. And it is even remarkably easy to understand!
  • kraken : P2P Docker registry capable of distributing TBs of data in seconds

Tuesday, May 07, 2019

[Links of the Day] 07/05/2019 : JIT runtime for WASM, Advanced Distributed Command Dispatch, Data templating for all

  • WasmTime : Standalone JIT-style runtime for WebAsssembly, using Cranelift
  • Brighter : Command Dispatcher, Processor, and Distributed Task Queue
  • Jsonnet : A data templating language for app and tool developers. This seems to hit a sweet spot for app configuration and tools. Often a lot of microservices/ apps have chained dependency in their configuration and we are still forced to write and maintain each of these configuration files separately. Jsonnet helps you solve that issue.

Thursday, April 18, 2019

[Links of the Day] 18/04/2019 : Decentralised networks made easy, Reload Linux system over ssh, Self Hosted push notification

  • Octopus : Octopus allow you to streamline the creation of decentralized networks.
  • : Wipe, reinstall or restore your system from running GNU/Linux distribution. Via SSH, without rebooting. 
  • Gotify : A self-hosted push notification service. But beware as worth noting that this will use a noticeable amount of power more than Google cloud messaging. Google/Apple and others have special deals with carriers that might make such solution cost prohibitive.

Tuesday, April 16, 2019

[Links of the Day] 16/04/2019 : L3 VPN gateway, NSA reverse engineering toolkit, Proof of History based block-chain

  • Vita : high-performance L3 VPN gateway you can use to interconnect your networks.
  • Ghidra : the first real competitor to IDA Pro, the extremely expensive and often pirated state-of-the-art software for reverse engineering.
  • Solana : bold claim from the authors as they claim to support 710,000 tx/s with off-the-shelf hardware and no sharding. This seems to be enabled by leveraging proof od history mechanism rather than the traditional proof of work that bitcoin and al. use.

Tuesday, March 05, 2019

[Links of the Day] 05/03/2019 : RDMA for containers, K8s for hobbyist, OpenSource mobile core network

  • FreeFlow : virtual RDMA networking purely with a software-based approach using commodity RDMA NICs for containers. 
  • K8s clusters for hobbyist : how to setup and operate a fully functional, secure Kubernetes cluster on a cloud provider such as Hetzner Cloud, DigitalOcean or Scaleway.
  • Magma : open-source software platform that gives network operators an open, flexible and extendable mobile core network solution.

Thursday, February 21, 2019

[Links of the Day] 21/02/2019: Database Internals, Fosdem 2019 Videos, Cloud Programming Simplified

  • Database Internals ; excellent series delving into the internal mechanism and algorithm of modern and not so modern database systems.
  • Fosdem 2019 Videos: Fosdem 2019 conference video start to filter through on the interweb
  • Cloud Programming Simplified: A Berkeley View on Serverless Computing paper which gives a quick history of cloud computing, including an accounting of the predictions of the 2009 Berkeley View of Cloud Computing paper, explains the motivation for serverless computing, describes applications that stretch the current limits of serverless, and then lists obstacles and research opportunities required for serverless computing to fulfil its full potential.

Tuesday, February 19, 2019

[Links of the Day] 19/02/2019: Headless Jenkins, Organising AWS accounts, 10-tier microservices architecture demo

  • jenkinsfile-runner : run your Jenkins file in headless mode. This is fantastic if you want to offer a quick way to test your pipeline locally or even offer Jenkins as a function.
  • Organizing enterprise AWS accounts: a very good intro on how, what, and why partitioning your AWS accounts.
  • 10-tier microservices architecture demo : shows how to build a website using a 10-tier microservices architecture—Kubernetes/GKE, Istio, Stackdriver, Skaffold, gRPC and OpenCensus—where each tier is written in a different language—Go, C#, Node, Python, Java, Python—all connected using gRPC, deployable using with little or no configuration. Microsoft has a similar example and lets me tell you I am sure that somewhere there is an exec that gave it a look and mandated a poor dev team to deliver the same for its company website while using their own private cloud ( he has to justify buying all those servers a couple of years ago)