Tuesday, August 08, 2017

[Links of the Day] 08/08/2017 : Python image drawing & animations, Breaking x86 ISA, Correlation between NYT and Stock markets

  • pywonderland : A collection of python scripts for drawing beautiful figures or animating interesting algorithms in mathematics.
  • Breaking the x86 ISA : Back hat conf presentation on the sand sifter tool for detecting hardware bug or undocumented instruction in modern processors. Sadly, it's known that Intel's microcode binaries are encrypted, and are secured with a RSA2048-SHA256 signature. Which makes any discovery a little bit useless. Unless it's a bug and then it opens up a whole new world of possibility. [Slides] [Github]
  • Correlations and Flow of Information between The New York Times and Stock Markets : Well as everybody knows, there is a correlation between information and the market state. Nothing new, but it confirms to some extent that the new york time especially has a specific influence on wall street ( and vice versa).

Thursday, August 03, 2017

[Links of the Day] 03/08/2017 : NVMe over TCP , Lineage mapping of cryptocurrency , Perceptions of probability

  • NVMe Over TCP : interesting kernel module by solarflare that allow people to use NVMe over TCP. It will be really interesting to see what type of performance you can start to get out of such setup. Even if performance is significantly decreased ( but higher than other storage solution) the economic gain vs costly NVMe solution would make this worth it. Also, It can start to accelerate the arrival of a new type of high-performance low-cost storage applications by lowering the barrier to entry.  
  • Map of Coins : Impressive lineage mapping of crypto currency. But what is more concerning is the amount of dead Bitcoin child cryptocurrency, a lot of pump and dump scheme going on
  • Perceptions : this really cool graphics show the how human perceive probability and how fuzzy it can be.  This can explain why a certain type of person might take more risk or less based on certain information due to a different interpretation of the content. 

Tuesday, August 01, 2017

[Links of the Day] 01/08/2017 : Os Image generation, K/V optimized for SSD, Command line cloud deployment tool

  • mkosi : Tool for generating OS image. This is nice if you need to create an maintain low-level OS image with EFI support and GPT based table. It is invaluable if you do bare metal deployment / PXE  based deployment. [github]
  • WiscKey : Key / Value pair system optimised for SSD systems. Especially aiming at avoiding write amplification with traditional LSM based K/V system. 
  • Arc :  plaintext manifest for provisioning and deploying a cloud infrastructure. It's quite nice and elegant interface for such tedious task. If you have used chef, puppet, cloud formation or terraform you know how verbose this can get. 

Thursday, July 27, 2017

[Links of the Day] 27/07/2017 : Russian Information Warfare, Public Cloud Economics, Impact of slowness in ultra fast networks

  • Russian Information Warfare Handbook : In depth description of Russian information war machine and how it affects the rest of the world. Some suggestion on how to fight it, however, I feel that the internet and the current social networks model heavily bias in favour of propaganda exploitation. Moreover, with the advance of machine learning, it becomes easy to identify key nodes in the network to attack in order to achieve maximum disinformation reach. 
  • Usage Patterns and the Economics of the Public Cloud : paper looking at the current cloud economic and cloud customers. It seems that most customers have a steady or mild variation usage with the obvious outlier ( probably academia or other heavy HPC / Machine learning job) 
  • To slow or not? : the authors look at the impact of slowing down (hardware error, software bug, or simply laws of physics)  next gen network on data centres and application when we start to reach 1 digit microsecond latency. There is a wide range of implication, from technical to legal as well as ethical. Sadly most of them tend to stay unanswered until a problem or conflict arise. 

Tuesday, July 25, 2017

[Links of the Day] 25/07/2017 : Universal Scalability Law Model , k8s + cloud native apps, python distributed execution engine

  • usl4j : Implementation of Universal Scalability Law model, this is really cool because it allows you to model ( and predict ) when your system performance will start to degrade as its scale. It allows you to take real measurements from a live system and continuously build models. [github]
  • daft : a tool for developers to create cloud-native applications on Kubernetes.
  • ray : distributed execution engine written in python. Useful if you want to execute and schedule task across a cluster of nodes.

Friday, July 21, 2017

[Links of the Day] 21/07/2017 : Tofu HPC interconnect challenges, Satellite Quantum key distribution, Go K/V store

  • Evolution and challenges of Tofu Interconnect : Deep learning and heterogeneous hardware is putting a strain on HPC interconnect. They need to adapt to new application communication model as well as hardware while retaining best of breed capability for "traditional" HPC application. 
  • Satellite-to-ground quantum key distribution : this is ground breaking from Chinese scientists. Where they demonstrate they are able to solve the main hurdle behind planet-wide quantum communication by leveraging satellite to satellite quantum crypto key distribution.  And they are deploying a proof of concept!
  • Badger :  nice key/value store written in go. It's based on Wiskey paper and is heavily optimised for SSD. It's 3.5 faster than rocksDB .[github]

Tuesday, July 18, 2017

[Links of the Day] 18/07/2017 : Banking API, how Cooperation strategy evolve, Distributing file system images

  • Teller : API for your bank account, already support a couple of UK bank. This is nice, however, I wonder how banks will react? Also, EU is forcing bank open their API but UK is leaving the EU, and there is a chance that the UK banking system will try to seize the chance to create its own independent banking API. Creating more barrier to entry for fintech startup. Anyway this is rather cool, however, I am still disappointed that most banks do not expose an API to access your data. 
  • How Cooperation Evolves :  the authors looked at evolution as a thermodynamic process and found how cooperation strategy evolve and how they can be manipulated.  
  • Casync : A tool for distributing file system images, really cool if you have to update images often and want to have a cheap traffic and storage wise solution.