Tuesday, October 17, 2017

[Links of the Day] 17/10/2017: Corporate Taxes & wages, Storage with macromolecule, 25 years of MPI


  • Do Higher Corporate Taxes Reduce Wages? : interesting paper where the authors estimate that 40% of the corporate tax burden is passed onto the worker. And that most of the tax variation is directly imposed on the workforce. 
  • Macromolecules as Storage Media : the authors suggest that you can achieve a petabyte per cubic centimetre. Stability and durability are not fully addressed yet compared to another non-organic medium. However, I doubt that this can be a major concern as it can be an extremely viable solution for short-term transport of digital data. 
  • MPI symposium : MPI is 25 years old, and still improving. The venerable HPC message passing interface is still widely used and underpin a lot of non-HPC critical infrastructure such as stock markets. A must read is Jack Dongarra presentation on the evolution of MPI.

Thursday, October 12, 2017

[Links of the Day] 12/10/2017 : bitcoin resource list, time series DB seminar, Microservices debugger

  • Bitcoin resource list : extensive list of bitcoin resource ranging from basic introduction, history, tutorial, to in-depth tech materials
  • Time Series Database Lecture : 2017 Carnegie Mellon university lectures. This is quite good as it not this series of lecture not only offer high-quality theoretical knowledge in the field but also invited talk from key commercial and opensource player in this field ( influxdb, timescale, etc..) 
  • Squash : microservices debugger, because now you can't rely on your monolith debugging skill and tool set anymore ( ^_^).


Tuesday, October 10, 2017

[Links of the Day] 10/10/2017 : Machine Learning Hardware acceleration , Homomorphic encryption

  • Tutorial on Hardware Architectures for Deep Neural Networks : How to leverage hardware for accelerating machine learning processes. 
  • A Survey on Homomorphic Encryption Schemes : this paper presents a thorough survey of the state of homomorphic encryption schemes. Homomorphic encryption allows manipulation of the encrypted data without the need to decrypt it. This will allow when hardware will be fast enough to deal with the complexity of the operations, to have a true secure distributed multitenant database. As no operation on the hosting side will require clear text decryption of the data and everything can be done securely on the client side. 
  • Efficient Methods and Hardware for Deep Learning : Standford lecture where guest lecturer Song Han present algorithms and specialized hardware (FPGA, GPU, ASIC, etc..) that can be used to accelerate training and inference of deep learning workloads. [video]



Friday, October 06, 2017

[Links of the Day] 06/10/2017 : HPC routing topology on dependency graph, Arm network stack development, Multicore graph processing

  • Routing on the Channel Dependency Graph : the author aim are providing a toolset for topology calculation for HPC network. 
  • Arm for network stack developers : arm is trying to slowly move up the stack into the data centre world. For that, it needs to address one of its main limitation: IO. This slide deck describe the current effort to tackle network stack limitation ( and support RDMA ) as well as providing pointer where ARM or devs can push the Linux stack further. As Linux is pretty much the only viable software stack for such hardware infrastructure in the datacenter. 
  • Multicore graph processing : this present a very good overview of the Multicore graph processing problem, solution landscape and where it's heading. Graph problems are essential to solve in the domain of social network modelling as well as for items recommendation or search and website ranking. [slides]



Wednesday, October 04, 2017

[Links of the Day] 04/10/2017 : Tensor Flow Extended , 5d Torus , Machine learning influencing hardware designs

  • TFX : Google paper describing it's tensor flow based platform for production scale deployment. It is impressive how they created a platform that delivers robust TensorFlow-based learners and support for continuous training and serving with production-level reliability. [video]
  • 5d torus : when your 3d torus fabric is not enough :) . The authors demonstrate how using 6 port NIC they are able to achieve such feat. Its domain of application is still be limited to HPC environment as only tailored applications can leverage such network topology. However, there might be potential in the machine learning domain. There is only a future for such approach if they are able to demonstrate significant acceleration for popular problems ( ML ). And make is fungible for cloud-like deployment. I.e. you need to be able to easily partition a set of nodes connected by such network and share it in multitenancy model. [slides] [thesis]
  • Machine Learning and the Implications for Computer System Design : Jeff Dean talk at hot chips 2017 conference. Jeff really really show the current influence of ML on the present and future hardware architecture. 





Thursday, September 14, 2017

[Links of the Day] 14/09/2017 : Automating Turing test, Deep Learning Survey, Unix History


  • Toward Automatic Turing Test : when software is used to detect if its a software or a real person talking, feel like it should be submitted to totally, not robot subreddit. The problem is way more complex and useful than it seems. By automating the procedure you could do fast prototyping and testing of models with limit human input. Accelerating the research and reducing costs. 
  • Survey of Deep Reinforcement Learning : l cover central algorithms in deep reinforcement learning, including the deep Q-network, trust region policy optimisation, and asynchronous advantage actor-critic.
  • Unix - History and Timeline : The history of Linux's grandfather OS , surprisingly enough the latest version 3 spec and ISO/IEC spec came out in 2003. Which is only 14 years ago ( I feel old now.... )

Tuesday, September 12, 2017

[Links of the Day] 12/09/2017 : OpenFaaS serverless framework, Papers I like, Docker comparison tool

  • FaaS : Functions as a Service (OpenFaaS) is serverless framework using Docker & Kubernetes. What I really like about this approach is that it simply relies on using STDIN and STDOUT as a way of passing event trigger and output of the serverless function. It allows great flexibility and open up functionality that you wouldn't have by using Lambda by example. As it constraints you behind the REST + API gateway model.
  • Papers I like : start of a really cool series ( 5 parts so far) of interesting fundamental papers. Must check out!
  • lstags : a practical little tool that allows you to compare local docker image with the ones in a repository.