Showing posts with label tool. Show all posts
Showing posts with label tool. Show all posts

Thursday, June 25, 2020

[Links of the Day] 25/06/2020 : Architecture decision record, Database stress test, Rust Network Function Framework

  • Architecture decision record : Methods and tools for capturing software design choices that address a functional or non-functional requirement that is architecturally significant. [template]
  • pstress : Perconna Database concurrency and crash recovery testing tool
  • capsule : A framework for network function development. If you want to do fast packet process in a memory safe programing language (RUST) this is for you.

Tuesday, May 05, 2020

[Links of the Day] 05/05/2020: cached Compilation, DeepLearning optimization library, Nuclear Matters Handbook

  • umake : no more compilation wait, this tool offers fast with cached compilation.
  • Deepspeed : a deep learning optimization library. The authors claim some amazing gains over the standard library. The nice thing is that it reuse the PyTorch API, which makes it easy to use. [github]
  • Nuclear Matters Handbook : ever wanted to know how the US handles Nuclear deterrent and nuclear matters? look no further and read this book. It provides an overview of the U.S. nuclear enterprise and how the United States maintains a safe, secure, and effective nuclear deterrent.


Tuesday, April 28, 2020

[Links of the Day] 28/04/2020 : Distributed Time Series Database, Data lakes, Translate data between format

  • Modern data lakes : if you think you need a data lake, you probably don' need one and are better off using S3/athena or GCP/bigquery . If you know you want a data lake you might be mature enough to need one and should read this article.
  • M3DB : Distributed Time Series database from Uber, it tries to address horizontal scaling of storage and queries or long term storage limitation of existing solutions.
  • ConfBase : a practical tool for inferring and instantiating schemas and translate between data formats. The tools support JSON, GraphQL, YAML, TOML, and XML. [github]


Thursday, October 26, 2017

[Links of the Day] 26/10/2017 : Algebra for #AI , Live presentation tool, The (nonexistent) CEO effect

  • All the Linear Algebra You Need for AI : well not really, but it is a good start
  • doitlive : if you ever had to do a live demo/presentation. You know how dreadful it can be. Stuff can go wrong really fast. This tool allows you to remove some of the hassles of this type of exercise. It reads a file of shell commands and replays the commands in fake terminal sessions. 
  • How large must the CEO effect be to rule out chance? : turn out that most CEO are completely interchangeable as that most CEO has little effect on company performance. 



Tuesday, September 12, 2017

[Links of the Day] 12/09/2017 : OpenFaaS serverless framework, Papers I like, Docker comparison tool

  • FaaS : Functions as a Service (OpenFaaS) is serverless framework using Docker & Kubernetes. What I really like about this approach is that it simply relies on using STDIN and STDOUT as a way of passing event trigger and output of the serverless function. It allows great flexibility and open up functionality that you wouldn't have by using Lambda by example. As it constraints you behind the REST + API gateway model.
  • Papers I like : start of a really cool series ( 5 parts so far) of interesting fundamental papers. Must check out!
  • lstags : a practical little tool that allows you to compare local docker image with the ones in a repository.


Tuesday, August 01, 2017

[Links of the Day] 01/08/2017 : Os Image generation, K/V optimized for SSD, Command line cloud deployment tool


  • mkosi : Tool for generating OS image. This is nice if you need to create an maintain low-level OS image with EFI support and GPT based table. It is invaluable if you do bare metal deployment / PXE  based deployment. [github]
  • WiscKey : Key / Value pair system optimised for SSD systems. Especially aiming at avoiding write amplification with traditional LSM based K/V system. 
  • Arc :  plaintext manifest for provisioning and deploying a cloud infrastructure. It's quite nice and elegant interface for such tedious task. If you have used chef, puppet, cloud formation or terraform you know how verbose this can get. 




Tuesday, July 18, 2017

[Links of the Day] 18/07/2017 : Banking API, how Cooperation strategy evolve, Distributing file system images

  • Teller : API for your bank account, already support a couple of UK bank. This is nice, however, I wonder how banks will react? Also, EU is forcing bank open their API but UK is leaving the EU, and there is a chance that the UK banking system will try to seize the chance to create its own independent banking API. Creating more barrier to entry for fintech startup. Anyway this is rather cool, however, I am still disappointed that most banks do not expose an API to access your data. 
  • How Cooperation Evolves :  the authors looked at evolution as a thermodynamic process and found how cooperation strategy evolve and how they can be manipulated.  
  • Casync : A tool for distributing file system images, really cool if you have to update images often and want to have a cheap traffic and storage wise solution.