Thursday, November 16, 2017

[Links of the Day] 16/11/2017 : Sparse and dense array database, Rythm of memory, Routing over blockchain

  • TileDB : manages massive dense and sparse multi-dimensional array data simply. This is a really good project as often there is no real support in existing database. 
  • Rhythm of memory : the brain is a complex organ. And we just barely scratched the surface. Scientist discovered that part of the memory processing in the brain is segregated in different subcomponent that process information in parallel and at different speeds. This gives a glimpse of how the brain works and how it is able to store and access so much data at the various level of granularity fast.
  • IPvPub : I really think there is something behind this concept. While I tend to be wary of the current trend of sprinkling blockchain everywhere. Using this technology for large-scale address resolution and routing can solve so many problems... Reduce reliance on DNS system in the age of lambda. What I really want to see is this integrated with a Lambda framework for simple exposure of service endpoints.

Tuesday, November 14, 2017

[Links of the Day] 14/11/2017: wallaroo elastic data processing, Unified clock for real time synchronization, Golang text search engine

  • Wallaroo : this is a really impressive alternative to spark/storm. The creators really focused on ease of use and deployment. Which can be a huge barrier to entry with the spark, storm, Hadoop stacks.  [github]
  • Unified Clock : Must read blog post, on how Riot games use a unified clock mechanism to synchronise player in the league of legends multiplayer games.  
  • Riot : golang text search engine with some really good perf - 1M blog 500M data 28 seconds index finished, 1.65 ms search response time, 19K search QPS

Thursday, November 02, 2017

[Links of the Day] 02/11/2017 : Probabilistic programming Library, Better than Word2Vec , Serverless conf

  • Edward : Turing complete deep probabilistic programming software library. Probabilistic computing is going to be at the forefront of the next big AI improvement wave. [software]
  • Better than Word2Vec : first word2vec is great and there is already so many pre-built libraries out there that it should be your number 1 go to approach. Then if you want to develop custom word embedding library, as the blog post explains, SVD might be a better approach. 
  • ServerlessConf NYC 2017 : a good summary of New York serverless conference  2017.