Thursday, March 26, 2015

Links of the day 26 - 03 - 2015

Today's links 26/03/2015: #HPC Network and #Kafka REST proxy
  • Receiving Packets at the Speed of Light : Data Plane Acceleration for modern network when the amount of time to process packets decreases to as little as 6.7ns per packet at 100Gb/s. A memory barrier can cause stalls of 7ns or more strategies must be devised to mitigate in order to avoid wasting bandwidth. 
  • Multi-Host Technology in OCP-Server Track : Mellanox ConnectX-4 (100GbE)+Multiple Heterogeneous Hosts (x86, POWER, ARM, GPU) [slides]
  • slimFly : high-performance cost-effective network topology that approaches the theoretically optimal network diameter.
  • Kafka REST proxy : making it easy to connect to a Kafka cluster

Wednesday, March 25, 2015

Links of the day 25 - 03 - 2015

Today's links 25/03/2015: #RDMA, #NVM, Google Build tools, OFS dev workshop

Monday, March 23, 2015

Links of the day 23 - 03 - 2015

Today's links 23/03/2015:  Full stack Lttng profiling, #RDMA + #HADOOP , VRAM data leakage, difference between DL vs ML vs PR in AI (acronym overload)

Thursday, March 19, 2015

Links of the day 19 - 03 - 2015

Today's links 19/03/2015:#python framework, #linux perf tools, #bitcoin API, Memory-centric distributed  #storage
  • SuPPort : in-development distillation of PayPal Python Infrastructure. SuPPort is an event-driven server framework built on top of several open-source technologies designed for building scalable and maintainable services and clients.
  • Linux Performance Analysis: New Tools and Old Secrets : Brendan Gregg's excellent talk on new Linux performance tools: perf-tools collection. These use existing kernel frameworks, ftrace and perf_events, which are built in to most Linux kernel distributions by default, including the Linux cloud instances he analyze at Netflix.
  • Coinkite : Bitcoin API provides simple and powerful REST integration for adding bitcoin functions into application.
  • Tachyon: A memory-centric storage system enabling reliable file sharing at memory-speed across cluster frameworks, such as Spark and MapReduce. [SOCC 13] [Github]

Wednesday, March 18, 2015

Links of the day 18 - 03 - 2015

Today's links 18/03/2015: NVDIMM , Dynamic CPU Cache allocation, NAS + Bigdata Analytic, DPDK packet generator
  • Atomic Sector Updates inSoftware for Persistent Memory : Intel proposal to adress atomic sector update as byte addressable persistent storage is great but limited when you want to do large write.
  • Priority-Based Cache Allocation in Throughput Processors : interesting approach that propose to dynamically vary the amount of cache allocated to processors based on the pollution rate. Allowing cache friendly process to benefit from greater cache real estate [slides]
  • Qumulo : start up proposing a file system with Analytic capability directly embedded within the NAS [spec]
  • MoonGen : fully scriptable high-speed packet generator build on DPDK and LuaJIT. It can saturate a 10 GbE connection with 64 byte packets on a single CPU core while executing user-provided Lua scripts for each packet. It also features precise and accurate timestamping and rate control.

Tuesday, March 17, 2015

Links of the day 17 - 03 - 2015

Today's links 17/03/2015: hash table datastructure and hashing Algorithm, #ARM virtualization, Hyper-converged Solution

from Adexchanger comic strip

Monday, March 16, 2015

Link of the day 16 - 03 - 2015

Today's links 16/03/2015: #devops, time service, simultaneity in distributed system, value of data
  • DIY Punk Rock DevOps Playbook : punk rock view of devops from Joyent CTO Bryan Cantrill 
  • Introduction to Time Service : after reading this one would really wonder why we still stick to NTP and not use GPS based clock system that provide multiple order of magnitude higher precision within data centers.
  • There is No Now : a look into problems with simultaneity in distributed systems
  • The Value of Data : 3-part series about building companies that leverage the value of data , part [1] [2] [3]

Friday, March 13, 2015

Links of the day 13 - 03 - 2015

Today's links 13/03/2015: machine learning , Time-Series and Geospatial database, Write acceleration for virtual environment

Thursday, March 12, 2015

Links of the day 12 - 03 - 2015

Today's links 12/03/2015: cryptocurrency landscape, vsphere memory state, hyperscale datacenter system, rowhammer bit flip
  • Bitcoin Landscape : database and categorization of crypto based company [ database here ]
  • Vsphere memory state : What technique vmware use to increase memory density depending of the system memory state . Bonus : memory management performance in vsphere 5.0
  • HDS 8000 : Ericsson HDS 8000 (Hyperscale Datacenter System), built on Intel® Rack Scale Architecture. It uses optical interconnect. Combining a disaggregated hardware architecture with optical interconnect removes the traditional distance and capacity limitations of electrical connections.
  • Project Zero - row hammer : how flipping bit in memory can allow you to gain root access to a physical machine. Basically by aggressively flipping 2 bits you can trigger the third one to switch. ECC can help prevent that to a certain extent but is not completely immune.

Wednesday, March 11, 2015

Links of the day 11 - 03 - 2015

Today's links 11/03/2015: category theory, linux profiling, CRDT, Log structured merge trees

Tuesday, March 10, 2015

Links of the day 10 - 03 - 2015

Today's links 10/03/2015: architecture modeling, why engineers build crappy products, lock free DS, growth hacking

Monday, March 09, 2015

Links of the day 09 - 03 - 2015

After a brief hiatus ( still enjoying the snow in Chamonix until the 15th ) here is Todays' links 09/03/2015: real time stream engines, high performance networking framework, RLE lib
  • GearPump: Real-time Streaming Engine Using Akka [github
  • Seastar : Really interesting framework for high-performance server applications on modern hardware. It leverage DPDK and single threaded model to enable fast zero copy communication, however like any higly specific framework model there is a certain learning curve. Applications using Seastar can run on Linux or OSv. [github
  • TurboRLE : an Efficient and fastest Run Length Encoding library, nice real time stream engine using SQL semantics.
  • Pulsar : Ebay start moving more aggressively into the opensource ecosystem game [ source ]