Reflections Of The Void

Thursday, February 12, 2015

Today's links 12/02/2015: #bigdata algorithm, probabilistic programming, Start-up resources and RAM myth

PPAML : Probabilistic Programming for Advancing Machine Learning program goal tries to facilitate the construction of machine learning applications by using probabilistic programming.
Start-up Resources : a very good list of start-up resources and articles.
The Myth of RAM : Memory access patterns matters.... a lot. This is hardly news and this article higlight it as if you solely use "classical" complexity analisys to evaluate your code you are going to be bitten badly. The main idea is that the memory accesses costs O(√N) and not O(1) in practice.

HyperLogLog : technique to estimate the cardinality of a set with cardinality Nmax using just loglog(Nmax) + O(1) bits. Like the Linear Counter the Hyper LogLog counter allows the designer to specify the desired accuracy tolerances. Very good summary of the paper here.

Today's links 11/02/2015: Test and optimization articles, scaling product team, PCIe vs Eth , Distributed Sys fallacies

100 Must-Read Articles on Testing and Optimization : data driven, big data, a/b testing etc.. The best articles from 2014
Scaling a product team : lesson learned from Intercom on how they scaled a product building team, and the nitty gritty involved in getting valuable product out the door as fast as possible.
Eight Fallacies of Distributed Computing : very good tech talk with real life encounter of the fallacies.
PCIe vs Ethernet : with the rise of Intel’s silicon photonics (SiPh) optical PCIe (OPCIe) and other PCIe fabric, is it time to fragment your datacenter and use fast PCIe rack fabric and Eth for cross rack one. To be honest time will tell as you already know the best technology doesn't always win.

Today's links 06/02/2015: Hashing, Distributed time series / monitoring , MTU, Spray list

Perfect hashing : when you like your hash without collision
Prometheus : Some interesting concept such as data is sharded and local only for reliability and scalability, time series oriented storage and query system and expose time series via key value pair.
Path MTU discovery : when you want to know what is the biggest frame you can send when you do not own 100% of the network path ( or if you just forgot)
Spray list : nice data structure delivering scalable relaxed priority queue[github implementation]

Today's links 05/02/2015 : #openstack #neutron with #dpdk , #ARM A72 coherency, Captain proto

Openstack* Neutron Accelerated by DPDK : dpdk is gaining a lot of momentum, to bad that they decided to adopt their own API model for queue rather than adopting the RDMA one ( also why they lack critical feature in term of security and multicore support)
ARM Cortex-A72 chips : coming in 2016 thus ARM 64-bit processors that can run at clock speeds of up to 2.5 GHz. They can also be paired with lower-power ARM Cortex-A53
Coherency : ARM coherence for heterogeneous core package.
Captain Proto : fast data interchange format and capability-based RPC system.

Today's links 04/02/2015: Shared Memory API for MPI, #Openstack File Service, Dell Power FX converged hardware

Remote Memory Access Programming in MPI-3 : interesting proposal and method to bridge the gap between shared memory model and message passing with the de-facto standard of HPC communication library.
Openstack Manilla : Shared File Services for the Cloud and specifically for Openstack , interesting number : 65% of all storage sold is for file-based use cases (IDC 2012) [slides]
Power Fx : Dell PowerEdge FX architecture, combining Dell networking, servers, and storage into a 2U chassis. Interesting piece of technology even if the presenter is rather monotone.

Today's links: 03/02/2015 : Log parser, Esoteric languages, Distributed systems, High speed Interconnect

Sequence: A High Performance Sequential Semantic Log Parser at 175,000 MPS
Esoteric Programming Languages : if you have ever wonder what are brainfuck , befunge , ook
Distributed Systems Seminar reading list : a good list of recent distributed system paper
High-Speed Datacenter Interconnects : special issue discusses the challenges surrounding high-speed datacenter interconnects and presents five articles that have novel approaches to achieving efficient, scalable datacenter designs. [table of content]

Today's links 02/02/2015: #AI , #Debian #Openstack Image, Metrics Driven prioritization and search engine

Awesome Artificial Intelligence : A curated list of Artificial Intelligence (AI) courses, books, video lectures and papers
Openstack Debian Image : the official OpenStack Debian image is now generated at the same time as the official Debian CD ISO images. If you are a cloud user, if you use OpenStack on a private cloud, or if you are a public cloud operator, then you may want to download the weekly build of the OpenStack image from here: http://cdimage.debian.org/cdimage/openstack/testing/
Metrics-Driven Prioritization : integrate business metrics and probabilistic modeling into prioritization process.
Hound : an extremely fast source code search engine.