Links of the day 23 - 12 - 2014

Today's links 23/12/2014: Erasure code library and #cloud #storage that use them ( #swift , #ceph ), warehouse scale computing and scheduling

• Erasure code library : if you need a refresher on the subject [ erasure code for storage ] 
• liberasurecode : Erasure Code API library written in C with pluggable Erasure Code backends. 
• Jerasure : Too bad that Streamscale decided to shut down this project using patent coercion methods [project homepage with announcement].. But the github is still UP :) 
• Cloud storage using Erasure code: 
• Swift : interesting that they chose AP over C ( CAP theorem ) and use liberasurecode 
• Ceph : use jerasure, i wonder what are going to be the implication of the partial amputation of the project on CEPH performance 
• Next Gen Erasure code : erasure code are mapped deterministicaly using a global namespace scheme eliminating the need for accessing metada repository hence speeding up 
• A few control issues in warehouse-scale computing : John wilkes (Google) #cloud Control Workshop, London, UK December 2014 
• Scheduling for Large Scale Systems : 9th Scheduling for Large Scale Systems Workshop - July 1-4, 2014 - Lyon, France 

Links of the day 22 - 12 - 2014

Today's links 19/12/2014: #azure postmortem, #machinelearning and programmer resources list, #robot knowledge engine

• Root Cause Analysis : Nov 18 Azure Storage Service Interruption detailed postmortem.
• 10 Technical Papers Every Programmer Should Read (At Least Twice) : some good paper , basically the minimum paper list that any CS student should have read by the end of its university cycle.
• 200 machine learning and data science resources : looks like everybody love to make list when the year comes to an end. 
• Robot brain : Knowledge Engine For Robots

Links of the day 18 - 12 - 2014

Today's links 18/12/2014: #devops infra provisioning model, #blockchain Distributed apps stack, anonymous group communication

• 7 Layer DIP : 7 layer osi like model that decompose the DevOps Infrastructure Provisioning environment. 
• Eris : blockchain based Distributed Application Software Stack that aim at enabling design, test, and deployment of distributed applications which are as flexible, user-friendly, and legally compliant as they are secure. 
• Dissent : accountable anonymous group communication delivering prractical anonymous group communication system offering strong, provable security guarantees with reasonable efficiency

Links of the Day 17 - 12 - 2015

Today's links 17/12/2014: HP's machine,  #datacenter, #bigdata, stream computing, #bitcoin dev guide

• Tigon : open-source, real-time, low-latency, high-throughput stream processing framework from Cask Data, Inc. and AT&T . Interesting to see how now company are all releasing open source components.. Open source projects are now just another economic weapon on the corporate arsenal. 
• Bitcoin Developer Guide : detailed information about the Bitcoin protocol and related specifications
• The Machine: HP datacenter scale computer based on memristor technology
• The HP Memristor Solution for Computing Big Data : Stanley Williams lecture on HP "machine"

Links of the day 16 - 12 - 2014

Today's links 16/12/2014: VRAM fs, Mesh Network, #NuPic , free courses, #Machinelearning

• VRAMfs : video ram file system.. Now you know what to do with all your old graphics card laying around. 
• Freedom Layer : quest for a scalable, secure and distributed mesh network. 
• NuPic : Numenta is ramping up its community investment
• 2014 Fall Hackathon
• NuPIC Studio : all-in-one tool that allows users create an HTM network from scratch, train it, collect statistics
• Jeff Hawkins Hackaton Kickoff video
• A Master List of 1,100 Free Courses From Top Universities : 1100 free online courses from the leading universities

Links of the day 15 - 12 - 2014

Today's links  15/12/2014 : Code Monkeys, Cache Monitoring, Distributed system design and Elliptic curve crypto for Rust

• Not Just Code Monkeys : Martin Fowler keynotes on the importance of building a healthy social environment where software development can thrive.
• Intel Cache Monitoring : enables threads, applications, VMs or any combination to be tracked simultaneously in a flexible manner to suit a wide variety of software usage models. with some really nice tools and especially KVM support 
• Introduction to Distributed System Design : Google Code University distributed system lecture and notes.
• Elliptic Curve Crypto : pure rust implementation , now you can have identity based crypto solution in pure rust.

Links of the day 12 - 12 - 2014

Today's links 12/12/2014 : #python document DB and pipelines / batch jobs orchestration, RAM #Cloud

• BitzDB : document-oriented database for Python 
• Luigi : Python module that helps you build complex pipelines of batch jobs. It handles dependency resolution, workflow management, visualization etc. It also comes with Hadoop support built in. From spotify 
• ARC : Analysis of Raft Consensus, in depth technical report analyzing the raft consensus by Heidi Howard 
• RamCloud : this is a really interested project i reported about a couple of time already they seem to move to the next stage of the project which is probably more about productization than research.

Links of the day 11 - 12 - 2014

Today's links 11/12/2014: OS conf, #Unikernel : #Rump , #jitsu , atlas #devops, bgp image format

• New Directions in Operating Systems conference: video slide and audio of the 2014 conference, selected talk : 
• Rump Rump kernels and {why,how} we got here
• Rumprun : unikernel for Posix application on top of rump
• jitsu : Just-in-Time Summoning of Unikernels
• Userland Networking and Userspace networking : when the network stack move out of the kernel
• BPG : Frabice Bellard is a new image format based on HEVC and supported by most browsers with a small Javascript decoder. You can see the comparison with other format here
• Atlas : bridge the gap between the devops split by bundling all 5 Hashicorp tools into a single SaaS solution. Really nice toolkit. 

Links of the day 10 - 12 - 2014

Today's links 10/12/2014: #openstack , VM placement , #Cloud , #HPC and transactional app delivery and update from #Ubuntu

• Snappy : Ubuntu Core, with a new mechanism for transactional app delivery and system updates ( "snappy" ). This is in direct competition with rpm-ostree from project atomic or NixOS
• Ironic + Crowbar for openstack : another step toward making bare metal provissioning as easy as provisioning VM
• Job packing in warehouse-scale computing : more VMs or jobs in more space .
• HPC aware VM placement : VMs packing for HPC use case

Links of the day 9 - 12 - 2014

Today's links 9/12/2014: #quantum computing, #LLVM conf, #HPC fault tolerance

• Future Of Quantum Computing : Vern Brownell (CEO, D-Wave) insights in quantum computing and where it is headed. 
• LLVM Developers' Meeting : video and slides of the 2014 conference
• Fault-tolerant Techniques for HPC : Tutorial on Techniques and practical use of fault tolerance approach for large scale HPC systems.
• Failures at Petascale :  Lessons Learned From the Analysis of the peta scale Blue Waters HPC system

Links of the day 8 - 11 - 2014

Today's links 8/11/2014: stream processing, documentation, #machinelearning , #bigdata

• Write the docs : a place where the art and science of documentation can be practiced and appreciated
• Mantis : Netflix's Event Stream Processing System
• ACID Stream Processing : transactional stream processing system that supports full ACID properties without compromising scalability and high throughput
• Machine learning : 
• when machine learning goes bad : when using ML to do preemptive maintenance end up being counter productive and really expensive.. 
• large scale deep learning : lecture deck from Google fame Jeff Dean

Links of the day 5 - 12 - 2014

Today's links 5/12/2014 : #hotchips , code performance, #SGI UV, #HPC , #KVMGT

• Hotchips : video and slides for 2014 edition.
• KVMGT : the implementation of #Intel GVT-g(full GPU virtualization) for #kvm
• Coding for Performance : how aligning of data within structures can help you achieve optimal performance
• SGI UV 300 : A single UV 300 chassis (5U) provides 4 Xeon E7 processors, up to 96 DIMMs, and 12 PCIe slots. Connecting 8 of these units together in a single rack, using NUMAlink7 interconnect, then creates a huge pool of resources, up to 480 cores, 24TB DRAM.

Links of the day 4 - 12 - 2014

Links of the day 4/12/2014: #devops tools, Distributed systems and Micron Automata processors

• Serverspec : framework using RSpec tests to validate server configuration
• Diamond : python daemon that collects system metrics and publishes them to Graphite (and others).
• Automata : Micron processor is designed to have complex, unstructured data written to it and to perform graph processing on that data, and provide analytic results back to the user or to the host system.
• Distributed systems for fun and profit : distributed programming and systems concepts you'll need to understand commercial systems in the data center.

Links of the day 3 - 11 - 2014

Today's links 3/12/2014:  #container management , choosing a #nosql platform, future programming , #ARM v8.1 , #Apache drill for #Hadoop

• Giant Swarm : kubernetes alternative 
• Visual Guide to NoSQL Systems : picking one is not as trivial as what they want you to believe.
• Future Programming Workshop 2014 : Video from the workshop 
• Arm v8 architecture : An overview of the ARMv8.1 architecture extensions (enhancements over current ARMv8). An important feature is the possibility to run a host OS kernel directly in EL2 (Hypervisor mode) saving some extra context switches for KVM.
• Drill : new top level project from apache , aim to deliver Schema-free SQL Query Engine for Hadoop and NoSQL

Links of the day 2 - 12 - 2014

Today's links 2/12/2014:  #CoreOS #docker Rocket container runtime, #Go Probabilistic data-structure, software define stuff.

• Rocket:  after lxd and nspawn , Coreos brings its own container run-time, as long as the API stay stable across the product who cares. Competition is good even if I feel that the departure from LXC is premature and more effort should be poured into it rather than going for the its doomed lets rewrite it attitude.
• Probabilistic Data Structures for Go : When you do not always know what you are getting, trade off between speed/ memory and flexibility. 
• Software-Defined Application Delivery : Software defined everything.. but more seriously the fragmentation of the software engineering landscape is interesting.

Links of the day 1 - 12 - 2014

Today's links 1/12/12014: functional programming pattern, virtual supercomputer on demand and VMWARE software defined datacenter architecture.

• Functional Programming Patterns : nice look into design pattern for Functional programming
• Virtual Supercomputer: Massive Solutions, announced a beta version of their computational service platform. It provides secure Internet access to high-performance parallel cluster resources and applications on demand.
• VMware Software-Defined Data Center : reference architecture  providing an overview of the solution and the logical architecture as well as results of the tested physical implementation