Tuesday, December 23, 2014

Links of the day 23 - 12 - 2014

Today's links 23/12/2014: Erasure code library and #cloud #storage that use them ( #swift , #ceph ), warehouse scale computing and scheduling

  • Erasure code library : if you need a refresher on the subject [ erasure code for storage
  • Cloud storage using Erasure code: 
    • Swift : interesting that they chose AP over C ( CAP theorem ) and use liberasurecode 
    • Ceph : use jerasure, i wonder what are going to be the implication of the partial amputation of the project on CEPH performance 
  • Next Gen Erasure code : erasure code are mapped deterministicaly using a global namespace scheme eliminating the need for accessing metada repository hence speeding up 
  • A few control issues in warehouse-scale computing : John wilkes (Google) #cloud Control Workshop, London, UK December 2014 
  • Scheduling for Large Scale Systems : 9th Scheduling for Large Scale Systems Workshop - July 1-4, 2014 - Lyon, France 

Monday, December 22, 2014

Links of the day 22 - 12 - 2014

Today's links 19/12/2014: #azure postmortem, #machinelearning and programmer resources list, #robot knowledge engine

Thursday, December 18, 2014

Links of the day 18 - 12 - 2014

Today's links 18/12/2014: #devops infra provisioning model, #blockchain Distributed apps stack, anonymous group communication

  • 7 Layer DIP : 7 layer osi like model that decompose the DevOps Infrastructure Provisioning environment. 
  • Eris : blockchain based Distributed Application Software Stack that aim at enabling design, test, and deployment of distributed applications which are as flexible, user-friendly, and legally compliant as they are secure. 
  • Dissent : accountable anonymous group communication delivering prractical anonymous group communication system offering strong, provable security guarantees with reasonable efficiency

Wednesday, December 17, 2014

Links of the Day 17 - 12 - 2015

Today's links 17/12/2014: HP's machine,  #datacenter, #bigdata, stream computing, #bitcoin dev guide
  • Tigon : open-source, real-time, low-latency, high-throughput stream processing framework from Cask Data, Inc. and AT&T . Interesting to see how now company are all releasing open source components.. Open source projects are now just another economic weapon on the corporate arsenal. 
  • Bitcoin Developer Guide : detailed information about the Bitcoin protocol and related specifications
  • The Machine: HP datacenter scale computer based on memristor technology
  • The HP Memristor Solution for Computing Big Data : Stanley Williams lecture on HP "machine"

Tuesday, December 16, 2014

Links of the day 16 - 12 - 2014

Today's links 16/12/2014: VRAM fs, Mesh Network, #NuPic , free courses, #Machinelearning

Monday, December 15, 2014

Links of the day 15 - 12 - 2014

Today's links  15/12/2014 : Code Monkeys, Cache Monitoring, Distributed system design and Elliptic curve crypto for Rust

  • Not Just Code Monkeys : Martin Fowler keynotes on the importance of building a healthy social environment where software development can thrive.
  • Intel Cache Monitoring : enables threads, applications, VMs or any combination to be tracked simultaneously in a flexible manner to suit a wide variety of software usage models. with some really nice tools and especially KVM support 
  • Introduction to Distributed System Design : Google Code University distributed system lecture and notes.
  • Elliptic Curve Crypto : pure rust implementation , now you can have identity based crypto solution in pure rust.

Friday, December 12, 2014

Links of the day 12 - 12 - 2014

Today's links 12/12/2014 : #python document DB and pipelines / batch jobs orchestration, RAM #Cloud
  • BitzDB : document-oriented database for Python 
  • Luigi : Python module that helps you build complex pipelines of batch jobs. It handles dependency resolution, workflow management, visualization etc. It also comes with Hadoop support built in. From spotify 
  • ARC : Analysis of Raft Consensus, in depth technical report analyzing the raft consensus by Heidi Howard 
  • RamCloud : this is a really interested project i reported about a couple of time already they seem to move to the next stage of the project which is probably more about productization than research.

Thursday, December 11, 2014

Links of the day 11 - 12 - 2014

Today's links 11/12/2014: OS conf, #Unikernel : #Rump , #jitsu , atlas #devops, bgp image format
  • New Directions in Operating Systems conference: video slide and audio of the 2014 conference, selected talk : 
  • BPG : Frabice Bellard is a new image format based on HEVC and supported by most browsers with a small Javascript decoder. You can see the comparison with other format here
  • Atlas : bridge the gap between the devops split by bundling all 5 Hashicorp tools into a single SaaS solution. Really nice toolkit. 

Wednesday, December 10, 2014

Links of the day 10 - 12 - 2014

Today's links 10/12/2014: #openstack , VM placement , #Cloud , #HPC and transactional app delivery and update from #Ubuntu

Tuesday, December 09, 2014

Links of the day 9 - 12 - 2014

Today's links 9/12/2014: #quantum computing, #LLVM conf, #HPC fault tolerance

Monday, December 08, 2014

Links of the day 8 - 11 - 2014

Today's links 8/11/2014: stream processing, documentation, #machinelearning , #bigdata

  • Write the docs : a place where the art and science of documentation can be practiced and appreciated
  • Mantis : Netflix's Event Stream Processing System
  • ACID Stream Processing : transactional stream processing system that supports full ACID properties without compromising scalability and high throughput
  • Machine learning : 

Friday, December 05, 2014

Links of the day 5 - 12 - 2014

Today's links 5/12/2014 : #hotchips , code performance, #SGI UV, #HPC , #KVMGT

  • Hotchips : video and slides for 2014 edition.
  • KVMGT : the implementation of #Intel GVT-g(full GPU virtualization) for #kvm
  • Coding for Performance : how aligning of data within structures can help you achieve optimal performance
  • SGI UV 300 : A single UV 300 chassis (5U) provides 4 Xeon E7 processors, up to 96 DIMMs, and 12 PCIe slots. Connecting 8 of these units together in a single rack, using NUMAlink7 interconnect, then creates a huge pool of resources, up to 480 cores, 24TB DRAM.

Thursday, December 04, 2014

Links of the day 4 - 12 - 2014

Links of the day 4/12/2014: #devops tools, Distributed systems and Micron Automata processors

  • Serverspec : framework using RSpec tests to validate server configuration
  • Diamond : python daemon that collects system metrics and publishes them to Graphite (and others).
  • Automata : Micron processor is designed to have complex, unstructured data written to it and to perform graph processing on that data, and provide analytic results back to the user or to the host system.
  • Distributed systems for fun and profit : distributed programming and systems concepts you'll need to understand commercial systems in the data center.

Wednesday, December 03, 2014

Links of the day 3 - 11 - 2014

Today's links 3/12/2014:  #container management , choosing a #nosql platform, future programming , #ARM v8.1 , #Apache drill for #Hadoop

  • Giant Swarm : kubernetes alternative 
  • Visual Guide to NoSQL Systems : picking one is not as trivial as what they want you to believe.
  • Future Programming Workshop 2014 : Video from the workshop 
  • Arm v8 architecture : An overview of the ARMv8.1 architecture extensions (enhancements over current ARMv8). An important feature is the possibility to run a host OS kernel directly in EL2 (Hypervisor mode) saving some extra context switches for KVM.
  • Drill : new top level project from apache , aim to deliver Schema-free SQL Query Engine for Hadoop and NoSQL

Tuesday, December 02, 2014

Links of the day 2 - 12 - 2014

Today's links 2/12/2014:  #CoreOS #docker Rocket container runtime, #Go Probabilistic data-structure, software define stuff.
  • Rocket:  after lxd and nspawn , Coreos brings its own container run-time, as long as the API stay stable across the product who cares. Competition is good even if I feel that the departure from LXC is premature and more effort should be poured into it rather than going for the its doomed lets rewrite it attitude.
  • Probabilistic Data Structures for Go : When you do not always know what you are getting, trade off between speed/ memory and flexibility. 
  • Software-Defined Application Delivery : Software defined everything.. but more seriously the fragmentation of the software engineering landscape is interesting.

Monday, December 01, 2014

Links of the day 1 - 12 - 2014

Today's links 1/12/12014: functional programming pattern, virtual supercomputer on demand and VMWARE software defined datacenter architecture.
  • Functional Programming Patterns : nice look into design pattern for Functional programming
  • Virtual Supercomputer: Massive Solutions, announced a beta version of their computational service platform. It provides secure Internet access to high-performance parallel cluster resources and applications on demand.
  • VMware Software-Defined Data Center : reference architecture  providing an overview of the solution and the logical architecture as well as results of the tested physical implementation