- Earth Computing Network Fabric : event based protocol for datacenter that target specifically datacenter as it eliminate the need for heartbeats and timeouts. The protocol relies on recoverable atomic token to deliver deterministic in order communication. To some extend they are proposing to move back to latices system where each server are a node within the network and act as router for messages. This eliminate switch requirement and looks really neat. However adoption might be difficult due to the ubiquitous Ethernet hardware and also the need to change the underlying communication protocol. Last but not least I do not really know how to efficiently secure and trust messages on such network. [slides]
- Computer Science video courses : Extensive collection of links to CS courses ranging from introductory to expert in pretty much the full scope of CS subject (DB, distributed systems, etc..)
- Appdash : Application tracing system for Go, based on Google's Dapper.
A blog about life, Engineering, Business, Research, and everything else (especially everything else)
Monday, November 28, 2016
[Links of the Day] 28/11/2016 : Earth Computing network fabric, CS video courses, Go app tracing
Labels:
computer science
,
courses
,
Distributed systems
,
fabric
,
golang
,
links of the day
,
network
,
tracing
,
video
Friday, November 25, 2016
[Links of the Day] 25/11/2016 : CD/CI maturity model , Deep Learning lip reading, Microservices make
- Continuous Delivery Maturity Model : look at the different level of maturity for continuous integration-delivery-build-.... in software development
- LipNet : deep learning for full sentence lip reading. One step closer to a fully fledged HAL.
- Dmake : tool to manage micro-service based applications. It allows to easily build, run, test and deploy an entire application or one of its micro-services.
Wednesday, November 23, 2016
[Links of the Day] 23/11/2016 : AMD Exascale vision, Hardware Resiliency myths and truths, MIT EmTech
- Resiliency for Reliability– Myths and Truths : this slide deck provide an overview of the resiliency issue and how Intel tackle those for hardware fault. From fans down to soft errors ( ex: neutron beam ... yes this can £%£ your system). The authors present the two type of approach , reactive and proactive handling of errors.
- AMD's Exascale computing vision : Its all about 3d stacked chip with future interconnect. The interesting bit is the ROCM platform and the P2P multiGPU and P2P with RDMA. Slowly we are removing the need to have a full server to deploy GPU, one step closer to fully modular system with each resourced pooled and optimized in their own enclosure. Its a lot easier to design power supply, cooling system, etc.. When you do not have to deal with heterogeneous hardware with different power, and cooling profile ( cpu, memory , disk etc.. in the same enclosure).
- MIT EmTech 16 : This year MIT EmTech is all about AI & machine learning ... reaching maximum hype in the domain
Labels:
amd
,
exascale
,
fault
,
intel
,
links of the day
,
resiliency
Monday, November 21, 2016
[Links of the Day] 21/11/2016 : Erasure Code for Big data and cluster cache, Emerging Interconnect Tech
- Erasure Coding for Big-data Systems : Technical report presenting the state of the art of erasure code and how they are use in practice.
- EC-Cache: the authors present an interesting solution. Where they combine erasure code to compensate for limitation of selective replication. The solution provide a load-balanced, low-latency cluster caching and improve resilience against failure from the inherent benefit of the code.
- Emerging Interconnect Technologies : really cool overview of the current and future of the interconnect especially on chip or chip to chip interconnect. This looks at the future of communication when chips will be stacked to keep Moore's law going.
Labels:
bigdata
,
cache
,
Distributed systems
,
erasure code
,
interconnect
,
links of the day
Friday, November 18, 2016
[Links of the Day] 18/11/2016 : Extreme Scale OS, GPU Stream Benchmark, Neural Net that produce neural net
- Neural Architecture Search with Reinforcement Learning : Neural net that produce neural net. Cool thing is that the authors are able to beat human generated model for text processing and deliver equivalent performance for image processing model. Who needs human anymore....
- Extreme-Scale Operating Systems : multi-OS research project at Intel aiming to be the node OS for HPC machine. Intel is trying to deliver a polymorphic OS that can quickly adapt to new software and hardware without the need for specialized solution like it exist commonly on high end HPC systems. To some extend it looks like the Jailhouse system. Where the HW is physically partitioned. A few core are dedicated for management, while the rest are partitioned and are running lightweight kernel (LWK) + application. Note that I really resent Intel for always trying to rename things that are commonly used. LWK are Unikernel dammit.. Anyway its jailhouse + unikernel for HPC.
- GPU-STREAM : Stream benchmark for GPU, much needed benchmark to understand and quantify memory transfer rate to from global memory device on GPUs.
Labels:
benchmark
,
gpu
,
HPC
,
intel
,
jailhouse
,
links of the day
,
operating system
,
unikernel
Wednesday, November 16, 2016
[Links of th Day] 16/11/2016 : Open Whisper, Security via BPF + XDP, Why cloud fails
- X3DH : stand for Extended Triple Diffie-Hellman key agreement protocol. It allow asynchronous secure communication.
- Cilium : BPF start to emerge as the dominant tool for any network functionality out there. Google cilium which leverage BPF and XDP for enforcing dynamic security rules via eBPF. [github]
- Why Cloud Fails : Excellent review by Murat on the paper analyzing various cloud failures . Turn out that the vast majority are config related and upgrade related. Human failure only represent a very small portion of the overall numbers. [paper]
Labels:
bpf
,
cloud
,
encryption
,
failure
,
google
,
links of the day
,
security
,
xdp
Monday, November 14, 2016
[Links of the day] 14/11/2016 : Time series features extraction, GCHQ data analysis platform and Alibaba's Kafka contender : RocketMQ
TsFresh : Automatic extraction of relevant features from time series. This is really usefull for anybody dealing with metrics. It allow in one sweep data cleaning and feature extraction.
Stroom : GCHQ data processing storage and analysis platform.
RocketMQ : Alibaba's MQ proposed as an Apache project. It tries to solve some of the limitation of Kafka while providing better performance.
Stroom : GCHQ data processing storage and analysis platform.
RocketMQ : Alibaba's MQ proposed as an Apache project. It tries to solve some of the limitation of Kafka while providing better performance.
Labels:
apache
,
gchq
,
kafka
,
links of the day
,
message queue
,
time series
Subscribe to:
Posts
(
Atom
)





