- KVM forum : slide deck of the 2015 KVM forum, some gems in there especially related to the real time efforts.
- A tale of two laws : As Amdahl’s law and Moore’s law reach their 50th anniversaries, this paper review the roles they have played in shaping both perception and reality in high-performance computing. Along the way, it also attempt to clarify some misconceptions that have surrounded both of these highly influential but not always fully appreciated ‘‘laws.’’
- NVM Express - The Data Center and Client Storage Transformation: Loads of good stuff from Intel IDF 2015, i ll be distilling it over the next week. But this one is particularly interesting talk by Intel and DSSD folks ( acquired by EMC recently). It show how the new tech is trying to cut the CPU out of the loop as much as possible and storage start to embrace Memory type transaction model ( RDMA ). To a certain extend storage is just being absorbed back into the overall memory model. The interesting bit is that because of the current performance limitation of flash couple with the fabric capabilities there is a very small overhead in using remote storage vs local one.
A blog about life, Engineering, Business, Research, and everything else (especially everything else)
Friday, August 21, 2015
Links of the day 21/08/2015: #kvmforum , Two laws, and NVMe transforming the Datacenter
Thursday, August 20, 2015
Links of the day 20/08/2015 : #Facebook DC network, #cloud at #Berkley go BOOM and Eve
- Inside the Social Network’s (Datacenter) Network : A very insight full and deep look into Facebook data center networking. What's interesting to see is that there is a non negligible inter data center communication going on there.
- BOOM : Berkeley Orders Of Magnitude project, Enabling the construction of data-rich systems at unprecedented scales using a minimum of software.
- Eve : version 0 : a relational database, a new programming language, an IDE, and a UI editor, all built from scratch to fit our goals for a better programming foundation. Ambitious project, lets see how it develop.
Labels:
berkley
,
cloud
,
datacenter
,
facebook
,
links of the day
,
network
Wednesday, August 19, 2015
Links of the day 19/08/2015 : #Google at Scale , Data Flow Model and Cost allocation at #MSFT
- Shapley Value Approach for Cost Allocation in the Cloud : Microsoft resource allocation in the cloud
- Data Flow Model : the google manifesto to move away from batch to streaming.
- What does it take to make Google work at scale? : What going at scale really means.
Labels:
bigdata
,
cloud
,
google
,
links of the day
,
scale
,
scheduling
Tuesday, August 18, 2015
Links of the day 18/08/2015 : #RDMA fabric, #ReRAM NVDIMM, #Micron & 64bit dev problem
- Congestion Control for Large-Scale RDMA Deployments : Microsoft Research paper demonstrating how they look at flow control in mixed use environment with RoCE. What's interesting is that it show that Microsoft start to heavily leverage RDMA in its data-center in order to deliver fast guaranteed performance especially in the storage domain.
- ReRAM Storage Class Memory NVDIMM : Viking technology already had a Flash NVDIMM offer, but it seems they are expanding with the faster ReRAM type of tech. Probably in direct competition with 3DxPoint from Intel. I need to dig into the spec to see what are the trade-off between the different tech in term of cost/GB/Perf.
- 64 bit program development forgotten problems : me bug you long long time.
- Micron analyst presentation : interesting to see that the NB of datacenter customer represent is roughly equal to the number of enterprise one. Obviously we are at the tipping point where datacenter will clearly outtake enterprise in IT HW consumption following the natural shift from product to utility. Does that means that traditional storage vendor will be relegated to niche market in the future?
Monday, August 17, 2015
Links of the day 17/08/2015 : #NVMe & #RDMA , #Strategy , Cryptography in hostile environment
- NVMe over RDMA fabric : interesting bit PMC Sierra and Mellanox unveiled NVMe ove RDMA fabric as well as peer direct technology for NVM storage. This open up a certain world of possibility where you could combine without CPU involvement GPU - NVM(e) - RDMA. Literally offloading all the storage operations.
- Strategy Scenario and the use of mapping : excellent series of posts by Simon Wardley showing how leveraging his mapping technique allow CEO - CIO to navigate the tortuous strategic decision. The Analysis of the scenario can be found here
- The network is hostile : TL;DR: we don't encrypt enough and early enough
Labels:
cryptography
,
links of the day
,
Mellanox
,
network
,
nvme
,
rdma
,
strategy
Friday, August 14, 2015
Links of the day 14/08/2015 - a lot of Kalman Filter and some Flabbergast
- Kalman Filter illustrated : a general and powerful tool for combining information in the presence of uncertainty
- Stochastic model, estimation and control : more about Kalman filter and other stochastic model
- Kalman Filter: Kalman Filter textbook using Ipython Notebook
- Flabbergast : a object-oriented macro system that uses contextual lookup (dynamic scope) and inheritance to making writing complex configurations easy.
Labels:
configuration
,
kalman filter
,
links of the day
Thursday, August 13, 2015
Links of the day 13/08/2015 - Flash failure @ #facebook , tech behind #google voice and its datacenter network provisioning, distributed system #cloud challenges
- Distributed systems research agenda for cloud computing : a nice summary of opportunities and challenges for cloud and distributed systems in general
- Flexible Network Bandwidth and Latency Provisioning in the Datacenter : a hint at how google provision its internal network resource.
- The neural networks behind Google Voice transcription : ever wondered how google voice works?
- Large-Scale Study of Flash Memory Failures in the Field : Facebook study on Flash memory failure . The really interesting bit : "Sparse data layout across an SSD’s physical address space (e.g., non-contiguously allocated data) leads to high SSD failure rates; dense data layout (e.g., contiguous data) can also negatively impact reliability under certain conditions, likely due to adversarial access patterns". This interesting especially with product like Memory 1 from Diablo which expose byte addressable Flash. The implication is that RAM like access type might drastically reduce the lifespan of flash device and make such technology potentially poor choice for byte addressable memory stack.
Labels:
distributed system
,
failure
,
flash
,
links of the day
,
network
,
neural networks
Subscribe to:
Posts
(
Atom
)






