- Numpy Cheat Sheet: all you need for data analysis in python with NumPy
- Mathematical Model of innovation patterns: Vittorio Loreto at the Sapienza University of Rome in Italy and al, created the first mathematical model that accurately reproduces the patterns that innovations follow.
- Persistent Memory Summit: SNIA NVM summit 2017. Finally, with the introduction of Intel 3dXpoint, we start to see more HW NVM solution out there. And with that software that uses it. Some really interesting talks:
- Nova file system demonstrates the benefit of NVM optimises storage solution.
- SAP Hana on NVM: interesting to see that they still require redundant copies as they fear data corruption on NvDimms. I wonder when we will start to see ECC NvDimms on the market?
- New interconnect: lots of hot new interconnects battling for the heterogeneous compute ecosystem domination. And this pass by offering persistent memory specific solution: Gen-z provide PM pooling, Open CAPI accelerate PM access and CCIX share PM
A blog about life, Engineering, Business, Research, and everything else (especially everything else)
Showing posts with label interconnect. Show all posts
Showing posts with label interconnect. Show all posts
Tuesday, January 24, 2017
[Links of the Day] 24/01/2017 : Numpy cheat sheet, Innovations patterns, Persistent memory summit
Labels:
innovation
,
intel
,
interconnect
,
links of the day
,
mathematics
,
model
,
nvm
,
persistent memory
,
snia
Monday, November 21, 2016
[Links of the Day] 21/11/2016 : Erasure Code for Big data and cluster cache, Emerging Interconnect Tech
- Erasure Coding for Big-data Systems : Technical report presenting the state of the art of erasure code and how they are use in practice.
- EC-Cache: the authors present an interesting solution. Where they combine erasure code to compensate for limitation of selective replication. The solution provide a load-balanced, low-latency cluster caching and improve resilience against failure from the inherent benefit of the code.
- Emerging Interconnect Technologies : really cool overview of the current and future of the interconnect especially on chip or chip to chip interconnect. This looks at the future of communication when chips will be stacked to keep Moore's law going.
Labels:
bigdata
,
cache
,
Distributed systems
,
erasure code
,
interconnect
,
links of the day
Friday, October 28, 2016
[Links of the day] 28/10/2016 : 3D chip stacking Wireless interconnect, Golem reverse MVC framework, Data Cleaning with R
- ThruChip : The trend is to stack chips to save space and increase bandwidth. Most solution use Thru-Silican Vias (TSV) solution. Instead of using TSV, ThruChip company propose to use wireless interconnect to link the different chips and claims that they can achieve terabytes/s of bandwidth. [video] [slides]
- Golem : Golem turns the MVC app inside out by making the client the intermediary between the application servers and the database.
- Data cleaning with R : data cleaning often take more time than the analysis itself. This paper describe how to do it fast and efficiently with R.
Labels:
framework
,
interconnect
,
language
,
links of the day
,
R
,
wireless
Wednesday, September 21, 2016
[Links of the day] 21/09/2016 : NAS 16 , cloud optical interconnect, Netmiko
- NAS : 2016 networking, architecture and storage conference, selected papers:
- CircularCache : storage wide cache system using virtual queue mechanism for load balancing usage and performance accross the cluster.
- Active Burst-Buffer : when storage is not fast enough you start to move your processing int he buffers to save time
- Emerging Optical interconnect Technology for the Cloud : Finisar presentation , the largest fiber optic transceivers provider in the world, on the trend in cloud interconnect technology. Like HPC and other system its all about power / bits / seconds. Power decrease while bandwidth needs to increase. What is interesting is the impact of the topology used on the fabric requirement ( HPC vs hyperscale datacenter). What is impressive is that aggregate bandwidth doubles every 3 years but that cost per Gbps is lower for higher channels counts at the same point in time.
- Netmiko : paramiko wrapper simplifying SSH connections to network device
Labels:
burst buffer
,
cache
,
cloud
,
conference
,
interconnect
,
links of the day
,
optical
,
python
,
ssh
Tuesday, January 05, 2016
Links of the day 05/01/2016 : Rethinking memory systems, Fractal Merkle tree and 5th edition of the redbook
- Rethinking Memory System Design (along with Interconnects) : Presentation on the evolution of memory system , their challenge (rowhammer is looked at) and how Interconnects will play a major role in shaping the future of the technology. It seems that we are looking for a further integration of the interconnect and memory ( volatile or not) systems. However HW vendor need to remind themselves that now the protocol need to bridge many different layers and it needs to be allowed to be used across many scale. Silicon only is not an option anymore.
- Fractal Merkle Tree Representation andTraversal : paper presenting a technique for traversal of Merkle trees which is structurally very simple and allows for various tradeoffs between storage and computation.
- Readings in Database Systems, 5th Edition : the 5th edition of the redbook is out! A must read for anybody dealing with database and associated optimization.
Labels:
book
,
database
,
interconnect
,
links of the day
,
memory
,
Merkle Tree
,
nvm
,
optimization
,
paper
Subscribe to:
Posts
(
Atom
)