- Combining knowledge graphs : The authors describe a new entity alignment technique that factors in information about the graph in the vicinity of the entity name. It provides a 10% higher accuracy while reducing computational cost for model generation.
- Wizard : project looking into real-world storage reliability for cost-effective data and storage resource management system for reliability enhancement.
- Elle : Jespen black-box transactional safety checker based on cycle detection. You can find more in the Arxiv Paper by Kyle Kingsbury and Peter Alvaro : "Elle: Inferring Isolation Anomalies from Experimental Observations"
A blog about life, Engineering, Business, Research, and everything else (especially everything else)
Showing posts with label SSD. Show all posts
Showing posts with label SSD. Show all posts
Wednesday, May 27, 2020
[Links of the Day] 27/05/2020 : Combining Knowledge graphs, Real World storage resource management, Jespen black box transactional safety checker
Labels:
black box
,
failure
,
jespen
,
knowledge graph
,
links of the day
,
machine learning
,
safety checker
,
SSD
Thursday, December 19, 2019
[Links of the Day] 19/12/2019 : Machine learning at arXiv, Netflix human centered machine learning infrastructure management library, Filesystems are still not fully SSD aware
- arXiv Machine Learning Classification Guide : how does ArXiv classify papers automatically with machine learning and what they plan to do with it in the future.
- Metaflow : Netflix open source it's human-centred python library for managing machine learning infrastructure. It can user PyTorch, Tensorflow and Scikit. [website]
- Evaluating File System Reliability on Solid State Drives : Your filesystem needs to understand the underlying hardware in order to guarantee reliability and security of the data stored. Nowadays the majority of storage solution relies on SSD but the authors discovered that many of the common filesystems are not fully SSD aware in their operations. They demonstrated that in 16% of the case faults resulted in irrecoverable failures.
Labels:
ai
,
arxiv
,
aws
,
filesystem
,
links of the day
,
machine learning
,
netlfix
,
SSD
Thursday, June 08, 2017
[Links of the Day] 08/06/2017 : Machine Learning Tuning DBMS, Direct SSD to GPU SQL and Large Graph DB processing
- Tuning DBMS with Machine Learning : From the people behind Peloton, they demonstrate a way to automatically tune DB using machine learning. This is rather interesting, however, there is a key element that is missing in the approach: Cost. Your DB system can become highly optimise but your AWS cost can skyrocket too. What you need is a system that automatically tunes perf & cost tradeoff to maximise ROI Sometimes being a little bit slower can save $$
- MOSAIC : More heterogeneous approach: graph processing engine that exploits all the hardware resources available in a standard Xeon host processor, Xeon Phi coprocessors, NVMe, and a fast interconnect. Because fast processing of your Facebook social network for fast advertisment targeting is worth it :) [slides]
- PG-Strom : By-passing CPU for SQL operation by allowing direct SSD to GPU communication for Postgress SQL processing. We are slowly entering the age of heterogeneous computing system were core CPU get relegated to highly generic tasks. [slides]
Labels:
database
,
gpu
,
graph DB
,
links of the day
,
machine learning
,
sql
,
SSD
Monday, July 11, 2016
[Links of the day] 11/07/2016: SSD failures, BCC , NUMA deep dives
- SSD Failures in Datacenters : Best student paper : SSD fail, What? When? And Why?
- BCC : I have been trying to trace some nasty RCU stall bug ( which turn out to be just the symptom of another problem) and BCC was really useful with this ordeal. It is quickly turning into the linux swiss army knife of debugging. BPF is an amazing piece of software.
- NUMA Deep Dive Series : Start of a series of posts looking into history and modern NUMA architecture.
Labels:
datacenter
,
kernel
,
links of the day
,
linux
,
numa
,
SSD
Monday, May 02, 2016
[Links of the day] 02/05/2016 : All about storage @ Intel IDF 16 + no more secret
- Storage Transition : NVM Express and PCI Express in the Client and Data Center
- Intel Non-Volatile Memory Inside : A look into 3d NAND and next gen SSD
- Modern Storage Architectures : The implication of new fabric and NVM tech for modern storage architectures
- No more secrets : recreate the famous "decrypting text" effect as seen in the 1992 movie Sneakers
Labels:
architecture
,
idf16
,
intel
,
links of the day
,
network fabric
,
nvm
,
pcie
,
SSD
,
storage
Monday, June 08, 2015
Links of the day 08 - 06 - 2015
Today's links 08/06/2015: #SSD no panacea for VMs, Hardware X86 #security breach, #Bigdata stream engine
- SSD no panacea with VM : because of is operational model SSD tend to have poor performance in virtual environment when shared across multiple VM. The authors suggest to isolate and dedicate SSD for each VM in order to benefit from the speed benefit of SSD. Micro storage solution anyone ?
- X86 design flaw : Apparently there is a way to escalate from ring 0 to the high privileged state. This can be really interesting if this would enable VM or container to escape and gain access to the bare-metal system. : :
- Heron : the descendant of Storm by Twitter. The architecture seems nice and try to address some of Storm shortcoming.
Labels:
bigdata
,
distributed system
,
links of the day
,
security
,
SSD
,
storage
,
Stream Processing
,
virtualization
,
vm
,
x86
Thursday, February 19, 2015
Links of the day 19 - 02 -2015:
Today's links 19/02/2015: Technical debt, #Microservices & µ²services, SSD
- Technical debt financial metaphor : using finance term to describe technical debt, however I feel that we need to introduce the concept of refinancing, restructuring of technical debt. Without forgetting the bankruptcy option when there is really no other choice.
- Microservices - stress-free and without increased heart attack risk : a short explanation why µservice are always hard (yes, the title of the presentation is sort of an oxymoron) and what kind of architectural trade-off they are compared to monoliths.
- What every programmer should know about solid-state drives : Part 6 summarizing the key information ( you can find link to the previous 5 parts in the page)
- Micro Micro Services : proposed to push the concept of micro service one step further when you have a single container per request per service and not service alone. There is certain advantage however until the technology to make this approach seamless ( such as flash cloning etc..) it will remain a nice thought exercise ( follow up post here ) .
Labels:
links of the day
,
microservices
,
SSD
,
technical debt
Subscribe to:
Posts
(
Atom
)





