- Exactly once messaging : more rant on the subject, basically guarantee anything , especially message behavior is hard. Its even harder without formal proof and most system out there do not have any.
- Hammer Protocol : an implementation of Tor Routing for Web Services
- Decentralized Trusted Timestamping using the Crypto Currency Bitcoin : interesting, however it beg the question, how do you garantee that the timestamp generated in the first place is accurate. Unless the time at each peer signing it is accurate we can have huge variation.
- High-Performance and Scalable Designs of Programming Models for Exascale Systems :focus on programming models and their designs for upcoming exascale systems with millions of processors and accelerators such as current status and future trends of MPI and PGAS (UPC and OpenSHMEM) programming models.
A blog about life, Engineering, Business, Research, and everything else (especially everything else)
Wednesday, April 01, 2015
Links of the day 01 - 04 - 2015
Today's links 01/04/2015: Messaging, WS #Tor Routing, #Bitcoin time stamping, HPC programming model
Labels:
bitcoin
,
HPC
,
links of the day
,
Messaging
,
tor
Thursday, March 26, 2015
Links of the day 26 - 03 - 2015
Today's links 26/03/2015: #HPC Network and #Kafka REST proxy
- Receiving Packets at the Speed of Light : Data Plane Acceleration for modern network when the amount of time to process packets decreases to as little as 6.7ns per packet at 100Gb/s. A memory barrier can cause stalls of 7ns or more strategies must be devised to mitigate in order to avoid wasting bandwidth.
- Multi-Host Technology in OCP-Server Track : Mellanox ConnectX-4 (100GbE)+Multiple Heterogeneous Hosts (x86, POWER, ARM, GPU) [slides]
- slimFly : high-performance cost-effective network topology that approaches the theoretically optimal network diameter.
- Kafka REST proxy : making it easy to connect to a Kafka cluster
Labels:
HPC
,
kafka
,
links of the day
,
network
,
rest
Wednesday, March 25, 2015
Links of the day 25 - 03 - 2015
Today's links 25/03/2015: #RDMA, #NVM, Google Build tools, OFS dev workshop
- Bazel : Google build tool that builds code quickly and reliably, a lot of nice feature in there, automated testing, rule based integration , caching ,parallelism, language and platform diversity.
- A Comparison Of Log-Structured Merge (LSM) And Fractal Tree Indexing : Trees everywhere!!
- Prototyping Byte-Addressable NVM Access : fine granularity doesn't always make things easier to use
- RDMA and NVM Programming Model : I predict strange behavior with RDMA unless all vendor agree onto a single common API for atomic persitency.
- 2015 International OFS Developer’s Workshop Video Gallery
Monday, March 23, 2015
Links of the day 23 - 03 - 2015
Today's links 23/03/2015: Full stack Lttng profiling, #RDMA + #HADOOP , VRAM data leakage, difference between DL vs ML vs PR in AI (acronym overload)
- Full stack system call latency profiling : demo of Lttng based profiling similar to the linux perf tools. It allows the use the static kernel tracepoints to dynamically decide what and when to record relevant information for our use-case and trying to find the needle in the haystack.
- HiBD : RDMA-based Apache Hadoop 2.x solution. Feels like Big Data is just going through the same evolution curve as HPC
- Is your VirtualBox reading your E-Mail? : Collecting data from VRAM. I wonder when we will see the first proof of concept attack of cross VM information leakage over (GP)GPU
- Deep Learning vs Machine Learning vs Pattern Recognition : if you ever wonder what the hype is really about.
Labels:
Artificial intelligence
,
deep learning
,
hadoop
,
links of the day
,
machine learning
,
pattern recognition
,
profiling
,
rdma
,
security
,
vram
Thursday, March 19, 2015
Links of the day 19 - 03 - 2015
Today's links 19/03/2015:#python framework, #linux perf tools, #bitcoin API, Memory-centric distributed #storage
- SuPPort : in-development distillation of PayPal Python Infrastructure. SuPPort is an event-driven server framework built on top of several open-source technologies designed for building scalable and maintainable services and clients.
- Linux Performance Analysis: New Tools and Old Secrets : Brendan Gregg's excellent talk on new Linux performance tools: perf-tools collection. These use existing kernel frameworks, ftrace and perf_events, which are built in to most Linux kernel distributions by default, including the Linux cloud instances he analyze at Netflix.
- Coinkite : Bitcoin API provides simple and powerful REST integration for adding bitcoin functions into application.
- Tachyon: A memory-centric storage system enabling reliable file sharing at memory-speed across cluster frameworks, such as Spark and MapReduce. [SOCC 13] [Github]
Labels:
bitcoin
,
links of the day
,
linux
,
memory
,
performance
,
python
,
storage
Wednesday, March 18, 2015
Links of the day 18 - 03 - 2015
Today's links 18/03/2015: NVDIMM , Dynamic CPU Cache allocation, NAS + Bigdata Analytic, DPDK packet generator
- Atomic Sector Updates inSoftware for Persistent Memory : Intel proposal to adress atomic sector update as byte addressable persistent storage is great but limited when you want to do large write.
- Priority-Based Cache Allocation in Throughput Processors : interesting approach that propose to dynamically vary the amount of cache allocated to processors based on the pollution rate. Allowing cache friendly process to benefit from greater cache real estate [slides]
- Qumulo : start up proposing a file system with Analytic capability directly embedded within the NAS [spec]
- MoonGen : fully scriptable high-speed packet generator build on DPDK and LuaJIT. It can saturate a 10 GbE connection with 64 byte packets on a single CPU core while executing user-provided Lua scripts for each packet. It also features precise and accurate timestamping and rate control.
Tuesday, March 17, 2015
Links of the day 17 - 03 - 2015
Today's links 17/03/2015: hash table datastructure and hashing Algorithm, #ARM virtualization, Hyper-converged Solution
- A Fast, Minimal Memory, Consistent Hash Algorithm : interesting and minimalist (in a good way) hashing algorithm allowing simple variable partitioning of the address space.
- Fast Bounded-Concurrency Hash Tables : very nice lock free data structure with bounded guarantee. This is an impressive piece of work.
- ARM virtualization extensions : in depth look into the virtualization features and extension of the ARM platform.
- Datacore & Huawei : Huawei FusionServer servers running DataCore SANsymphony-V software with Huawei Oceanstor direct-attached storage made into a virtual SAN across 2 to 64 servers.
![]() |
| from Adexchanger comic strip |
Labels:
algorithm
,
arm
,
datastructure
,
hash
,
hyperconverged
,
links of the day
Subscribe to:
Posts
(
Atom
)






