Reflections Of The Void: hash

Showing posts with label hash. Show all posts

Monday, September 12, 2016

OmniHash and Rhash : Omni hash is a Python multi hash library , RHash provide similar functionality but in C . They are both small and versatile.
Goto Chicago , Amsterdam , and Stockholm conference 2016 videos : loads of good content and some rehashed one.
Papers we love conference : I am so jealous of the people who can attend. This looks like an amazing conference, I will link to the slides deck / video as soon as they are up.

Best Practices for Building a Microservice Architecture : Article providing an overview of the best practice when shifting complexity from a monolithic systems to a distributed one. Complexity doesn't disappear, it is bounded to the interactions between simple services. While this sound great, the complexity increase with the degree of interactions which can follow a power law.
Semantic Hashing : paper describing a method using deep learning algorithms for generating fast hash of documents. This method allow to generate locality sensitive that permit to execute similarity search over a vast library of documents in a time independent of the size of the collection.
Principles of Programming Languages : book providing an introduction to the study of programming languages derived from Johns Hopkins University programming language courses.

Worst-Case Distributed Systems Design : nice blog post on the advantage of designing distributed systems with handle worst-case scenarios gracefully in order to improve average case behavior handling.
Parallella : 18-core credit card sized computer, nice playground for parallel programming ( and hence publications)
2015 Storage Developer Conference Presentations | SNIA : slide deck of the conference, some gems in there:

RDMA + PMEM : coupling pmem with RDMA in order to deliver remote persistent memory.
NVDIMM cookbook : very good overview of what you can do and use case of NVDIMM.
Hashing algo for storage : Very good overview of the main hashing techniques, trade-off etc.. of hashing techniques for K/V (not just for storage)
Pro & Cons of Erasure Code vs Replication vs Raid : as always its depends but here is the exec summary : RAID is reaching its limit, Erasure code is the preferred option for large scale however replication is required if you want certain type of performance. Finally everything will be really dependent of the storage defined system running it.

Today's links 17/03/2015: hash table datastructure and hashing Algorithm, #ARM virtualization, Hyper-converged Solution

A Fast, Minimal Memory, Consistent Hash Algorithm : interesting and minimalist (in a good way) hashing algorithm allowing simple variable partitioning of the address space.
Fast Bounded-Concurrency Hash Tables : very nice lock free data structure with bounded guarantee. This is an impressive piece of work.
ARM virtualization extensions : in depth look into the virtualization features and extension of the ARM platform.
Datacore & Huawei : Huawei FusionServer servers running DataCore SANsymphony-V software with Huawei Oceanstor direct-attached storage made into a virtual SAN across 2 to 64 servers.

Today's links 06/02/2015: Hashing, Distributed time series / monitoring , MTU, Spray list

Perfect hashing : when you like your hash without collision
Prometheus : Some interesting concept such as data is sharded and local only for reliability and scalability, time series oriented storage and query system and expose time series via key value pair.
Path MTU discovery : when you want to know what is the biggest frame you can send when you do not own 100% of the network path ( or if you just forgot)
Spray list : nice data structure delivering scalable relaxed priority queue[github implementation]

Today's links 06/10/2015: hash functions collections, monoids, functors, applicatives, and monads, category theory

Hash functions : collection of hash functions, ciphers, tools, libraries, and materials related to cryptography
Monoids, Functors, Applicatives, and Monads : the different properties of monoids, functors, applicatives, and monads packed into a neat post.
Introduction to Category Theory : Category theory is a mathematical approach to the study of algebraic structure that has become an important tool in theoretical computing science, particularly for semantics-based research.

Today's links : Big data, deep learning, Cryptography, Microsoft Dev practice evolution

TESSERA : Open Source Environment for Deep Analysis of Large Complex Data
New algorithm shakes up #cryptography : Researchers have solved one aspect of the discrete logarithm problem
A Fast, Minimal Memory, Consistent Hash Algorithm : fast, minimal memory, consistent hash algorithm in 5 lines of code!
How Microsoft dragged its development practices into the 21st century : the long road to move toward an agile dev ops oriented practice at Microsoft.

Today : hash , compression, economics in Memory DB and anonymity made simple

xxHash : a fast 64 bit wide non cryptographic hash ( code )
History of Lossless Data Compression Algorithms : a very nice overview of the history of loss less data compression algorithms by IEEE
The Sacred Economy : how the money system will have to change—and is already changing, didn't have time to read it yet, but planning too. ( or if you want the book directly )
Aerospike : Flash optimised nosql database has been open sourced.. They have some bold claim on the performance of their product
Streisand : sets up a new server running L2TP/IPsec, OpenSSH, OpenVPN, Shadowsocks, Stunnel, and a Tor bridge. It also generates custom configuration instructions for all of these services. At the end of the run you are given an HTML file with instructions that can be shared with friends, family members, and fellow activists.