Links of the day 27 - 01 - 2015

Today's links 27/01/2015: #NLP library, Queuing Theory, #NVM in #HPC

• SpaCY : Industrial-strength NLPlibrary for text processing in Python and Cython. 
• Queuing Theory Explained : Simple introduction to QT. 
• Opportunities for Nonvolatile Memory Systems in Extreme-Scale High Performance Computing : NVM is here to stay and take over the classic memory / persistence stack.

Mem0r1es

Links of the day 26 - 01 - 2015

Today's links 26/01/2015: #compression, text extraction, #cloud message queue comparison and #benchmarking

• ZSTD : short for Z-Standard ( and not Zombie-STD - dirty mind...), is a new lossless compression algorithm, aiming at providing both great compression ratio andspeed for your standard compression needs. It delivers decompression a rate around ~500 MB/s per core and compressiong rate of 200 MB/s ( so no real time for you).
• Ocropus : when you need to extract text from an image 
• Comparison of Message Queue Architecture on AWS : the short version is that if you are not latency sensitive and don't want to spend too much effort use SQS for job management and Kinesis for event stream processing. On the contrary if latency is critical ELB or RabbitMQs (or beanstalkds) for job management and Redis for event stream processing.
• Flotilla : Automated message queue orchestration for scaled-up benchmarking.

Compression, César 1991

Links of the day 23 - 01 - 2015

Today's links 23/01/2015: #cloud storage - Open vStorage, #bitcoin #blockchain scalability, shortest path in corporate communication

• Open vStorage :  its roadmap and some interesting bits on its architecture.
• Blockchain scalability : A look at the stumbling blocks to blockchain scalability and some high-level technical solutions.
• Surprising Facts About Shortest Paths : In a corporate communication network  the shortest path is not the fastest ( Social Network Analysis ). In other words, don’t let your train pass through the central hub for a shortcut, ’cause it’s going to stay there for a long long time.

Links of the day 22 - 01 - 2015

Today's links 22/01/2015: NUMA & VMs,#openstack & messaging, continuous deliver

• Estimating memory locality for virtual machines on NUMA systems : using sampling techniques to 
• Scaling openstack - messaging : scaling is hard , especially when your messaging stack is already showing sign of weakness.
• Continuous Delivery at Scale: how CD evolve at Linkedin 

Links of the day 21 - 01 - 2015

Today's links 21/01/2015: cost of #bigdata scalability and when you are stuck in the middle, to big for small data and to small for big data : #mediumdata

• Scalability! But at what COST? : Big data systems may scale well, but this can often be just because they introduce a lot of overhead. Rather than making your computation go faster, the systems introduce substantial overheads which can require large compute clusters just to bring under control. In many cases, you’d be better off running the same computation on your laptop. This has been a well know side effect in HPC as for certain type of problem high parallelism just create more overhead than accelerate the processing. The only need for such cluster is the lack of capabilities to buy hardware that is able to fit the necessary amount of data. I guess often people prefer to buy a lot of small cheaper server and say : "look i m running a cluster", than one single beefed up machine that would solve the problem faster.
• Medium Data : when your big data is too small to warrant a cluster but too big to fit within a single machine .. I think the authors of this article and the one above should collaborate on a follow up one. Also.. one size fit all does not exist.. News at ten.

Links of the day 20 - 01 - 2015

Today's links 20/01/2015: Bloom filters, #Unikernel, API framework

• Dablooms : scalable, counting bloom filter library [github]
• Performance Evaluation of OSv for Server Applications : where performance matter unikernel can significantly improve your applications performance and stability under load. 
• Swagger: nice API framework

Links of the day 19 - 01 - 2015

Today's links 19/01/2015: Data-structure books, #cloud and business agility, Leslie Lamport interview

• Air Combat, Communism, Coal, and Clouds: Understanding Business Agility and IT Spending in the Age of Cloud, Gartner Symposium 2013 [slides]
• Leslie Lamport on LaTeX, Paxos, Distributed Systems, TLA and TLA+ :Interview with Leslie Lamport by Charles Humble on Jan 17, 2015
• Open Datastructure : Open book on datastructure with python / java code associated
• Data Structures and Algorithm Analysis :  third edition of the textbook by Clifford A. Shaffer