- kubernix : Single dependency, single node Kubernetes clusters for local testing, experimenting and development. This project uses NIX as it's underlying functional package manager.
- mirrorgate : this looks like a better version of Hygiea from capital one. From a quick glance at the code, it seems easier to deploy and extend. I think I will give it a spin and see what we can achieve with it. I strongly feel that wallboard application are essential for effective SRE/Devops and provide direct feedback to the teams while contextualizing it with business process output. What's probably missing from this version is the "executive" wallboard that Hygiea offers.
- jtc : select one or multiple elements from a source JSON and apply various actions on the selected elements at once. Another tool for your swiss army knife bash script.
A blog about life, Engineering, Business, Research, and everything else (especially everything else)
Showing posts with label devops. Show all posts
Showing posts with label devops. Show all posts
Thursday, October 17, 2019
[Links of the Day] 17/10/2019 : Kubernetes single node cluster using NIX , Devops Wallboard, Json CLI tool
Labels:
cli
,
cluster
,
devops
,
json
,
Kubernetes
,
links of the day
,
nix
,
SRE
,
wallboard
Thursday, September 19, 2019
[Links of the Day] 19/09/2019 : Golang DNS lib, tool for SQL query across databases, Linux Kernel Devops
- NewDNS : Want to build a DNS in GO, this is for you.
- OctoSQL : query tool that allows you to join, analyse and transform data from multiple databases and file formats using SQL.
- kdevops : devops framework for Linux kernel development that relies on ansible, vagrant and terraform, ansible roles through the Ansible Galaxy, and terraform modules. It aims at making setting up and testing the Linux kernel for any project as easy as possible. I wish I had that a couple of years ago.
Labels:
database
,
devops
,
dns
,
golang
,
links of the day
,
linux kernel
,
sql
Wednesday, May 30, 2018
The curse of low-tech Scrum
I recently read the following article that describes how scrum disempowers devs. It criticises the "sell books and consulting" aspect that seems to have become the primary driver behind the Agile mantra. Sadly, I strongly agree with the authors' view.
Scrum brings some excellent value to the technical development process such as :
- Sprints offer a better way to organise than Waterfalls.
- Force to ship functional products as frequently as possible to get feedback early and often from the end user.
- Requires stopping what you're doing on a regular basis to evaluate progress and problems.
However, Scrum quickly spread within the tech world as a way for companies to be "agile" without too much structural change. First, Scrum does not require technical practices and can be installed in place at existing waterfall companies doing what is effectively mini-waterfall. Second, such deployment generates little disruption to the corporate hierarchy (and this is the crux of the issue). As a result, Scrum allows managers and executives to feel like something is being done without disturbing the power hierarchy.
Even though the method talks about being flexible and adapting when there are real business needs to adjust to. The higher level of corporation rarely adjusts this approach which relegates scrum to allow companies to move marginally in the direction of agility and declare "mission accomplished". Agile providing a low-tech placebo solution to an organisational aspiration.
Last but not least adopting a methodology for the sake of it is often doomed to fail. If you have a customer that needs a new thing built by a specific date. Then scrum is less than ideal as it requires the flexible date and profoundly involved customer stakeholders in the process. The waterfall approach would be a better choice as it forces to define the project up front and allows for calling out changes to the plan and thus changes the scope.
It is often disappointing to see claims by consulting firms that organisation needs to adopt agile. It's a piecemeal solution that will only temporary mask deeper organisational problems without the required correct structural change. It's not because your dev teams started to use agile or devops that your organisation as a whole suddenly became agiler.
Don't misunderstand this blog post as a complete rejection of the principle of scrum and agile. It's not. The core ideas are awesome and should be adopted where it suits. Other methodologies such as waterfall, devops, etc.. have also their place in an organisation depending on the lifecycle stage of the products. However, these need to be adopted alongside organisational change beyond the devs teams to improve the overall operations and efficiency of the company. Without these, it's just a low-tech placebo.
Wednesday, March 08, 2017
[Links of the Day] 08/03/2016 : Intel blockchain, Fast17 conference and papers, AWS cloud formation devops tool
After a small hiatus, here is the return of the links of the day.
- Sawtooth Lake: Intel distributed ledger system. It uses an interesting security mechanism to deliver secure consensus. Sadly it relies on Intel proprietary hardware encryption modules to deliver this feature.
- Fast17: File and Storage technology Usenix conference happened last month. There were a couple of interesting papers but one picked my interest: Redundancy Does Not Imply Fault Tolerance:Analysis of Distributed Storage Reactions toSingle Errors and Corruptions. The authors look at single file system fault impact on Redis, ZooKeeper, Cassandra, Kafka, RethinkDB, MongoDB, LogCabin, and CockroachDB. Turns out most systems are not able to handle these type of faults very well. It seems that a single node persistency layer error can have an adversarial ripple effect as distributed system seems to have put way to much trust in the reliability of this layer. Sadly they lack tools for recovering from errors or corruption emerging from file systems.
- Stacker : remind 101 tools for creating and updating AWS formation stacks. Looks like an interesting alternative to terraform.
Labels:
automation
,
aws
,
blockchain
,
conference
,
devops
,
fault tolerance
,
intel
,
links of the day
,
storage
Tuesday, January 12, 2016
Links of the day 12/01/2016 : #devops for cynics, Probabilistic computing reading list, lambda conf vids
- MIT Probabilistic Computing Reading list : excellent list of probabilistic readings. Beware its really long but if you are interested in this type of technology its a must read to at least keep up to date.
- Devops for cynics : small ebooks for those out there that takes everything with a grain a salt.
- LambdaConf 2015 : playlist of all the talk at last year lambda conf
Labels:
devops
,
lambda
,
links of the day
,
probabilistic
,
programming
Friday, December 11, 2015
Links of the day 11/12/2015: Devops Summit, Intel's HPC framework, Cybercrime fail
- DOES15 : DevOps Enterprise Summit 2015 video
- Intel’s HPC Scalable System Framework Plans : delves into aspects of the framework and highlight the relationship and benefits to application development and execution.
- Cyber crime: Preventing young people from getting involved : this is just begging for a parody anti piracy video style
Labels:
conference
,
cybercrime
,
devops
,
HPC
,
intel
,
links of the day
,
parody
Thursday, December 10, 2015
Links of the day 10/12/2015: Networks, Crowds, and Markets book, end to end encrypted DB, low level Datacenter devops
- Networks, Crowds, and Markets : Books on the different scientific perspectives and approach to understanding networks and behavior. Drawing on ideas from economics, sociology, computing and information science, and applied mathematics, it describes the emerging field of study that is growing at the interface of all these areas, addressing fundamental questions about how the social, economic, and technological worlds are connected.
- ZeroDB : An end-to-end encrypted database protocol.
- Vapor : can't believe a company actually named themselves vapor .. anyway . While their hardware is semi interesting what really picked my interest is their Open Data Center Runtime Environment. It aims to offer capability to expose and manage low level DC capabilities such as Power and Temp. I am not sure if devops will really want to go that low but this might be a nice addition to orchestration framework for meta optimization.
Labels:
book
,
database
,
datacenter
,
devops
,
encryption
,
links of the day
,
management
,
power
Monday, September 14, 2015
Links of the day 14/09/2015 : devops cert, Byte-Addressable NVM, Kernel Bypass
- WrAP : paper on Managing Byte-Addressable Persistent Memory
- Kernel bypass : as network and storage get faster generic solution start to be seen as a limitation in current software stack. As a result we are seeing more and more bypass library. However it always end up being dependent on how efficient the end consuming software is.
- Devops League : There are plenty of DevOps certifications out there of varying quality. This one is the best. It is wonderful and You'll love it, too. You'll love it so much that you'll print out your certification and even put it on your résumé. You'll tell all your friends about it and even ask your loved ones to mention it at your funeral. RIP, by the way.
Monday, March 16, 2015
Link of the day 16 - 03 - 2015
Today's links 16/03/2015: #devops, time service, simultaneity in distributed system, value of data
- DIY Punk Rock DevOps Playbook : punk rock view of devops from Joyent CTO Bryan Cantrill
- Introduction to Time Service : after reading this one would really wonder why we still stick to NTP and not use GPS based clock system that provide multiple order of magnitude higher precision within data centers.
- There is No Now : a look into problems with simultaneity in distributed systems
- The Value of Data : 3-part series about building companies that leverage the value of data , part [1] [2] [3]
Labels:
bigdata
,
devops
,
Distributed systems
,
links of the day
,
time service
Thursday, December 11, 2014
Links of the day 11 - 12 - 2014
Today's links 11/12/2014: OS conf, #Unikernel : #Rump , #jitsu , atlas #devops, bgp image format
- New Directions in Operating Systems conference: video slide and audio of the 2014 conference, selected talk :
- Rump Rump kernels and {why,how} we got here
- Rumprun : unikernel for Posix application on top of rump
- jitsu : Just-in-Time Summoning of Unikernels
- Userland Networking and Userspace networking : when the network stack move out of the kernel
- BPG : Frabice Bellard is a new image format based on HEVC and supported by most browsers with a small Javascript decoder. You can see the comparison with other format here
- Atlas : bridge the gap between the devops split by bundling all 5 Hashicorp tools into a single SaaS solution. Really nice toolkit.
Labels:
devops
,
image
,
links of the day
,
networking
,
unikernel
Thursday, December 04, 2014
Links of the day 4 - 12 - 2014
Links of the day 4/12/2014: #devops tools, Distributed systems and Micron Automata processors
- Serverspec : framework using RSpec tests to validate server configuration
- Diamond : python daemon that collects system metrics and publishes them to Graphite (and others).
- Automata : Micron processor is designed to have complex, unstructured data written to it and to perform graph processing on that data, and provide analytic results back to the user or to the host system.
- Distributed systems for fun and profit : distributed programming and systems concepts you'll need to understand commercial systems in the data center.
Labels:
automata
,
devops
,
Distributed systems
,
processor
Subscribe to:
Posts
(
Atom
)