Storage Clustering Solution Architect

Joystream Video DAO is actively looking for a Storage Clustering Solution Architect to design, prototype and document Kubernetes and CEPH storage node implementation, to be adapted and used by the storage group workers.

As the Joystream DAO grows and accrue more creators the requirement for more storage capacity grows faster. Currently SWG workers are running standalone servers with as many disks as the server can take. This naturally have problems:

- Max server capacity

- Migrating data to new bigger servers.

- Cost is not optimized.

The DAO is looking for midterm solution of clustering servers storage and providing a headend server/s a mountable elastic storage capacity that can be expanded at will.

The DAO is looking for long-term solution of clustering servers storage and providing a object storage that is elastic storage capacity and can be expanded at will.

Deliverable:

- Design Kubernetes and CEPH storage node implementation for: block storage and object storage

- Prototype Kubernetes implementation that includes for each storage type:

- Colossus storage server

- Query node and joystream-node.

- Ngnix front end

At least three storage CEPH integrated servers.

- Monitoring: Prometheus, nodeexporter, cadvisor, Grafana and alertmanager.

- Full documentation of the implementation in Github.

This is a one time task and requires efficiency in execution.

More info: https://joystream.org

Requirements

- High availability

- Having access to IT infrastructure.

- Skills: Linux, Docker, Kubernetes, CEPH, docker/docker-compose, nginx or Caddy, GraphQl, Prometheus, git/github, bash/java script/Python

- Deliver within the agreed time frame.