Syncthing

The data required to run a web service, such as files and databases, must be replicated across all servers capable of hosting that service. Presently, Syncthing is used for this replication. Syncthing allows encrypted, peer to peer (p2p) data synchronization and doesn’t leak data to any external company. Beyond that, it plays very nicely with the other tools used in this architecture. Unfortunately, Syncthing requires full file replication, instead of sharding data, and can cause services to break when hosted by multiple services. It can also, occasionally, break services by not fully replicating metadata, such as proper ownership permissions. Because of these flaws, a better suited solution for data replication within the Web Infrastructure is being developed; that project is the Cache Tier File System.