Citadel BSync Replication

Core Accomplishments

• Distributed Ingestion Engine: Co-designed and deployed BSync, a fault-tolerant HTTP synchronization application that scheduled, coordinated, and executed large file-copy processes between Citadel's on-premises systems and AWS.
• Coordination Layer: Utilized Consul to manage distributed locks across replication agents, preventing race conditions and resource contention during high-volume batch runs.
• Scale & Throughput: Allowed a small 3-person team to coordinate and monitor the successful weekly ingestion of dozens of multi-terabyte financial datasets.