Shipping a Trillion Parameters With a Hub Bucket: Delta Weight Sync in TRL - Tech Sentiments