Add cleanup_delay configuration item with a default of five seconds