If you like it need and clean then the covers belong there.
Every airline that has the HUDS installed uses the covers as per manufacturers recommendation and actually prerequisite to not void the guarantee.
These things are expensive and you don't want any scratches on them. Thefore they are always stowed away with the covers on them when not used.