It depends on the cut, fabric weight and overall style of the set. Minimal loungewear trousers and a jumper can sometimes be paired with casual footwear for short trips outside. However, styles designed specifically for sleeping are not always suitable in this context. Consider the intended use of the garment and whether the overall look feels appropriate.